Assessment Solution Strategist

About the role

Assessments are only as powerful as the thinking behind them. At Pluralsight, we believe that measuring skills well is one of the most meaningful things you can do for a technologist's career — and we're looking for someone who feels the same way. As an Assessment Solution Strategist, you'll own the full lifecycle of assessment design and quality for a platform used by thousands of learners and organizations worldwide.

Responsibilities

• Blueprint to delivery | Design assessment blueprints, generate item prompts, develop items across the full complexity spectrum, and manage forms from creation through continuous improvement.
• Performance monitoring & analytics | Run item and test analyses, calibration, equating, scaling, and reliability/validity checks. Flag issues, investigate root causes, and drive continuous improvement across the assessment portfolio.
• Standards, content guidelines & QA | Contribute to assessment content standards and ensure the portfolio aligns to curriculum and learning objectives. Apply item-level QA with a sharp editorial eye and advise on evidence-based assessment practices.
• Vendor & partner relationships | Lead day-to-day collaboration with SMEs and vendors, support SOW execution, and manage multiple concurrent projects to deadline — independently and without hand-holding.
• Documentation & process ownership | Author and maintain processes, procedures, and decisions related to assessment design, development, and continuous quality monitoring. Resolve complex queries from internal partners and escalate where appropriate.

Requirements

• Bachelor's degree in educational or psychological measurement, instructional design, psychometrics, or a related field
• 3+ years of relevant professional experience designing and developing high-integrity assessments
• Strong command of assessment types, taxonomy, and principles of validity and reliability
• Excellent writing, editing, and quality assurance skills
• Experience working with vendors, SMEs, and cross-functional teams
• Proficiency with learning management systems, authoring tools, and item banks
• Strong organizational and project management skills with the ability to manage multiple projects simultaneously
• Strong analytical skills and a data-driven approach to decision making
• Exceptional attention to detail

Preferred Qualifications

• Master's degree or 3–5 years of specialized experience in assessment design, development, or measurement
• Experience with technical/IT content or certifications (e.g., AWS, Azure, Python, security)
• Knowledge of accessibility and Universal Design for Learning (UDL) standards
• Experience with adaptive testing or automated assessment tools
• Familiarity with the Pluralsight platform and value proposition
• Experience with SaaS software (e.g., ZenDesk, Asana, Confluence, Smartsheet)

Benefits

• Competitive compensation
• Bonus eligibility
• Comprehensive medical coverage
• Unlimited PTO
• Wellness reimbursement
• Professional development funds
• and more