Psychometrician II

About the role

The Psychometrician II plays a crucial role in the development and maintenance of assessments for a large K-12 state assessment program. This includes managing projects, representing the department to senior management, and applying psychometric knowledge to test design, development, and evaluation.

Responsibilities

• Manage projects through product implementation and evaluation
• Represent the department to senior management, both internal and external, and technical advisory committees
• Exercise judgement of analysis, methodology, and techniques to accomplish goals
• Apply knowledge of psychometrics and statistics to the design, development, and evaluation of tests and other educational products
• Plan advanced research studies, including item calibration, test norming, and validity studies
• Analyze item responses, score distributions, reliability and validity research data as part of test development process
• Design and implement psychometric studies to support new products or new product development
• Coincide with Product Management, Engineering, Content Development, and other internal groups to deliver new products
• Investigate and diagnose complex anomalies, issues, and customer concerns related to scores
• Present to and document work for both internal and external stakeholders, using the appropriate communication for the audience

Requirements

• Doctoral degree (Ph. D.) in education, measurement, statistics, evaluation, or relevant field and minimum 4 years of experience in related field, or equivalent combination of education and experience
• Knowledge of CAT design, IRT, and statistical methods, and proficiency with statistical software packages (e.g., SAS, R, Python)
• An understanding of test content alignment to state standards
• Demonstrated ability to define problems, collect data, establish facts, and draw valid conclusions
• Demonstrated ability to respond to common inquiries or complaints from customers, regulatory agencies, or members of the business community
• Project management skills, with emphasis on technical design and implementation of educational tests
• Experience in developing proposal responses for state assessment programs
• Ability to adapt quickly to change and navigate ambiguity and to be successful in a fast-paced Lean Agile environment
• Exceptional organizational skills and attention to detail and accuracy
• Extensive experience in applied measurement in a K-12 education setting
• Excellent coding experience in SAS

Qualifications

• Doctoral degree (Ph. D.) in education, measurement, statistics, evaluation, or relevant field and minimum 4 years of experience in related field, or equivalent combination of education and experience

Skills

• Knowledge of CAT design, IRT, and statistical methods, and proficiency with statistical software packages (e.g., SAS, R, Python)
• An understanding of test content alignment to state standards
• Demonstrated ability to define problems, collect data, establish facts, and draw valid conclusions
• Demonstrated ability to respond to common inquiries or complaints from customers, regulatory agencies, or members of the business community
• Project management skills, with emphasis on technical design and implementation of educational tests
• Experience in developing proposal responses for state assessment programs
• Ability to adapt quickly to change and navigate ambiguity and to be successful in a fast-paced Lean Agile environment
• Exceptional organizational skills and attention to detail and accuracy
• Extensive experience in applied measurement in a K-12 education setting
• Excellent coding experience in SAS

Benefits

Benefits for eligible US employees include:

• World Class Health Benefits: Medical, Prescription, Dental, Vision, Telehealth
• Health Savings and Flexible Spending Accounts
• 401(k) and Roth 401(k) with company match
• Paid Vacation and Sick Time Off
• 12 Paid Holidays
• Parental Leave (20 total weeks with 14 weeks paid) & Milk Stork program
• Tuition Reimbursement
• Life & Disability Insurance
• Well-being and Employee Assistance Programs