Senior Psychometrician

NBME’s Psychometrics and Data Analysis (PADA) unit is seeking a Senior Psychometrician to join their team. This role is primarily remote, with flexibility to work remotely, hybrid, or onsite. Candidates within 50 miles of the Philadelphia, PA office are preferred, and onsite interviews or onboarding may be required with advance notice.

About the Role

The Senior Psychometrician will contribute in the following key areas:

• Applied research and development to support modifications to examination designs, analysis methods, and procedures.
• Planning and execution of psychometric analyses, scoring, and score reporting for operational examination programs.
• Contributing to the educational measurement community through professional presentations and publications.
• Evaluating existing procedures for improvement opportunities and identifying new methods to increase accuracy and efficiency.
• Designing and evaluating data visualization and graphical representations for stakeholder feedback, examinee reports, and interactive tools.
• Supporting AI-related research initiatives.

Collaboration with internal teams (data analysts, test developers, IT, and program managers) and external stakeholders (clients and subject matter experts in medical and healthcare fields) is essential. Operational programs include the United States Medical Licensing Examination®, medical school assessments, and client examinations for medical specialties.

Requirements

• Doctorate degree in Educational/Psychological Measurement, Statistics, or a related field.
• Minimum of 5 years of experience in a Psychometrician/Measurement Scientist role.

Skills

• Strong background in psychometric theory and application, including IRT, CTT, statistics, test development, and research design.
• Advanced knowledge of applied measurement topics (e.g., equating, scaling, generalizability theory, Bayesian methodology, standard setting).
• Experience presenting assessment data graphically to support comprehension and decision-making.
• Knowledge or experience in natural language processing, process data analytics, or formative assessment approaches is desirable.
• Proficiency in statistical software (e.g., SAS, Python, R, calibration software).
• Excellent oral and written communication skills.
• Strong problem-solving and interpersonal skills, with the ability to collaborate across diverse professional backgrounds.

About NBME

NBME provides high-quality assessments and educational services for medical education and healthcare. Programs include the United States Medical Licensing Examination®, NBME Subject Examinations, Customized Assessment Services, and international initiatives like the International Foundations of Medicine® Program. NBME advances assessment science through research, grants, and professional development opportunities, including the Summer Psychometric Internship Program and funding initiatives like the Stemmler Fund.

NBME is committed to diversity, equity, and inclusion (DEI) in its workforce, culture, products, and services, ensuring impactful and enduring contributions to medical education.

Benefits

• Healthcare, dental, prescription, and vision plans.
• 401(k) with employer match.
• Tuition reimbursement plan.
• Commuter benefits (public transit or parking).
• Remote-friendly workplace.

Pay

The compensation range for this position is $138,688 to $173,360, with the offered rate typically aligning with the minimum to midrange based on qualifications, experience, department budget, and internal equity.