Verification & Validation Data Scientist

Overview

This role exists to answer one question independently: do the synthetic-audience and automated systems actually perform as claimed? It is a verification-and-validation role.

Responsibilities

• Data: Own the evaluation metrics, test harness design, and reported accuracy bounds; quantify where each system is and is not reliable. Certify fitness for use, translate results into actionable insights.
• Technical: Design and run the independent validation methodology: benchmark synthetic-audience and automated output against real panel holdout and other ground-truth data.
• Independence and rigor: the temperament to challenge results and withhold sign-off, including from colleagues’ work. Clear communication: able to tell a non-technical audience about the findings.

Requirements

• Education & Experience: Bachelor’s degree in computer science, mathematics, or engineering or relevant equivalent experience in lieu of degree. Master’s degree preferred. Seven (7) or more years of relevant work experience.
• Knowledge: Strong applied statistics and metrics design; fluency in accuracy, bias, calibration, and uncertainty quantification. Working understanding of LLMs and NLP techniques.
• Skills: Independence and rigor: the temperament to challenge results and withhold sign-off, including from colleagues’ work. Clear communication: able to tell a non-technical audience about the findings.
• Understanding: Prolonged periods of sitting at a desk and working on a computer. Frequent use of hands and fingers for typing, handling documents, and using office equipment.

Benefits

SHRM offers a competitive compensation package including a salary range of $110,000 to $135,000 per year, health insurance, retirement plans, and professional development opportunities.

Schedule

This position follows a hybrid work schedule, with Tuesday through Thursday in office and Monday and Friday remote.

Pay

The salary range for this role is $110,000 to $135,000 per year.

Qualifications

SHRM is an equal opportunity employer (Minority/Female/Disabled/Veteran).