Senior Research Director - Center for Responsible AI in Learning and Assessment

Primary Responsibilities

• Strategic Scientific Leadership and vision for AI
  • Define and lead a multi-year research agenda at the intersection of AI and measurement
  • Automated scoring and evaluation (writing, speaking, constructed response, performance tasks)
  • LLM-enabled assessment design and delivery (e.g., generative task creation, adaptive interactions)
  • NLP and multimodal modeling for language and skills measurement
  • Psycho metric modeling integrated with ML (hybrid models, fairness-aware measurement, Bayesian/IRT + deep learning)
  • Model evaluation frameworks aligned to validity arguments and operational constraints
  • Responsible AI for high-stakes testing (bias, transparency, privacy, security, governance)
• Identify emerging opportunities in AI
  • Serve as a scientific thought leader for ETS on AI-enabled assessment innovation
  • Identify emerging techniques, risks, and opportunities
• Research & Innovation Management
  • Lead the design and implementation of complex AI focused research programs
  • Require hands-on scientific direction and consultation on research prototypes, models and analytic tools, methodology, and evaluation strategies
  • Maintain research progress, ensure methodological rigor, and guide teams to high-quality deliverables that meet rigorous standards for fairness, reliability, and transparency
• External Funding, Proposals, and Partnerships
  • Consult on proposal development
  • Identify potential funding agencies
  • Coordinate responses to RFPs
  • Develop strong partnerships with universities, research labs, policy bodies, foundations, and other funding organizations
  • Serve as liaison between ETS Research Institute and key client groups, including policy/advisory boards and government agencies
  • Represent ETS at conferences and advisory groups
• Dissemination, and Thought Leadership
  • Maintain an active, independent research program with sustained scholarly output
  • Disseminate findings through peer-reviewed publications, technical reports, invited talks, and participation in seminars, symposia, and professional organizations
  • Represent ETS externally and help position ETS as a global leader in AI for assessment and measurement science

People Leadership & Talent Development

• Recruit, develop, and mentor researchers and staff, building capability across AI, psychometrics, and applied measurement
• Guide staff work, provide coaching and performance feedback, and foster collaboration across disciplines
• Build an inclusive, high-performance research culture that values scientific integrity, innovation, and impact

Center Administration & Operational Leadership

• Direct center operations including budget planning, fiscal oversight, resource prioritization, and policy implementation
• Monitor and approve research and consulting expenditures; review and approve proposal and project budgets; manage against budgets
• Oversee personnel processes, including staffing plans, performance appraisals, and related actions in alignment with ETS policies