Head of Research

Requirements

• A PhD in ML/NLP (in progress or completed), or equivalent industry research track record
• Deep familiarity with the LLM evaluation landscape: existing benchmarks, their failure modes, judge-model approaches, human-in-the-loop methodologies
• Bias toward research that affects what people actually deploy, rather than benchmarks that are easy to game
• Strong written and verbal communication skills
• Ability to work in-person, in San Francisco

About the Role

The Head of Research will lead the development of methodologies and standards for evaluating AI models, shaping the future of the AI economy. Key responsibilities include advancing evaluation science, overseeing a broad research portfolio, publishing impactful research, recruiting and growing a research team, and collaborating with enterprise customers and lab partners.

Qualifications

• PhD in ML/NLP (in progress or completed), or equivalent industry research track record
• Deep familiarity with LLM evaluation landscape
• Bias towards research affecting deployment
• Strong communication skills
• Ability to work in-person in San Francisco