STEM Researcher - Computational Fields

Key Responsibilities

• Design complex, research-oriented benchmark tasks inspired by real-world scientific workflows, including study design, experimentation, hypothesis testing, and data analysis
• Develop comprehensive reference solutions using Python, notebooks, and computational tools with the rigor expected in professional research
• Define clear evaluation standards that distinguish sound scientific reasoning from plausible but incorrect conclusions
• Review AI-generated solutions, identifying methodological weaknesses, analytical errors, and flawed reasoning that experienced researchers would recognize immediately
• Collaborate with AI researchers and fellow domain experts to improve benchmark quality, consistency, and scientific rigor
• Contribute to the continuous refinement of evaluation methodologies for advanced AI systems

Required Qualifications

• Master's degree, PhD, or equivalent practical experience in a STEM discipline, computational social science, computational humanities, or another research-intensive field involving programming and data analysis
• Minimum 1 year of experience in an active research role within academia, industry, government laboratories, or a similar research environment
• Demonstrated experience performing computational research involving Python, data analysis, simulation, modeling, machine learning, or scientific computing
• Strong understanding of experimental design, hypothesis testing, statistical analysis, and rigorous interpretation of research findings
• Working knowledge of Git, integrated development environments (IDEs), and notebook platforms such as Jupyter or Google Colab
• Experience with AI evaluation, benchmark development, AI training, or task authoring is preferred
• Excellent analytical thinking, attention to detail, creativity, and the ability to solve complex, open-ended problems independently
• Strong written communication skills for documenting technical methodologies and research findings
• Ability to commit approximately 35 hours per week on a consistent basis

Preferred Qualifications

• Experience designing reproducible computational experiments or research workflows
• Familiarity with machine learning, large language models, or AI-assisted research tools
• Background in benchmark design, scientific software development, or computational research infrastructure
• Experience mentoring researchers, reviewing scientific work, or contributing to peer-reviewed publications