Mathematics PhD - AI Evaluation Expert

About the role

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

Responsibilities

• Source original material from published papers, Kaggle datasets, open-source repositories, or self-designed scenarios.
• Write scientific prompts based on sourced input to challenge frontier models.
• Build grading criteria that define correct answers for scientific tasks.
• Calibrate tasks against frontier models, ensuring tasks ship only when strong models fail more often than succeed.
• Work independently and asynchronously to meet deadlines while improving AI model performance.

Qualifications

• Must-Have: PhD in mathematics, applied mathematics, computational mathematics, or a closely related field.
• Must-Have: Demonstrated depth in at least two subdomains: numerical linear algebra, computational mechanics, computational finance.
• Must-Have: Working proficiency in Python or R for scientific computing.
• Must-Have: Comfortable with Git/GitHub and running code in Docker.
• Preferred: Publications in peer-reviewed journals.
• Preferred: Prior scientific software or research engineering experience.

Pay

$70/hour

Schedule

• Contract position
• Remote
• Duration: 6 weeks
• Commitment: 20+ hours/week
• Start Date: Immediate

Interview Process

• Upload your resume and application form.
• 25-minute conversational interview covering your background, experience, and motivations.
• Follow up within a few days with next steps and onboarding.

Application Process

Takes 20–30 minutes to complete:

• Upload resume
• AI interview based on your resume
• Submit form

Resources & Support

For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome

For any help or support, reach out to: support@mercor.com

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.