STEM Expert - Task Designer

About the role

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

Responsibilities

• Build challenging, real-world tasks to test AI agents on expert-level technical work.
• Design open-ended tasks with no single right answer, allowing for partial credit scoring.
• Develop tasks like "Build the fastest possible attention engine" to push AI capabilities.
• Ensure tasks are evaluated automatically from 0 to 1 with partial credit.
• Work independently and asynchronously to meet deadlines and improve task quality.

Qualifications

• Must-Have Expertise in your field to create high-level technical tasks.
• Ability to design tasks that challenge AI models.

Pay

$2000 per task

Schedule

Remote, 20 hours commitment