Domain Expert, AI Evaluation (Medical Doctor)

About the role

We are looking for experienced Medical Doctors to contribute to AI evaluation projects by creating high-quality evaluation data for advanced AI systems. This is a specialist role for practicing physicians, not a generalist research position. As a Domain Expert, you will apply your clinical judgment to design realistic medical scenarios that challenge advanced AI models and produce accurate, evidence-based expert answers.

Key Responsibilities

• Design original, domain-specific clinical tasks and prompts based on real-world medical practice.
• Produce the correct expert answer ("golden answer") for each task with clear clinical reasoning.
• Create challenging evaluation scenarios that expose weaknesses in advanced AI models.
• Maintain consistent quality across submissions while meeting defined quality, accuracy, and formatting standards.

Required Qualifications

• Education & Experience:
  • Medical Doctor (MD) or Doctor of Osteopathic Medicine (DO).
  • Minimum 2 years of clinical or professional experience.
• Skills:
  • Strong clinical expertise and current medical knowledge.
  • Excellent written English with the ability to explain complex medical reasoning clearly.
  • Strong analytical and critical thinking skills.
  • High attention to detail and quality.
  • Ability to work independently in a structured environment.

Requirements

• Full-time availability during the engagement.
• Own laptop with a modern browser.
• Reliable high-speed internet connection.

Compensation

Task-Based Compensation
Competitive payment for each approved task.
Earnings depend on the quality and number of completed tasks.

Onboarding & Work Integrity

• Successful completion of the project onboarding assessment is required before beginning paid work.
• All deliverables must be original, human-authored work.
• The use of AI writing or editing tools of any kind (including grammar assistants) is strictly prohibited.
• Employment is subject to signing a Non-Disclosure Agreement (NDA).