Domain Expert, AI Evaluation (Registered Nurse / Nurse Practitioner)

About the role

We are looking for experienced Registered Nurses and Nurse Practitioners to contribute to AI evaluation projects by creating high-quality evaluation data for advanced AI systems. This is a specialist role for nursing professionals, not a generalist research position. As a Domain Expert, you will use your clinical expertise to develop realistic healthcare scenarios, evaluate AI reasoning, and provide accurate, evidence-based expert solutions.

Key Responsibilities

• Design original, domain-specific nursing and healthcare tasks based on real-world practice.
• Produce the correct expert answer ("golden answer") for each task with clear clinical reasoning.
• Develop challenging evaluation scenarios that expose limitations in advanced AI models.
• Maintain consistent quality across submissions while meeting defined quality, accuracy, and formatting standards.
• Incorporate reviewer feedback to refine your work.

Required Qualifications

• Education & Experience:
  • Registered Nurse (RN) or Nurse Practitioner (NP).
  • Minimum 2 years of clinical or professional experience.
• Required Skills:
  • Strong nursing expertise and current clinical knowledge.
  • Excellent written English with the ability to communicate complex reasoning clearly.
  • Strong analytical and critical thinking abilities.
  • High attention to detail and quality.
  • Ability to work independently in a structured environment.

Requirements

• Full-time availability during the engagement.
• Own laptop with a modern browser.
• Reliable high-speed internet connection.

Compensation

Task-Based Compensation
Competitive payment for each approved task.
Earnings depend on the quality and number of completed tasks.

Onboarding & Work Integrity

• Successful completion of the project onboarding assessment is required before beginning paid work.
• All deliverables must be original, human-authored work.
• The use of AI writing or editing tools of any kind (including grammar assistants) is strictly prohibited.
• Employment is subject to signing a Non-Disclosure Agreement (NDA).