Knowledge Expert Coder - Medical
Rose International · United States · 1 wk ago
RemoteRemoteHealthcareFull-time
Temporary full-time remote position, estimated duration 3 months. Local work hours, minimum availability of ~20 hours/week (40 hours preferred). Participation in 2–5 calibration calls per week required.
About the role
Join a cutting-edge GenAI team and help build foundational AI models from the ground up. As a Medical Knowledge Expert Coder, you will bring deep domain expertise to elevate the quality of AI training data and collaborate directly with AI research teams.
Responsibilities
- Guide research teams to close knowledge gaps and improve AI model performance in your specialty field; collaborate with other subject-matter experts to ensure consistency and accuracy in training data.
- Evaluate and grade the quality of annotations produced by vendors for Supervised Fine-Tuning (SFT) and Reinforcement Learning from Human Feedback (RLHF).
- Identify areas of improvement and provide actionable feedback to optimize annotation quality.
- Directly annotate data for key tasks when necessary, including writing SFT responses and judging output quality for RLHF.
Requirements
- MD or DO degree (required).
- Ph.D. or Doctorate (required minimum education).
- Minimum 5 years of professional experience in Medicine.
- 3+ years of experience with Claude code/AI tools.
- 3+ years of coding experience (Python preferred, but deep expertise in any language accepted).
- 5+ years of demonstrated deep understanding and expertise in the Medical field.
- 5+ years of exceptional analytical abilities to identify trends, evaluate annotation quality, and provide actionable feedback.
- Strong written and verbal communication skills to convey complex ideas effectively.
- Proven ability to collaborate with cross-functional teams and external partners.
- Flexibility and adaptability to learn new technologies and processes in a rapidly evolving environment.
Skills
- Familiarity with AI tools (e.g., Claude code).
- Coding (Python preferred).
- Analytical skills.
- Subject-matter expertise in Medicine.
- Experience teaching advanced concepts and distilling complex problems into logical, step-by-step thinking.
Pay
Hourly rate: $155.00.