Internal Medicine AI Evaluation Specialist

Key Responsibilities

• Create realistic Internal Medicine case studies based on everyday clinical practice.
• Develop prompts covering diagnostic reasoning, differential diagnosis, treatment planning, risk stratification, evidence-based guideline adherence, and long-term patient management.
• Evaluate AI-generated clinical responses using structured evaluation frameworks.
• Identify reasoning gaps, inaccuracies, omissions, and opportunities for improvement.
• Provide detailed written feedback to improve AI model performance and clinical reliability.
• Participate in onboarding sessions and specialty calibration meetings.
• Work with multidisciplinary teams to ensure consistency, accuracy, and quality across medical evaluations.

Required Qualifications

• Board-certified in Internal Medicine.
• Current, active, and unrestricted medical license.
• Final-year Internal Medicine resident or recent residency graduate with board eligibility.
• Board-certified or board-eligible in Internal Medicine or a related subspecialty.
• Strong knowledge of evidence-based medicine and clinical practice guidelines.
• Experience in clinical teaching, medical research, or quality improvement initiatives.
• Excellent written communication and analytical skills.
• Interest in artificial intelligence, clinical decision support, or healthcare technology.

Preferred Qualifications

• Expertise in Internal Medicine subspecialties such as Cardiology, Hematology & Oncology, Endocrinology, Nephrology, Gastroenterology, Pulmonology, or other relevant fields.

Pay

$130-$180 per hour

Schedule

Standard commitment of approximately 20 hours per week, with opportunities for additional hours based on project demand. Flexible working schedule.

Benefits

Weekly payments processed through supported payment platforms based on approved work completed.