Experienced Generalist (Train AI Models Part Time!)

Role Overview

Mercor is seeking generalist experts to support a large-scale project with a leading AI research partner. The goal is to create and refine a diverse dataset of human-aligned tasks for supervised fine-tuning (SFT) of frontier models. Generalists will contribute by generating realistic prompts, evaluating AI outputs, and iterating on responses to ensure quality and domain relevance. This is a short-term, project-based opportunity ideal for professionals with broad analytical capabilities and writing skills.

Key Responsibilities

• Create / evaluate base prompts across a range of generalist topics
• Review and revise AI-generated responses for clarity, accuracy, and alignment with human reasoning
• Develop prompt-response iterations using variations in length, style, and system prompts
• Contribute to benchmarking efforts by identifying failure points in model responses
• Create Rubrics to evaluate the prompts
• Apply consistent quality standards across diverse content types (e.g., summaries, Q&A, synthesis tasks)

Ideal Qualifications

• 2+ years of experience in research, education, writing, editing, or adjacent analytical fields
• Proven ability to communicate complex topics clearly and concisely
• Strong attention to detail and critical thinking skills
• Comfort working independently with evolving task guidelines
• Familiarity with LLMs or AI-assisted writing tools is a plus

More About the Opportunity

Expected commitment: 10–25 hours/week
Flexible task structure with batch-based assignments

Application Process

Submit your resume to get started
Complete the Domain Expert interview
We aim to follow up within a few business days