AI Trainer Jobs in the United States

About the role

Rex.zone connects AI/ML teams with professionals who build training datasets, run evaluations, and improve model quality across NLP, computer vision, and content policy evaluation.

Key Responsibilities

• Perform RLHF-style ranking and preference judgments to improve helpfulness, harmlessness, and honesty
• Execute prompt evaluation and response grading using calibrated scoring rubrics and edge-case prompts
• Create and validate labeled datasets for NLP tasks (classification, summarization, NER)
• Conduct QA evaluation to ensure annotation guidelines compliance and consistent label quality
• Flag ambiguous instructions, propose rubric clarifications, and document decision rationales
• Identify systematic failure patterns (hallucinations, bias, refusal errors, safety gaps) and report insights
• Support content safety labeling for policy categories and sensitive topics
• Collaborate to refine evaluation frameworks, gold sets, and acceptance criteria

Required Qualifications

• Mid-Senior experience in AI training, data labeling, QA evaluation, or LLM evaluation
• Strong written communication and consistent rubric application
• High attention to detail and audit-ready documentation
• Comfort iterating with reviewer feedback while meeting throughput targets

Compensation

Competitive hourly base pay: $30–$50 per hour (USD).

Schedule

Full-time