Senior AI Trainer | Farooq77 Jobs

About the role

Collaborate on a customer-driven project focused on improving AI system quality through expert-level model training and evaluation. Apply generalist expertise and hands-on experience with AI products to evaluate model performance, annotate responses, develop and stress-test prompts, and contribute high-quality evaluation datasets for next-generation AI systems.

Responsibilities

• Evaluate the performance of AI chat and search tools under standardized and repeatable conditions.
• Apply detailed grading guidelines to evaluate, rank, and annotate model responses and provide structured feedback.
• Write, refine, and stress-test prompts covering diverse scenarios, edge cases, and user intents.
• Verify consistency and accuracy across evaluations and correct discrepancies between ratings and evaluation rubrics.
• Use AI training tools and platforms to record findings and submit evaluation datasets according to project standards and milestones.
• Collaborate with project trainers and contributors to resolve ambiguities and refine evaluation guidelines.
• Participate in ongoing quality reviews and incorporate feedback to maintain rigorous training and annotation standards.

Requirements

• Exceptional attention to detail and accuracy when reviewing and evaluating AI-generated content.
• Strong written and verbal communication skills for collaboration, reporting, and timely project updates.
• Strong time management and self-organization skills for independent remote work.
• Analytical and problem-solving mindset with a proactive approach to resolving evaluation challenges.
• Experience with AI model training, RLHF, data labeling, or similar data-centric evaluation projects is preferred.
• Familiarity with AI products, prompt engineering, and model behaviors and limitations is preferred.
• Experience writing evaluation rubrics, grading model outputs, or reviewing AI responses for accuracy, helpfulness, and safety is preferred.
• Background in AI training, machine learning data preparation, or LLM-focused projects is strongly preferred.

Skills

• AI Model Evaluation
• Video Annotation
• Data Labeling
• AI Training
• Evaluation Rubrics
• Prompt Engineering
• AI Response Evaluation
• Human Data
• Data Annotation
• AI Training Tools
• Model Behavior Analysis
• Quality Assurance
• Attention to Detail
• Time Management
• Written Communication
• Verbal Communication

Benefits

• Remote contractor opportunity across Northern America and Europe.
• Compensation of $14–$36 per hour.
• Opportunity to contribute to next-generation AI training and evaluation.
• Opportunity to work with AI products, model evaluation, prompt engineering, and evaluation datasets.
• Opportunity to contribute to customer-driven AI quality improvement projects.

Pay

$14 - $36 / hour