Producer | $20/hr Remote

Short-term contractor assignment (8 weeks), remote, up to 40 hours per week with 4 hours overlap with PST.

Responsibilities

• Create advanced Movies & TV Shows prompts for AI training and evaluation.
• Evaluate AI-generated responses for accuracy, reasoning, completeness, and nuance.
• Identify hallucinations, inconsistencies, outdated information, and knowledge gaps.
• Develop benchmark datasets and adversarial test cases.
• Compare and rank AI responses using authoritative references.
• Provide evidence-based feedback and maintain high annotation quality.

Requirements

• Strong years of professional, research, or teaching experience in Movies & TV Shows or related fields.
• Master’s degree or higher in a relevant Movies & TV Shows discipline.
• Strong knowledge of film, television, streaming, actors, directors, genres, awards, franchises, and entertainment history.
• Excellent written English and strong analytical skills.
• Strong attention to detail and ability to provide objective, evidence-backed reviews.
• Experience with LLMs, Generative AI, prompt engineering, or AI evaluation is preferred.

Pay

$60 per approved task.