AI Evaluation Specialist – Movies & TV Domain

About the Role

We are looking for experienced entertainment professionals and subject matter experts to support AI evaluation initiatives focused on Movies and TV content. The role involves creating challenging evaluation scenarios, reviewing AI-generated responses, and providing expert feedback to improve the accuracy and quality of AI systems.

Responsibilities

• Create domain-specific prompts related to movies, television, streaming, and entertainment topics
• Evaluate AI-generated responses for accuracy, reasoning, completeness, and relevance
• Identify factual errors, inconsistencies, outdated information, and knowledge gaps
• Compare multiple AI responses and provide structured evaluations
• Provide evidence-based feedback using reliable references
• Support the development of evaluation datasets and testing scenarios

Requirements

• Strong knowledge of movies, television, streaming platforms, actors, directors, genres, awards, and entertainment history
• Excellent written English and analytical skills
• Strong attention to detail and ability to assess factual accuracy
• Ability to research, analyze, and provide objective feedback
• Experience creating written content, research material, or evaluations preferred

Qualifications

• Master's degree or advanced academic background related to film, media studies, entertainment, or related fields (preferred)
• Professional, research, teaching, or industry experience in movies/TV domain
• Experience with Generative AI, LLMs, prompt engineering, or AI evaluation is a plus
• Experience working independently on research-based assignments

Skills

• Analytical skills
• Streaming platform expertise
• Entertainment industry knowledge
• Evaluations and feedback