Jobs · OTHR

Film & Television Reviewer (AI Evaluation)

Gramian Consulting · United States · 2 mo ago
RemoteRemoteOTHRContract

Key Responsibilities

  • Create advanced film and television prompts across a range of topics and difficulty levels
  • Evaluate and rank multiple AI-generated responses
  • Verify claims related to films, TV shows, streaming content, actors, directors, awards, genres, and franchises
  • Identify factual inaccuracies, hallucinations, outdated information, logical inconsistencies, and edge cases
  • Explain why responses are correct or incorrect using reliable references
  • Identify ambiguous or weak questions and propose improved prompts
  • Develop benchmark datasets and adversarial test cases
  • Provide clear, objective, and evidence-based feedback
  • Maintain accurate documentation and consistent annotation quality
  • Collaborate with AI researchers and project teams to improve model performance

Requirements

  • Master's degree or higher in Film Studies, Television Studies, Media Studies, Cinema Studies, Screen Studies, or a closely related discipline
  • At least 3 years of professional, research, or teaching experience related to film, television, media, or entertainment
  • Strong knowledge across film, television, streaming, actors, directors, genres, awards, franchises, or entertainment history
  • Ability to research and verify entertainment-related claims using authoritative sources
  • Strong analytical skills and ability to assess factual and contextual accuracy
  • Excellent written English
  • Strong attention to detail
  • Ability to work independently and provide objective, evidence-backed reviews

Similar jobs