Film & Television Reviewer (AI Evaluation)
Gramian Consulting · United States · 2 mo ago
RemoteRemoteOTHRContract
Key Responsibilities
- Create advanced film and television prompts across a range of topics and difficulty levels
- Evaluate and rank multiple AI-generated responses
- Verify claims related to films, TV shows, streaming content, actors, directors, awards, genres, and franchises
- Identify factual inaccuracies, hallucinations, outdated information, logical inconsistencies, and edge cases
- Explain why responses are correct or incorrect using reliable references
- Identify ambiguous or weak questions and propose improved prompts
- Develop benchmark datasets and adversarial test cases
- Provide clear, objective, and evidence-based feedback
- Maintain accurate documentation and consistent annotation quality
- Collaborate with AI researchers and project teams to improve model performance
Requirements
- Master's degree or higher in Film Studies, Television Studies, Media Studies, Cinema Studies, Screen Studies, or a closely related discipline
- At least 3 years of professional, research, or teaching experience related to film, television, media, or entertainment
- Strong knowledge across film, television, streaming, actors, directors, genres, awards, franchises, or entertainment history
- Ability to research and verify entertainment-related claims using authoritative sources
- Strong analytical skills and ability to assess factual and contextual accuracy
- Excellent written English
- Strong attention to detail
- Ability to work independently and provide objective, evidence-backed reviews