Content & Experience Evaluator

About the role

Join a team focused on improving member-facing search and AI experiences through thoughtful content evaluation and expert judgment. This contract opportunity is ideal for someone with a deep background in media and a strong ability to review, annotate, and rate content with accuracy, consistency, and care.

Responsibilities

• Review and evaluate content recommendations and generated text to support AI training and quality improvement efforts.
• Apply established guidelines and independent judgment to capture nuance, context, and intent in creative content.
• Validate datasets used in AI and machine learning workflows for accuracy, completeness, and consistency.
• Identify patterns, edge cases, and potential issues that could affect model performance or member experiences.
• Document evaluation results and rationale in a clear, concise, and objective way.
• Collaborate with cross-functional partners to help improve dataset quality and relevance.
• Support evaluation work tied to search and AI-driven member experiences, including voice and search relevance initiatives.

Skills

• Background in media-related work such as writing, editing, content design, metadata analysis, or content labeling for AI.
• Deep knowledge of films and series across genres, markets, and the broader streaming landscape.
• Strong ability to summarize and assess creative content in a clear, objective, and structured way.
• Excellent written communication skills in English.
• Comfort working within defined guidelines and rubric-based evaluation frameworks.
• High attention to detail, reliability, and the ability to work in a deadline-driven environment.
• Ability to learn and use internal tools and systems effectively.
• Fluency in Spanish is strongly preferred.
• Experience working with large data catalogs.
• Prior experience reviewing datasets or supporting AI and machine learning workflows.
• Curious, collaborative, and open to feedback in a team-oriented environment.
• Ability to adapt to changing tools, processes, and priorities.

Benefits

• Medical
• Dental
• Vision
• Retirement

Pay

The pay range for this role is $37 - $72 per hour based on qualifications and experience.