Video Games Reviewer (AI Evaluation)

Gramian Consultancy is a boutique consultancy specializing in IT professional services and engineering talent solutions. With a strong background in software engineering and leadership, we help companies build high-performing teams by matching them with professionals who truly fit their needs. Role Overview We are looking for an experienced Video Games Domain Reviewer to support the quality assurance of data used to evaluate Large Language Models. The role involves reviewing gaming-related prompts and completed tasks, checking factual accuracy, reasoning quality, completeness, and guideline compliance, and providing clear, evidence-based feedback. The work may cover game development, game design, esports, gaming platforms, publishers, genres, gaming communities, and current industry trends. CONTRACT: Contractor assignment, 8 weeks COMMITMENT: Full-time, 40 hours per week with at least 4 hours of PST overlap LOCATIONS: Remote - USA Key Responsibilities Review and validate video game-focused prompts across a broad range of gaming topicsEvaluate completed tasks for factual accuracy, reasoning quality, completeness, and relevanceIdentify factual errors, hallucinations, logical inconsistencies, and weak annotationsVerify claims related to games, publishers, platforms, genres, esports, and game developmentAssess whether prompts are sufficiently challenging and aligned with project objectivesEnsure compliance with project instructions, review rubrics, and quality standardsProvide clear, constructive, and evidence-based feedback to contributorsDocument review findings and escalate ambiguous or complex cases when requiredCollaborate with project managers and AI teams to improve evaluation quality and workflows Requirements Master's degree or higher in Game Design, Interactive Media, Computer Science, or a closely related disciplineAt least 3 years of professional, research, teaching, or industry experience in the video games domainStrong knowledge of game development, gaming platforms, publishers, genres, esports, or gaming communitiesExperience reviewing, evaluating, editing, or quality-checking technical or domain-specific contentAbility to identify subtle factual, logical, and contextual errorsExcellent written English communication skillsStrong analytical ability and attention to detailAbility to work independently in a quality-focused remote environment