AI Evaluation Specialist – Video Games Domain

About the role

We are looking for experienced professionals with strong expertise in the video game industry to support AI evaluation initiatives. The role involves creating gaming-related evaluation scenarios, reviewing AI-generated responses, and providing structured feedback to improve the quality, accuracy, and reasoning capabilities of AI systems.

Responsibilities

• Create domain-specific prompts related to video games, game development, esports, platforms, publishers, and gaming communities
• Evaluate AI-generated responses for factual accuracy, completeness, reasoning quality, and relevance
• Identify incorrect information, inconsistencies, outdated knowledge, and edge cases
• Compare AI responses and provide evidence-based feedback
• Support the development of evaluation datasets and testing scenarios
• Maintain high-quality documentation and evaluation standards

Requirements

• Strong knowledge of the video game industry, including game development, esports, platforms, publishers, and gaming communities
• Excellent written English and analytical skills
• Strong attention to detail and ability to evaluate information objectively
• Ability to research, analyze, and provide structured feedback
• Experience working independently on research-based activities

Qualifications

• Advanced academic background in video games, game studies, interactive media, or related fields
• 3+ years of professional, research, teaching, or industry experience
• Experience with Generative AI, Large Language Models (LLMs), prompt engineering, or AI evaluation is a plus
• Experience creating written analysis, reviews, or research content

Skills

• Analytical skills
• Video games
• Game development
• Research
• Game industry