Game Design Analyst | Remote | $20/hr

About the role

Position: Domain Expert Video Games. Type: Contractor. Location: Remote.

Pay

$20/hr (Average time taken: 3 hours)

Schedule

30-40 hrs/week

Responsibilities

• Create advanced prompts covering game development, esports, gaming platforms, game design, publishers, and gaming communities.
• Evaluate AI-generated responses for factual accuracy, reasoning quality, completeness, and nuance.
• Identify hallucinations, logical inconsistencies, outdated information, and edge cases.
• Develop benchmark datasets and adversarial test cases to evaluate AI model performance.
• Provide clear, evidence-based feedback supported by reliable references.
• Collaborate with AI researchers and project teams to improve AI model performance.
• Maintain high annotation quality and consistent documentation standards.

Requirements

• Hold a Master's degree or higher in Video Games, Game Design, Interactive Media, Computer Science, or a related field.
• Have 3+ years of professional, research, or teaching experience in a field related to video games.
• Possess excellent written English communication and analytical skills.
• Demonstrate strong attention to detail with the ability to identify subtle factual and logical issues.
• Have strong knowledge of video games, including game development, esports, platforms, game design, publishers, and gaming communities.
• Experience with LLMs, Generative AI, prompt engineering, or AI evaluation is preferred.