AI Model Response Evaluator

Title: AI Model Response Evaluator Industry: Artificial Intelligence and Data Training Location: , Duration: 3 months; starting 13 October 2026 Responsibilities Interact with multiple AI models and tools to assess their outputs.Compare two or more model responses side by side across defined evaluation criteria.Rate responses for accuracy, helpfulness, instruction-following, clarity, and overall quality.Follow detailed, multi-step evaluation workflows and rating guidelines.Document consistent, clear, and well-reasoned explanations for evaluation decisions. Requirements Fluent English with strong reading comprehension and writing skills.Extensive hands-on experience using large language models (LLMs) and evaluating their outputs.Strong critical-thinking skills and the ability to assess responses across multiple quality dimensions.Excellent attention to detail and careful adherence to instructions.Based in the United States and comfortable working remotely with multiple models and tools. Skills LLM evaluationAI model evaluationResponse comparisonSide-by-side evaluationData annotationQuality assessmentPrompt evaluationCritical thinkingEnglish writingInstruction following Hourly rate is commensurate with experience and is an estimated range provided by WorkGenius. ref_id: 60f09eed-2f37-4b9a-909d-454e207ba13b