AI Model Evaluator | $70/hr Remote

Role Responsibilities

• Evaluate and critique the performance and accuracy of AI-generated content across various domains.
• Deliver detailed, constructive feedback to inform AI model improvements and refinements.
• Analyze complex datasets and assess model outputs for clarity, factual correctness, and alignment with project goals.
• Identify patterns, anomalies, and subtle nuances in AI-generated responses using high-level reading comprehension and keen observation.
• Collaborate with team members by communicating findings and insights clearly in both written and verbal formats.
• Contribute user-level expertise by simulating real-life scenarios or tasks to gauge model utility and effectiveness.

Requirements

• Have native English proficiency at C1 or C2 level.
• Demonstrate high-level reading comprehension and analytical thinking abilities.
• Possess a keen eye for detail, capable of nuanced observation and recognizing subtle distinctions.
• Have the ability to provide clear, actionable feedback based on subject matter expertise.
• Exhibit strong organizational and time-management skills in a remote work environment.