LLM Evaluation Specialist – Analytical Reviewer | $70/hr Remote

Role Responsibilities

• Evaluate AI-generated responses and provide structured written feedback.
• Contribute to high-impact AI research projects.
• Identify nuances, implicit meanings, and gaps in reasoning in AI outputs.
• Write clear, precise, and well-evidenced rationales.
• Apply structured evaluation guidelines accurately.

Requirements

• Strong relevant experience in the domain.
• Strong analytical and written communication skills.
• Ability to work independently and follow detailed task guidelines.
• Strong critical reading skills.
• Creative and honest judgment with the ability to give critical assessments.