Data Annotation Specialist | $40/hr Remote

Role Responsibilities

• Evaluate and score AI-generated responses using well-defined rubrics and metrics.
• Annotate and categorize data sets to improve AI model accuracy.
• Review content for relevance, coherence, and factual accuracy.
• Provide actionable feedback on AI performance for model improvements.
• Collaborate with teams to interpret guidelines and refine rubrics.
• Document findings and maintain records of annotations and evaluations.

Requirements

• Strong relevant experience in data annotation and content evaluation.
• Strong critical reading and analytical skills with rubric application ability.
• Proficiency in written and verbal communication for clear feedback articulation.
• Bachelor's degree required.
• Experience in evaluating or scoring large volumes of content against detailed criteria.
• Experience with AI training, machine learning data annotation, or related tasks is highly valued.