Remote Data Annotation Specialist in New York

About the role

Rex.zone is hiring for a full-time, remote Data Annotation Specialist role supporting AI/ML training pipelines.

Responsibilities

• Label and evaluate text, images, and conversational outputs used in LLM training, RLHF, prompt evaluation, and training data quality programs.
• Perform remote data annotation and evaluation tasks that directly improve model performance.
• Apply labeling taxonomies and annotation guidelines to text, image, and multimodal data.
• Conduct QA evaluation, audits, and adjudication to resolve edge cases and improve inter-annotator agreement.
• Document rationales and error patterns that drive model performance improvement.
• Collaborate with project leads to refine rubrics, update policies, and calibrate labeling decisions.

Requirements

• Professional experience with data annotation, data labeling, evaluation, or QA workflows.
• Strong written communication and ability to justify decisions using rubrics.
• Comfort with annotation tools, spreadsheets, and web-based labeling platforms.
• Ability to maintain high accuracy under detailed policies and changing guidelines.
• Reliable remote setup and ability to meet full-time productivity and quality targets.