Remote AI Data Annotation Specialist (Detroit)

Role Overview

Rex.zone is hiring a Remote AI Data Annotation Specialist to support end-to-end LLM training pipelines and model evaluation datasets. You will apply detailed rubrics and labeling guidelines to improve training data quality and model reliability.

What You Will Do

• Label and review text, image, and multimodal datasets to meet training data quality thresholds
• Execute RLHF-style preference ranking and rubric-based evaluations of model outputs
• Perform prompt evaluation and QA evaluation (calibration, audit sampling, consistency checks)
• Annotate NLP tasks such as named entity recognition, taxonomy mapping, and document classification
• Support computer vision annotation (bounding boxes, polygons/segmentation, keypoints, attributes)
• Complete content safety labeling using policy-based decision rules
• Document edge cases, resolve disagreements, and improve annotation guidelines compliance

Required Qualifications

• Mid-Senior experience in AI data annotation, data labeling operations, or model evaluation
• Ability to follow complex rubrics and provide consistent judgments
• Familiarity with NLP concepts (e.g., NER, classification) and comfort with CV annotation concepts
• Strong written communication, attention to detail, and reliable remote work habits

Work Model

Remote, FULL_TIME. Work is performed online with asynchronous coordination; periodic calibration sessions may occur.

Compensation

Hourly base pay range: $30–$50 per hour (may vary by project complexity and evaluation scope).