Remote AI Data Annotation Specialist (Miami)

Key Responsibilities

• Annotate and review text datasets for NLP tasks such as classification and named entity recognition
• Perform RLHF tasks including preference ranking and rubric-based scoring
• Conduct prompt evaluation and QA evaluation to identify edge cases, label noise, and guideline gaps
• Label computer vision data (bounding boxes, polygons, keypoints, segmentation masks) and validate accuracy
• Apply content safety labeling and policy-based moderation labels for sensitive content categories
• Document decisions, propose improvements to annotation guidelines, and support calibration sessions
• Track quality metrics (disagreement rates, audit pass rates) and contribute to training data quality initiatives

Required Qualifications

• Mid-Senior experience in AI data annotation, data labeling, or QA evaluation/data operations
• Familiarity with LLM evaluation concepts, RLHF workflows, and rubric-based scoring
• Strong written communication and ability to justify labeling decisions with clear rationale
• High attention to detail and consistent annotation guidelines compliance
• Comfort working remotely in a metrics-driven production environment with iterative feedback

Compensation

Hourly base pay range: $30–$50/hr (USD)

Type

Remote (Miami-based search intent; eligible across the US)

How To Apply

Apply via Rex.zone and be prepared to summarize your experience across NLP labeling, computer vision annotation, RLHF, prompt evaluation, and QA evaluation.