Senior Data Annotator Jobs in Seattle

About The Role

Rex.zone is hiring a Senior Data Annotator to produce and review high-quality training data for AI systems across NLP, computer vision, and large language model evaluation. This is a Remote, FULL_TIME role focused on annotation guidelines compliance, content safety labeling, and evaluation workflows that directly improve training data quality and downstream model reliability.

What You Will Do

• Execute complex data labeling and review tasks across text, image, and multimodal datasets (NLP + computer vision annotation)
• Perform RLHF preference ranking, prompt evaluation, and LLM evaluation judgments to improve model behavior
• Run QA evaluation workflows including audits, calibration, adjudication, error analysis, and rubric enforcement
• Apply named entity recognition and taxonomy-based labeling for structured datasets
• Document edge cases, decisions, and guideline clarifications to strengthen annotation guidelines compliance
• Identify systemic label noise and recommend remediation to support model performance improvement

Required Qualifications

• Mid-Senior experience in data annotation, data labeling, or QA evaluation
• High accuracy and consistency following (and refining) annotation guidelines
• Familiarity with RLHF concepts, prompt evaluation, and LLM training/evaluation workflows
• Experience with named entity recognition or similar structured labeling tasks
• Comfort with computer vision annotation and/or multimodal labeling
• Strong written judgment for content safety labeling and policy-driven decisions

Work Arrangement

Remote, full-time. Although the page targets Seattle as a search modifier, the role remains explicitly Remote and may support teams and projects across the US.

Pay

Hourly base pay range: $30–$50/hr.