Remote Data Annotator Jobs in Portland

About The Role

Rex.zone is hiring for remote data annotator work supporting modern AI/ML training pipelines. You will create high-signal labeled datasets used in NLP, computer vision, and content safety systems, and contribute directly to model reliability through consistent guideline application and QA evaluation.

What You’ll Do

• Annotate text for NLP tasks (classification, named entity recognition, summarization evaluation)
• Perform prompt evaluation and LLM response scoring using rubrics
• Complete RLHF preference ranking and comparison tasks
• Label images for computer vision annotation (bounding boxes, polygons, segmentation)
• Document edge cases and provide clear notes to improve annotation guidelines
• Run QA checks, support audits, and participate in calibration sessions

How Quality Is Measured

• Guidelines compliance and accuracy on gold tasks
• Inter-annotator agreement and audit outcomes
• Low rework rates and clear edge-case documentation

Required Qualifications

• Experience with structured labeling workflows and careful, consistent decision-making
• Comfort working in web-based annotation tools and tracking tasks
• Strong written communication for remote collaboration and escalation of ambiguous cases

Preferred Qualifications

• Experience with RLHF, content safety labeling, or policy enforcement labeling
• Familiarity with NLP evaluation tasks (NER, instruction-following, retrieval relevance)
• Exposure to computer vision annotation and dataset QA concepts (gold sets, sampling, agreement)

Workplace

This is a FULL_TIME role that is explicitly Remote and can be performed from Portland, Oregon using online tools and remote team communication.