Senior Data Annotator Jobs Manchester
Rex.zone · United States · 1 wk ago
RemoteRemoteManufacturing$30–$50/hrFull-time
About the role
Rex.zone is a remote-first platform connecting professionals to AI/ML data operations work. This role focuses on producing high-quality training data for AI systems through expert labeling, evaluation, and QA workflows.
Responsibilities
- Deliver expert-level data annotation across NLP, LLM evaluation, and computer vision tasks
- Perform RLHF preference ranking and prompt evaluation for instruction-following and safety
- Execute QA evaluation (second-pass review, adjudication, calibration) to ensure training data quality
- Enforce annotation guidelines compliance, document edge cases, and provide reviewer feedback
- Support content safety labeling aligned to policy definitions and thresholds
- Collaborate with engineering on schema/tooling feedback and sampling plans to improve throughput and consistency
Requirements
- Mid-Senior experience in production data annotation and/or QA evaluation
- Strong guideline adherence and ambiguity resolution skills
- Experience with at least one: RLHF, prompt evaluation, NER, computer vision annotation, or content safety labeling
- Comfort with web-based annotation tools, spreadsheets, and issue trackers
- Clear written communication for audit trails and edge-case notes
Pay
Base pay: $30–$50 per hour (depending on domain scope, QA responsibilities, and complexity)