Remote Data Annotator Jobs Manchester

About The Role Rex.zone connects annotators with remote, full-time data annotation work supporting AI/ML and LLM training pipelines. You will create high-quality labeled datasets and human feedback signals, including RLHF preference ranking, prompt evaluation, and QA evaluation, while maintaining strict annotation guidelines compliance and training data quality. What You Will Do Label and categorize text, image, and multimodal data using defined taxonomies and policiesPerform RLHF pairwise preference ranking and write clear rationales/justificationsExecute prompt evaluation and response quality scoring for LLM evaluationRun QA evaluation audits, calibration tasks, and gold-set checks to improve consistencyComplete named entity recognition (NER) and span labeling for NLP datasetsSupport content safety labeling and sensitive content handling per policyMaintain throughput and accuracy targets with detailed decision logs for reviewer traceability Requirements Experience with structured labeling workflows and web-based annotation toolsStrong written reasoning and ability to follow detailed guidelines with high precisionComfort working asynchronously with reviewer feedback loops and QA processesPreferred: RLHF, prompt evaluation, LLM evaluation, NER, or computer vision annotation exposure Quality & Performance You will be evaluated on guideline adherence, inter-annotator agreement, edge-case handling, and overall training data quality. Expect structured QA cycles, periodic calibration, and reviewer feedback to support measurable model performance improvement.