AI Data Labeling Jobs India

About the role

Rex.zone is hiring Mid-Senior AI data labeling professionals to produce and evaluate high-quality labeled datasets for modern AI/ML systems, including LLM training pipelines. You will apply strict annotation guidelines compliance to improve training data quality, reduce model errors, and support model performance improvement across NLP, computer vision annotation, and content safety labeling workflows.

Responsibilities

• Create labels for NLP tasks (classification, summarization, intent) and named entity recognition (NER)
• Perform RLHF preference ranking and rubric-based scoring for model outputs
• Run QA evaluation checks (gold sets, audits, adjudication) and document edge cases
• Update/clarify annotation guidelines and drive consistency and inter-annotator agreement
• Support dataset curation for multimodal and computer vision annotation tasks as needed

Requirements

• Experience with data labeling / data annotation operations and web-based annotation tools
• Strong written English and ability to make consistent rubric-based judgments
• Familiarity with NLP concepts and LLM evaluation; comfort with repetitive QA workflows
• Mid-Senior level capability to mentor annotators and participate in calibration sessions
• Proficiency with spreadsheet-style reporting and quality dashboards

Quality & Collaboration

Delivery is tracked through quality metrics, audit checks, and project milestones. Collaboration is primarily async with calibration meetings, structured feedback loops, and reviewer audits.