Senior Data Labeling Specialist (Miami)
Rex.zone · Miami, FL · 2 wk ago
RemoteRemoteInformation TechnologyFull-time
Senior Data Labeling Jobs in Miami (Remote) Rex.zone is hiring a Senior Data Labeling Specialist to lead high-accuracy training data creation and evaluation for AI/ML systems. In this remote, full-time role, you will drive training data quality, annotation guidelines compliance, and large language model evaluation outcomes across NLP, computer vision, and content safety workstreams. What You Will Do Perform advanced data labeling/data annotation across NLP, CV, and safety domainsExecute RLHF tasks (preference ranking, rubric-based scoring, and justification writing)Run QA evaluation via sampling, audits, defect categorization, adjudication, and inter-annotator agreementConduct error analysis and root-cause investigations on label noise and guideline gapsImprove annotation guidelines with examples, decision trees, and edge-case handlingCollaborate with engineering/research stakeholders to align labels with downstream training objectives and evaluation metrics Domains You May Work On NLP labeling (named entity recognition, intent, sentiment, taxonomy mapping)LLM evaluation (prompt evaluation, response grading, hallucination detection)RLHF preference datasets and safety alignmentComputer vision annotation (bounding boxes, polygons, keypoints, segmentation, OCR)Content safety labeling (policy compliance, harmful content detection) Required Qualifications Experience in data labeling/data annotation with QA evaluation ownershipStrong written English and ability to apply consistent rubrics for LLM/prompt evaluationAbility to resolve ambiguous cases with clear reasoning and documented decisionsFamiliarity with annotation tools, audit workflows, and training data quality processesComfort working remotely in a metric-driven production environment Remote Work Work is performed remotely while supporting teams and projects aligned to Miami and broader US operations.