Jobs · Information Technology

Remote Data Annotation Jobs Dublin

Rex.zone · United States · 2 wk ago
RemoteRemoteInformation Technology$30–$50/hrFull-time
Remote Data Annotation Jobs Dublin (Remote) Rex.zone is hiring mid-senior data annotators to support AI training workflows, including data labeling, RLHF evaluation, prompt evaluation, and training data QA. You will follow structured rubrics, resolve edge cases, and deliver high-quality labeled datasets that improve model performance across real-world LLM training pipelines. Key Responsibilities Deliver accurate labels and evaluations across text, image, and safety datasetsPerform RLHF preference ranking (pairwise comparisons) and preference judgmentsConduct prompt response evaluation for helpfulness, factuality, and policy complianceComplete named entity recognition (NER) and intent/classification tasksAnnotate computer vision data (e.g., bounding boxes, polygons, segmentation) as requiredExecute rubric-based QA evaluation; escalate ambiguous edge cases with clear rationalesParticipate in calibration sessions to reduce inter-annotator variance and improve agreementDocument decisions to improve annotation guidelines and audit readinessMeet throughput targets while maintaining consistency, precision, and quality Required Qualifications Mid-senior experience in data annotation, QA evaluation, or AI data operationsStrong written English and high attention to detailProven ability to follow rubrics and maintain annotation guidelines complianceFamiliarity with NLP concepts (classification, NER) and/or computer vision annotationComfort working remotely with feedback cycles, quality audits, and production tooling Preferred Qualifications Hands-on experience with RLHF workflows, LLM evaluation, or prompt evaluationExposure to content safety labeling and policy-driven annotationExperience with calibration, adjudication, and inter-annotator agreement processesAbility to write clear rationales that reduce disagreement and improve guidelines Compensation $30–$50 per hour (base salary, hourly).

Similar jobs