Remote Data Annotation Specialist (Barcelona)

About The Role

As a Remote Data Annotation Specialist (Barcelona) on Rex.zone, you will label and evaluate multi-modal AI training data to improve large language model evaluation and downstream model behavior. This is a full-time, fully remote role (US job metadata) supporting Barcelona-oriented search intent and locale data when needed.

What You Will Do

• Execute NLP data labeling: intent tagging, sentiment/topic classification, and named entity recognition (NER)
• Perform RLHF preference ranking and pairwise comparisons for prompt evaluation, with concise written rationales
• Run QA evaluation on labeled datasets, resolve conflicts, and document edge cases
• Annotate computer vision data when required (bounding boxes, polygons, keypoints, image classification)
• Conduct content safety labeling (toxicity, self-harm, hate, sexual content) with policy adherence
• Track production metrics (throughput, accuracy, inter-annotator agreement) and support calibration
• Collaborate asynchronously via Rex.zone tools and follow secure data handling procedures

Required Skills And Experience

• Mid-Senior experience in data annotation, data labeling, QA evaluation, or search relevance evaluation
• Strong rubric adherence and consistent decision-making; high annotation guidelines compliance
• Strong written English for rationale-based grading and prompt-response evaluation
• Familiarity with NLP concepts and LLM evaluation workflows
• Comfort with web-based annotation tools and spreadsheet-like workflows

Work Model

FULL_TIME and fully Remote with asynchronous collaboration. Quality is measured via audits, gold tasks, inter-annotator agreement, and QA reviews focused on training data quality and consistency.

Compensation

Compensation is hourly and depends on project complexity and calibration accuracy.