Generalist Jobs India

Key Responsibilities

• Execute data labeling and QA evaluation for text, image, and mixed-modal tasks
• Apply RLHF rubrics for preference ranking and helpfulness/harmlessness scoring
• Perform prompt evaluation and response grading for LLM evaluation
• Complete NLP tasks such as named entity recognition and taxonomy-based tagging
• Conduct computer vision annotation (bounding boxes, polygons, classification) as needed
• Conduct content safety labeling across policy categories and sensitive content
• Maintain audit-ready notes, document edge cases, and propose guideline improvements
• Participate in calibration sessions to improve reviewer agreement and consistency

Required Qualifications

• Mid-senior experience in operations, QA, or structured review work
• Strong written English and ability to apply detailed rubrics consistently
• Familiarity with LLM evaluation concepts (helpfulness, harmlessness, factuality, relevance)
• Comfort working remotely with productivity and quality targets

Remote Work Details

• Remote, full-time role with async-first collaboration, structured rubrics, golden sets, audits, and feedback loops