STEM Careers India Engineer
Rex.zone · United States · 1 wk ago
RemoteRemoteEngineeringFull-time
About the role
Rex.zone connects India-aligned STEM talent with Remote, Full-Time engineering programs supporting AI/ML training workflows. You will help improve training data quality and evaluation rigor across LLM training pipelines, RLHF, and model evaluation.
Key Responsibilities
- Design and improve LLM training pipelines for supervised fine-tuning and RLHF
- Build and maintain annotation tooling, task routing, and QA evaluation checks
- Define labeling taxonomies for NLP tasks (e.g., named entity recognition, classification)
- SUPPORT computer vision annotation workflows (bounding boxes, polygons, segmentation QA)
- Run prompt evaluation and rubric-based model evaluation to identify failure modes
- Implement content safety labeling policies, audits, and escalation paths
- Create annotation guidelines, sampling plans, and ensure annotation guidelines compliance
- Analyze training data quality metrics, disagreement patterns, and error distributions
- Document datasets and evaluation artifacts for traceability and reproducibility
Required Qualifications
- Mid-Senior experience in engineering, data operations engineering, or applied ML workflows
- Hands-on experience with data labeling systems, QA evaluation, or model evaluation pipelines
- Familiarity with RLHF concepts and large language model evaluation methods
- Working knowledge of NLP and/or computer vision annotation
- Strong written communication for remote collaboration
How To Apply
Apply via Rex.zone and highlight experience in training data quality, annotation guidelines compliance, QA evaluation, RLHF, prompt evaluation, NLP/NER, computer vision annotation, and content safety labeling.