AI Data Quality Specialist - English (Philippines)
Filipino Contractors · New York, NY · 3 wk ago
Quality AssuranceFull-time
About the role
We are seeking an AI Data Quality & Annotation Specialist to help develop and evaluate large language models (LLMs). Your role will involve reviewing English language content to assess sentiment accuracy, factual consistency, and reasoning quality using structured guidelines.
Responsibilities
- Review English language content to assess sentiment accuracy, factual consistency, and reasoning quality using structured guidelines.
- Provide clear and well-reasoned written justifications for your assessments.
- Ensure consistency in decision-making across high volumes of tasks.
- Contribute to the development and evaluation of large language models (LLMs).
Requirements
- Advanced English proficiency (reading and writing) with professional-level fluency.
- Strong comprehension and articulation skills, with the ability to provide clear and well-reasoned written justifications.
- Previous experience in data annotation, AI training, or related projects.
- PREFERRED: Experience in analytical fields such as linguistics, journalism, research, or similar domains.
- Exceptional attention to detail and accuracy.
- Proven analytical reasoning and critical thinking abilities.
- Consistency in decision-making across high volumes of tasks.
- Familiarity with AI systems, large language models (LLMs), or evaluation processes (preferred but not required).