Head of Quality, AI Data Operations
Ladders · United States · 1 wk ago
RemoteRemoteQuality Assurance$160k–$200k/yrFull-time
Responsibilities
- Lead the design and implementation of quality assurance protocols focused on training data and model evaluation for GenAI and traditional AI projects
- Oversee specialized quality protocols for the collection and enrichment of multi-modal data for Robotics and Autonomous Vehicle projects
- Develop quality strategies for remote operations in robotics, ensuring data meets safety standards
- Define organizational standards for 'high-quality' data across various projects and ensure compliance
- Drive thought leadership by collaborating with clients on data quality goals and innovative processes
- Act as the principal contact for customer discussions regarding data quality issues
- Provide strategic guidance on addressing unique challenges in building high-quality training data
Qualifications
- 7+ years of experience in Data Quality leadership, preferably in HITL, RLHF, and evaluation services for AI and Robotics companies
- Deep knowledge of large language models, generative AI workflows, and multi-modal data structures essential for robotics
- Strong passion for AI technology with a hands-on approach to exploring and manipulating tools
- Prominent track record in designing robust quality assurance processes for data annotation and model evaluation
- Experience in developing scalable systems such as 'golden datasets' for performance evaluation
- Exceptional leadership and communication skills to effectively engage with diverse stakeholders
Benefits
- Comprehensive medical, dental, and vision insurance
- 401(k) plan with company matching contributions
- Paid time off, including vacation, sick leave, and holidays