Head of Quality, AI Data Operations

TaskUs is a provider of outsourced digital services and next-generation customer experience to fast-growing technology companies, helping its clients represent, protect and grow their brands. Leveraging a cloud-based infrastructure, TaskUs serves clients in the fastest-growing sectors, including social media, e-commerce, gaming, streaming media, food delivery, ride-sharing, HiTech, FinTech, and HealthTech. The company has expanded its workforce to approximately 60,000 employees globally, with a presence in twenty-three locations across twelve countries, including the Philippines, India, and the United States.

About the role

As the Head of Quality, AI Data Operations, you will ensure the quality of training data, adversarial testing, and model evaluation services meets the highest standards. You will drive thought leadership on data quality, work closely with customers to define and deliver high-quality outputs, and oversee the development of training and quality protocols across projects. This role requires strategic thinking, hands-on operations, and cross-functional collaboration to ensure impactful services for AI and LLM projects. The ideal candidate will have a strong entrepreneurial mindset, deep expertise in statistics and quality assurance, and experience leading global teams in a fast-paced, ambiguous environment.

Responsibilities

• Lead the design and implementation of quality assurance protocols tailored to training data and model evaluation, primarily for GenAI/LLM projects, with some traditional AI work.
• Design and oversee specialized quality protocols for the collection and enrichment of multi-modal data for advanced Robotics and Autonomous Vehicle (AV) clients.
• Master the "Human-in-the-Loop" for Hardware: lead the quality strategy for remote operations support, ensuring human intervention data for robotaxi navigation and robotic limb coordination meets zero-compromise safety standards.
• Own the definition of "high-quality" data across diverse projects and ensure these standards are met organization-wide.
• Drive thought leadership with customers, aligning on data quality goals and developing innovative quality processes.
• Act as the primary point of contact for customer discussions related to data quality and model evaluation.
• Provide strategic guidance on handling edge cases and offer solutions for challenges in building high-quality training data.
• Lead external communication on data quality, positioning the company as a thought leader in AI model robustness and evaluation.
• Foster a high-performance culture, encouraging continuous learning and improvement.
• Explore and implement new methodologies for improving the quality of training data and model evaluation processes.
• Drive a culture of testing, iterating, and scaling processes to ensure efficient and results-driven workflows.

Requirements

• 7+ years of Data Quality leadership experience, ideally within an organization providing HITL, RLHF, and evaluation services to leading LLM developers, Mag7 companies, AV builders, and Robotics companies.
• Deep understanding of LLMs, Generative AI workflows, and multi-modal data structures (video, spatial, and sensor fusion) essential for the robotics ecosystem.
• Strong interest and commitment to learning about the latest developments in LLMs and AI technologies.
• Proven ability to design and lead quality assurance processes for data annotation and AI model evaluation.
• Experience developing scalable systems like "golden datasets" for evaluating contributor performance.
• Strong communication and leadership skills with the ability to engage effectively with customers, internal stakeholders, and global teams.
• Track record of managing teams in a high-velocity environment, with a focus on outcomes.
• Excited to tackle ambiguous problems with a relentless attitude of testing, iterating, and scaling solutions.
• Strong analytical skills with the ability to derive actionable insights from complex data.

Benefits

• Comprehensive benefits package including medical, dental, and vision insurance.
• 401(k) with company match.
• Paid time off including vacation, sick leave, and holidays.

Pay

Salary range: $160,000 - $234,000 per year, plus bonus.

Schedule

• US - Remote
• Travel: 25%