Head of Quality, AI Data Operations

About TaskUs

TaskUs (Nasdaq: TASK) is a leading provider of outsourced digital services and next-generation customer experience to the world’s most innovative companies. We solve complex operational challenges for global category leaders within AI, autonomous vehicles (AV), robotics, and beyond. By combining specialized human talent with intelligent technology, we power the companies shaping the future. The People First culture at TaskUs has enabled the company to expand its workforce to approximately 45,000 employees globally. Presently, we have a presence in twenty-three locations across twelve countries, which include the Philippines, India, and the United States. It started with one ridiculously good idea to create a different breed of Business Processing Outsourcing (BPO)!

Key Responsibilities

• Lead the design and implementation of quality assurance protocols tailored to training data and model evaluation.
• Design and oversee specialized quality protocols for the collection and enrichment of multi-modal data specifically for advanced Robotics and Autonomous Vehicle (AV) clients.
• Master the "Human-in-the-Loop" for Hardware: Lead the quality strategy for remote operations support, ensuring that human intervention data used for robotaxi navigation and robotic limb coordination meets zero-compromise safety standards.
• Own the definition of what "high-quality" data means across diverse projects and ensure these standards are met across the organization.
• Drive thought leadership with customers, aligning on data quality goals, and developing innovative quality processes.
• Provide strategic guidance on handling edge cases, and offer solutions for the nuances and challenges involved in building high-quality training data.
• Lead external communication on data quality, positioning the company as a thought leader in AI model robustness and evaluation.
• Foster a high-performance culture, encouraging continuous learning and improvement.
• Continuously explore and implement new methodologies for improving the quality of training data and model evaluation processes.
• Drive a culture of testing, iterating, and scaling processes, ensuring that all workflows are efficient and results-driven.

Required Skills & Competencies

• 7+ years of Data Quality leadership experience, ideally within an organization that provides HITL, RLHF and evaluation services to leading LLM developers, Mag7 companies, AV builders and Robotics companies.
• A deep understanding of how LLMs, Generative AI workflows, and multi-modal data structures (video, spatial, and sensor fusion) essential for the robotics ecosystem.
• A strong interest and commitment to learning about the latest developments in LLMs and AI technologies.
• Proven ability to design and lead quality assurance processes for data annotation and AI model evaluation.
• Experience developing scalable systems like "golden datasets" for evaluating contributor performance.
• Strong communication and leadership skills with the ability to engage effectively with customers, internal stakeholders, and global teams.
• A proven track record of managing teams in a high-velocity environment, with a focus on outcomes.
• An excited attitude to tackle ambiguous problems with a relentless testing, iterating, and scaling solutions.
• A strong analytical skills with the ability to derive actionable insights from complex data.