Jobs · Quality Assurance · New York

Data Quality Team Lead (Human-in-the-Loop AI)

Welo Data · New York, NY · 1 wk ago
On-siteQuality Assurance$43.5/hrFull-time

Overview

Welo Data is seeking a Data Quality Lead to manage teams of Data Quality Analysts supporting AI model evaluation and improvement. The role involves guiding teams through fast-changing work, ensuring high-quality output, and bridging analysts and stakeholders.

Project Details

  • Job Title: Data Quality Lead
  • Hiring in: NYC, Seattle, Bellevue, Redmond, San Francisco, Sunnyvale, Burlingame
  • Hours: Full-time, 40 hours per week
  • Employment Type: W2 Full-Time Employee
  • Pay Rate: $43.50/hour
  • Contract Duration: 1-year contract with possible extension
  • Note: This is a 100% onsite position — remote work is not available for this role. Candidates must be located in or able to commute to one of the following cities: New York City, Seattle, Bellevue, Redmond, San Francisco, Sunnyvale, or Burlingame.

What You'll Do

  • Lead and support a team of Data Quality Analysts
  • Oversee overall operational performance across workflows and teams
  • Ensure team activities align with broader business objectives and program goals
  • Drive the success of key initiatives across quality, delivery, and team performance
  • Own quality across workflows — including audits, calibrations, and feedback loops
  • Identify trends, risks, and gaps in model performance and data quality
  • Translate ambiguous or evolving guidelines into clear team direction
  • Run calibrations and ensure consistency across reviewers
  • Partner with stakeholders to align on quality standards and expectations
  • Prioritize and support hiring of linguists and specialized talent as needed
  • Drive continuous improvement across processes, tooling, and evaluation methods
  • Step into edge cases and complex decisions when needed
  • Support team growth, coaching, and performance management

What We're Looking For

  • Experience: 5–8 years in data quality, QA, AI/ML operations, or related fields; 2+ years leading teams at scale
  • Languages: Native-level English proficiency and a university degree (Bachelor’s or higher); proficiency in additional languages preferred
  • Skills: Strong operational mindset, proven quality, delivery, and process improvement abilities, strong judgment, stakeholder interaction, comfort with ambiguity, deep attention to detail, interest in AI

Role Scope & Accountability

This leader is accountable for end-to-end operational success, including resource management, process optimization, and continuous improvement.

Benefits

  • Paid Vacation: 6 days
  • Paid Company Holidays: 2 days (Memorial Day and Labor Day)
  • Paid Sick Leave: accrual per applicable state law and company policy
  • Health Benefits: Medical, Dental, Vision Insurance, Health Savings Account (HSA), 401(k) Retirement Plan, Employee Assistance Program, additional voluntary benefits (life, accident, critical illness, etc.)
  • Workplace Amenities: Free gourmet food, micro-kitchens & snacks, unique campus features, commuter benefits

Similar jobs