French Data Quality Analyst (Human-in-the-Loop AI)
Welo Data · Chicago, IL · 1 wk ago
On-siteInformation Technology$38/hrFull-time
What You'll Do
- Support quality and execution across DLA teams, ensuring work meets defined standards at scale
- Audit DLA outputs and provide structured, actionable feedback to improve accuracy and consistency
- Act as the first line of support for DLAs — answering questions and helping interpret guidelines
- Help DLAs navigate ambiguity and apply evolving instructions effectively
- Support onboarding and training of new DLAs through hands-on guidance and coaching
- Monitor workflows, queues, and blockers — escalating risks and gaps to Team Leads
- Identify patterns, recurring issues, and edge cases in both human and model outputs
- Participate in calibrations, team discussions, and stakeholder syncs
- Contribute to improving guidelines, processes, and overall team performance
- Document findings and feedback in a clear, concise, and actionable way
What We're Looking For
- Native-level French proficiency and a university degree (Bachelor’s or higher)
- 2–4 years of experience in data annotation, content quality, QA, or related fields
- Strong ability to interpret and apply complex guidelines with consistency
- Excellent attention to detail with a high bar for quality
- Ability to stay consistent while working with evolving guidelines and priorities
- Experience in AI/ML data workflows or human-in-the-loop evaluation environments
- Prior experience auditing or reviewing the work of others
- Familiarity with safety, compliance, or policy-driven content evaluation
Benefits
- Paid Vacation: 6 days
- Paid Company Holidays: 2 days (Memorial Day and Labor Day)
- Paid Sick Leave: accrued per applicable state law and company policy
- Medical, Dental, and Vision Insurance (eligibility applies)
- Health Savings Account (HSA)
- 401(k) Retirement Plan
- Employee Assistance Program
- Additional voluntary benefits (life, accident, critical illness, etc.)
- Free Gourmet Food: Free breakfast, lunch, and dinner are provided, featuring a wide variety of cuisines in multiple cafes.
- Micro-kitchens & Snacks: Offices are stocked with free snacks and beverages, including premium coffee and La Croix.
- Unique Campus Features: Some locations include roof-top nature parks
- Commuter Benefits: Free transport, shuttles, and sometimes bike-to-work perks.