Senior Product Quality Analyst
About the role
We are seeking a Senior Product Quality Analyst to drive quality for key audio discovery features and recommendation engines. In this role, you will partner with product, design, engineering, and data science teams to create high-quality, culturally aware listener experiences. You will balance hands-on evaluation with strategic oversight, defining standard evaluation frameworks that shape product roadmaps.
This is a contract position, with a salary of $40 - 55 per hour, and work hours of 9am to 6pm. A Bachelor's degree is required.
Responsibilities
- Define and oversee quality standards and success metrics for core discovery surfaces and recommendations.
- Design and execute structured qualitative evaluations using AI tools and LLMs to support assessments.
- Develop and maintain reusable evaluation frameworks and guidelines adopted across teams.
- Communicate qualitative findings, risks, and strategic trade-offs to cross-functional stakeholders.
Qualifications
Required qualifications include a strong background in product quality, research ops, content quality, or product ops with ownership of major workstreams, as well as a deep understanding of audio culture, listener behavior, and user expectations. You should also have proven capability in qualitative analysis and evaluating structured, complex datasets, and experience with or high aptitude for evaluating ML-driven products and AI/LLM-powered features.
Preferred qualifications include experience designing and implementing testing frameworks adopted across multiple product teams, demonstrated ability to mentor and guide junior quality analysts, and exceptional communication and stakeholder management skills.
Benefits
- Medical, prescription, dental, vision, AD&D, and life insurance offerings
- Short-term disability
- 401K plan (all benefits are based on eligibility)