Sr. Product Quality Analyst (Remote)

Responsibilities

• Define and oversee quality criteria and success measures for a product area (e.g., specific discovery surfaces, recommendations, or AI-powered features).
• Design and run structured qualitative evaluations.
• Use LLMs and AI tools to support assessments, and design processes that keep human judgment at the center.
• Develop and maintain reusable evaluation frameworks and guidelines that can be adopted across teams.
• Partner closely with cross-functional leads to embed quality considerations early in roadmaps and design decisions.
• Communicate findings, risks, and trade-offs clearly to a range of stakeholders, influencing product direction.
• Contribute to planning and prioritization, including scoping effort and resourcing needs.
• Coach and mentor other Product Quality Analysts on methods, standards, and best practices.

Qualifications

• Significant experience in product quality or related roles (QA, content quality, research ops, product ops, etc.), with ownership of a product/workstream.
• Deep understanding of audio culture and how they influence listener behavior and expectations.
• Strong skills in qualitative analysis; comfortable with structured evaluations and large data sets.
• Familiarity with ML-driven products and evaluation of AI/LLM-powered features, or strong motivation and aptitude to grow quickly here.
• Experience designing or improving processes and frameworks adopted by multiple squads or product groups.
• Excellent communication and stakeholder management skills, vertically and horizontally.

Location: Fully Remote (EST working hours)
Type: W2 Contract
Duration: 5 months (potential to extend)
Compensation Range: $50-54/HR