Product Manager, Technical: Responsible AI
Job Overview
This role is essential for managing the Responsible AI evaluation framework, the evaluation program that applies it, and the AI transparency and disclosure standard as technical products that meet specific business objectives within the organization. It involves owning the product lifecycle, including vision, strategy, the benchmarks and tests AI engineers build and run, and stakeholder collaboration with Legal, Privacy and the approving functions, which make the decisions. The role requires balancing technical feasibility, the regulatory requirements Legal provides, and business goals to prioritize which AI systems are evaluated, when, and against which benchmarks. Success is measured by evaluation coverage, findings closed, and approvers having clear, complete evidence for every AI system they review. The work impacts the organization by enabling cross-functional teams to deliver AI that is fair, safe and transparent for customers and employees.
Job Responsibilities
- Own the end-to-end product lifecycle for the Responsible AI evaluation framework and program, and the AI transparency and disclosure standard, by defining vision, strategy, and roadmap to align with business and technical goals
- Conduct market and customer research to identify opportunities and inform product decisions based on data analysis and customer feedback, including Responsible AI frameworks and the regulatory requirements Legal provides
- Translate product strategy into detailed features and user stories, managing the product backlog to support Agile development teams, including the evaluation tests and benchmarks AI engineers build and run
- Collaborate with cross-functional teams and stakeholders to coordinate release schedules and ensure timely product delivery, including Legal, Privacy and the Applied AI design authority
- Monitor product performance and quality in production, addressing defects and driving continuous improvement, and track evaluation findings to closure with system owners
- Also responsible for other duties/projects as assigned by business management as needed