Senior Machine Learning Engineer, Applied AI Quality

Our client operates foundational teams across disciplines including People, Finance, Counsel, Hardware, Information Security, and Platform Infrastructure Engineering. They support global business groups by developing inclusive policies, providing financial forecasting and legal counsel, safeguarding systems, and nurturing new initiatives with a focus on economic empowerment and diverse perspectives.

About the Opportunity

The Senior Machine Learning Engineer, Applied AI Quality will lead the development and technical direction of advanced AI-driven quality evaluation systems. This role involves architecting systems that assess product behavior using LLMs and AI agents to detect issues and generate insights, improving product reliability and user experience. The position influences quality measurement strategies and collaborates across teams to establish scalable, foundational AI infrastructure.

Responsibilities

• Lead technical strategy and architecture for AI-powered quality and evaluation systems.
• Develop scalable systems utilizing LLMs, agents, and behavioral data to evaluate product quality.
• Define long-term evaluation and quality intelligence approaches across complex products.
• Translate organizational needs into technical roadmaps and platform capabilities.
• Influence engineering standards for building reliable and trustworthy AI systems.
• Lead cross-functional initiatives involving product, infrastructure, data, and AI teams.
• Mentor engineers through technical leadership and design reviews.
• Identify opportunities where AI can enhance understanding and improvement of product behavior.

Requirements

• Minimum 5 years of experience in software or machine learning engineering.
• Extensive experience designing and deploying large-scale AI/ML systems in production.
• Expertise with LLMs, agents, evaluation systems, retrieval architectures, and AI infrastructure.
• Proven leadership of complex technical projects from concept to adoption.
• Strong systems thinking and architectural judgment balancing experimentation and scalability.
• Experience defining technical strategy and influencing broader roadmaps.
• Excellent communication and cross-functional leadership skills.
• Ability to create platforms and frameworks that empower engineering teams.

Pay

• Zone A: $228,700—$343,100 USD
• Zone B: $217,300—$325,900 USD
• Zone C: $205,900—$308,900 USD
• Zone D: $194,500—$291,700 USD