Senior Machine Learning Engineer, Alexa-Conv A Modeling&Learning

About the role

Alexa AI is building the next generation of Alexa+, Amazon's LLM-powered conversational assistant, and its future is agentic: LLM systems that reason and act over dozens of chained inferences, coupled to real environments where their actions persist. Making these agents smarter, faster, and cheaper is as much a systems problem as a modeling problem - agent performance depends on the model, the harness, the evaluation infrastructure, and the serving stack co-designed together.

We are looking for a Senior Machine Learning Engineer to build and own core systems in this agentic platform. You will take one of its foundational areas - agentic evaluation infrastructure, reinforcement learning training systems, self-learning pipelines, or agentic inference serving - and own it end to end: the design, the implementation, the operational bar, and the interfaces that scientists and partner teams build on.

Responsibilities

• Design, build, and operate major components of the agentic AI platform: evaluation harnesses, sandboxed environments and mocked resources, RL and post-training pipelines, self-learning data pipelines, or inference serving for agentic traffic
• Lead the design work in your area: write the design documents, drive them through review, and make the build-versus-adopt calls within your scope
• Own reliability and performance: instrument your systems, drive down the failure modes that make results untrustworthy (process management, resource contention, unreliable external calls), and report platform health in metrics rather than anecdotes
• Partner with applied scientists to turn research code into production infrastructure, and expose it through interfaces other teams can use without your involvement
• Scale what you build: hundreds of concurrent evaluation trials, long-context multi-turn training jobs, and large GPU formations on shared company infrastructure
• Raise the engineering bar through code and design reviews, operational excellence practices, and deep dives on cross-system problems
• Mentor engineers earlier in their careers and help set technical direction for your team

About The Team

Our organization owns the applied science and platform engineering for Alexa's agentic experiences. We operate at the intersection of large language models, reinforcement learning with verifiable rewards, agentic architectures, and large-scale distributed systems, serving customers across dozens of languages and device types.

Our platform provides the shared evaluation, training, self-learning, and serving foundation for Alexa's flagship agent programs and the broader agent portfolio behind them.