Senior Software Development Engineer, AWS Mantle

About the role

We're looking for an experienced Senior Software Development Engineer to help build and scale the distributed inference engine that powers Amazon Bedrock. As part of the AWS Mantle team, you will design and deliver critical systems that enable millions of customers to access the world's leading foundation models—securely, reliably, and at global scale. This is an opportunity to work on one of the most impactful AI infrastructure platforms at AWS, where your code and design decisions will directly shape how generative AI is served to enterprises worldwide.

Responsibilities

• Design and implement core components of Mantle's distributed inference engine, including request routing, load balancing, model lifecycle management, and quality-of-service enforcement
• Build and operate services that onboard new foundation models rapidly while maintaining strict performance SLAs and Zero Operator Access (ZOA) security guarantees
• Drive operational excellence by owning your team's services in production—monitoring, alarming, incident response, and continuous reliability improvement
• Partner with applied scientists, ML engineers, and partner teams to integrate new model architectures and optimize inference performance across GPU/accelerator fleet
• Mentor junior and mid-level engineers through code reviews, design reviews, and hands-on guidance that elevates the team's technical capabilities

Requirements

• 5+ years of non-internship professional software development experience
• 5+ years of programming with at least one software programming language experience
• 5+ years of leading design or architecture (design patterns, reliability and scaling) of new and existing systems experience
• Experience as a mentor, tech lead or leading an engineering team
• Bachelor's degree in Computer Science, Engineering, a related field, or equivalent experience

Qualifications

• Master's degree in computer science, machine learning, engineering, or related fields
• Experience in machine learning, data mining, information retrieval, statistics or natural language processing, or experience in developing and deploying LLMs in production on GPUs, Neuron, TPU or other AI acceleration hardware
• Experience designing APIs at scale, particularly RESTful or streaming APIs with strict latency and availability requirements

Benefits

Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit here for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.

Pay

The base salary range for this position is listed below. Your Amazon package will include sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon also offers comprehensive benefits including health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage), 401(k) matching, paid time off, and parental leave. Learn more about our benefits at here.

Schedule

Learn more about our benefits at here.