Sr. SDM, AI Inference Technology, Neuron SDK

About the role

AWS Utility Computing (UC) provides product innovations — from foundational services such as Amazon Elastic Compute Cloud (EC2), to new product innovations that continue to set AWS’s services and features apart in the industry. Come develop inference acceleration for AWS Neuron, the complete software stack for Trainium, Amazon's custom cloud-scale machine learning accelerators that power the latest AI models.

Responsibilities

• Lead a strong team of managers and engineers to build fundamental inference technology building blocks and libraries to enable AI developers to optimize models for inference on Trainium and Inferentia devices.
• Be responsible for the full development life cycle of inference library and feature development, including reliability and scalability.
• Develop the Neuronx_Distributed Inference Libraries and contribute to other popular open source Inference Libraries, enabling customers to optimize LLMs, multimodal, and generative models.

Requirements

• 10+ years of engineering experience
• 5+ years of engineering team management experience
• 10+ years of planning, designing, developing and delivering consumer software experience
• Experience partnering with product or program management teams
• Experience managing multiple concurrent programs, projects and development teams in an Agile environment

Qualifications

• Strong technical ability to understand and manage a vertically integrated system stack that consists of hardware, frameworks, and workflows

Skills

• Experience delivering AI feature support for demanding, fast-changing priorities
• Experience delivering high-performance models using distributed inference libraries

Benefits

Amazon offers comprehensive benefits including health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage), 401(k) matching, paid time off, and parental leave. Learn more about our benefits at https://amazon.jobs/en/benefits.

Pay

The base salary range for this position is listed below. Your Amazon package will include sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location.

USA, CA, Cupertino - 253,100.00 - 342,300.00 USD annually

USA, WA, Seattle - 220,100.00 - 297,700.00 USD annually

Schedule

Full-time

Company

Annapurna Labs (U.S.) Inc.

Job ID

A3009701