Sr. SDM, AI Inference Technology, Neuron SDK

About the role

Develop inference acceleration for AWS Neuron, the complete software stack for Trainium, Amazon's custom cloud-scale machine learning accelerators that power the latest AI models.

Responsibilities

• Lead a strong team of managers and engineers to build fundamental inference technology building blocks and libraries to enable AI developers to optimize models for inference on Trainium and Inferentia devices.
• Develop the Neuronx_Distributed Inference Libraries and contribute to other popular open source Inference Libraries, enabling customers to optimize LLMs, multimodal, and generative models.
• Work with the executive leadership and other senior management and technical leaders to define product directions and deliver them to customers.
• Build massive-scale distributed training and inference solutions, developing the full stack of software, servers, and chips together with teams across the Annapurna organization to run the largest machine learning workloads.

Requirements

• 10+ years of engineering experience
• 5+ years of engineering team management experience
• 10+ years of planning, designing, developing and delivering consumer software experience
• Experience partnering with product or program management teams
• Experience managing multiple concurrent programs, projects and development teams in an Agile environment

Qualifications

• Experience partnering with product and program management teams
• Experience designing and developing large scale, high-traffic applications

Skills

• Strong technical ability to understand and manage a vertically integrated system stack that consists of hardware, frameworks, and workflows

Benefits

A day in the life

Work/Life Balance

Mentorship & Career Growth

Pay

Base salary range: $220,100.00 - $297,700.00 USD annually

Schedule

Not specified