Software Engineer-AI/ML, Inference Team - AWS Neuron

About the role

AWS Neuron is the complete software stack for AWS Inferentia and Trainium — AWS purpose-built accelerators for cloud-scale machine learning. Join the Machine Learning Inference Applications team to build the serving technology that lets customers run large-scale model inference fast and efficiently on Neuron chips. As an engineer on this team, you'll work on core serving technologies within open-source frameworks such as vLLM and SGLang, optimizing model serving performance on Neuron and broadening the range of models we support out of the box