Software Engineer- AI/ML, Amazon Neuron Training

Amazon's Annapurna Labs team builds AWS Neuron, a software development kit that accelerates deep learning and generative AI workloads on Trainium machine learning accelerators. The Software Engineer will implement and optimize distributed training components for large-scale training, post-training, and reinforcement learning workloads, while profiling performance and collaborating across the Neuron software stack. Responsibilities You’ll implement and tune components of our distributed training stack for large-scale training, post-training, and reinforcement learning workloads on the latest Trainium instances, working across PyTorch and the Neuron software stackYou'll contribute to parallelism strategies such as data, tensor, and pipeline parallelism and apply reduced-precision formats under the guidance of senior team membersYou'll profile workloads to help determine whether a bottleneck sits in compute, memory, collectives, or host overhead, and work with compiler, runtime, and collectives engineers to help land the fixYou'll build and maintain internal tooling, benchmarks, and tests that keep the team's performance work reproducible, and take on increasing ownership as you grow in the role