Sr. Software Engineer- AI/ML, AWS Neuron Distributed Training

About the role

Annapurna Labs designs silicon and software that accelerates innovation. Customers choose us to create cloud solutions that solve challenges that were unimaginable a short time ago—even yesterday. Our custom chips, accelerators, and software stacks enable us to take on technical challenges that have never been seen before, and deliver results that help our customers change the world.

Responsibilities

• Lead efforts to build distributed training support into PyTorch, the Neuron compiler, and runtime stacks.
• Enable distributed training strategies as well as use them to optimize models to achieve peak performance and maximize efficiency on AWS custom silicon, including Trainium servers.
• Experience as a mentor, tech lead or leading an engineering team.
• Experience in machine learning, large scale training with LLMs and expertise in Pytorch.

Requirements

Basic Qualifications:

• Bachelor's degree in computer science or equivalent
• 5+ years of non-internship professional software development experience
• 5+ years of programming with at least one software programming language experience
• 5+ years of leading design or architecture (design patterns, reliability and scaling) of new and existing systems experience
• 5+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience
• Experience as a mentor, tech lead or leading an engineering team
• Experience in machine learning, large scale training with LLMs and expertise in Pytorch

Qualifications

Preferred Qualifications:

• Master's degree in computer science or equivalent
• Experience in computer architecture
• Previous software engineering expertise with Pytorch/Jax/Tensorflow, Distributed libraries and Frameworks, End-to-end Model Training