Sr Software Development Engineer, Neuron Collectives, Annapurna Labs

About the role

The AWS Neuron Collectives team is seeking a Software Engineer to optimize collective operations for AWS Trainium. Trainium is one of Amazon's highest priority initiatives, powering the frontier AI models being trained today.

Responsibilities

• Enhance collective algorithms and topologies for optimal training performance
• Use tools like Neuron Explorer to identify bottlenecks in compute and bus bandwidth utilization
• Monitor and analyze processor, DMA, firmware, and workload metrics
• Optimize collective operations to scale AI compute across the data center
• Work closely with the hardware team to co-optimize software and Trainium silicon
• Develop and optimize C/C++ implementations of collective communication patterns
• Investigate and implement improvements for specific training topologies used by modern LLMs
• Build and maintain analysis frameworks and automation solutions

Qualifications

• Bachelor's degree in computer science or equivalent
• 5+ years of Experience building complex software systems that have been successfully delivered to customers
• 5+ years of Experience contributing to the architecture and design (architecture, design patterns, reliability and scaling) of new and current systems