Neuron Collectives Software Engineer, Trainium Collectives

About the role

As a Neuron Collectives Software Developer, you will enhance collective algorithms and topologies for optimal training performance, working at the intersection of hardware, firmware, and distributed systems. The role offers opportunities to work on cutting-edge AI training hardware while contributing to one of Amazon's most critical initiatives.

Responsibilities

• Use tools like Neuron Explorer to identify bottlenecks in compute and bus bandwidth utilization
• Monitor and analyze processor, DMA, firmware, and workload metrics
• Optimize collective operations to scale AI compute across the data center through low-level device driver development
• Work closely with the hardware team to co-optimize software and Trainium silicon
• Develop and optimize C/C++ implementations of collective communication patterns
• Investigate and implement improvements for specific training topologies used by modern LLMs
• Build and maintain analysis frameworks and automation solutions

About the team

Annapurna Labs, a crucial part of AWS, is responsible for developing hardware and software components for EC2 infrastructure. The Neuron Collectives team owns the software stack that enables collective operations — the communication primitives that allow AI training to scale across thousands of chips in the data center. Our team focuses on building networking solutions for Machine Learning (ML) and High-Performance Computing (HPC) workloads on AWS.

You will work side-by-side with infrastructure experts, hardware engineers, RTL engineers, scientists, and architects in a globally distributed, international workforce. The team values mentorship, fast-paced innovation in AI/ML, and work-life balance, offering flexibility in working hours. Career growth opportunities are abundant, with encouragement to continuously learn in a rapidly evolving field.

Qualifications

Basic Qualifications

• 3+ years of non-internship professional software development experience
• 2+ years of non-internship design or architecture (design patterns, reliability, and scaling) of new and existing systems experience
• Experience programming with at least one software programming language

Preferred Qualifications

• 3+ years of full software development life cycle experience, including coding standards, code reviews, source control management, build processes, testing, and operations
• Bachelor's degree in computer science or equivalent

Pay

USA, CA, Cupertino - $165,200.00 - $223,600.00 USD annually

Benefits

Amazon offers a comprehensive benefits package, including:

• Health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance, and optional supplemental life plans)
• Employee Assistance Program (EAP) and mental health support
• Medical Advice Line and Flexible Spending Accounts
• Adoption and surrogacy reimbursement coverage
• 401(k) matching
• Paid time off and parental leave
• Sign-on payments and restricted stock units (RSUs)

Learn more about our benefits at amazon.jobs/en/benefits.