Software Development Engineer, Annapurna Labs, Elastic Collectives

About the role

We are seeking an experienced engineer to work on distributed AI/ML systems. This role involves working on collective operations—the fundamental operations that enable AI to scale across multiple accelerators and servers. Most of our stack is C/C++ and relatively low level, so solid knowledge of Linux, kernels, and performant code is important. Experience with embedded systems is valued, and experience with high-speed networking or HPC interconnects is highly valued.

If you like solving hard problems, want to work with HPC and ML customers, iterate fast, and deliver meaningful solutions at scale, this role is at the forefront of AI/ML. You’ll be working on features for the largest clusters, with the largest customers, for the largest AI models.

The org you would be joining is Annapurna Labs, an integral part of AWS, developing hardware and software components critical to EC2 infrastructure. Every instance in EC2 runs some type of hardware designed by Annapurna Labs. We specialize in designing software, systems, and chips that optimize the AWS customer experience.

Responsibilities

• Develop distributed AI/ML systems, focusing on collective operations for scaling across accelerators and servers
• Work on low-level C/C++ code, optimizing for performance in Linux environments
• Collaborate with infrastructure experts, hardware engineers, RTL engineers, scientists, and architects
• Contribute to networking solutions for Machine Learning (ML) and High-Performance Computing (HPC) workloads on AWS
• Mentor new and junior engineers while receiving senior mentorship
• Engage in fast-paced development on the latest advancements in AI/ML

Requirements

• 3+ years of non-internship professional software development experience
• 2+ years of non-internship design or architecture experience (design patterns, reliability, and scaling) of new and existing systems
• Experience programming with at least one software programming language
• Proficiency in C/C++
• Solid knowledge of Linux, kernels, and performant code

Preferred Qualifications

• 3+ years of full software development life cycle experience, including coding standards, code reviews, source control management, build processes, testing, and operations
• Experience with embedded systems, high-speed networking, or HPC interconnects
• Bachelor's degree in computer science or equivalent

About the Team

Our team is dedicated to supporting new members with a broad mix of experience levels and tenures. We foster an environment that celebrates knowledge-sharing and mentorship, with senior members providing one-on-one mentoring and thorough, kind code reviews. We prioritize your career growth, assigning projects that develop your engineering expertise and empower you to take on more complex tasks.

Our workforce is global and international, with team members from numerous countries. We value diverse experiences and encourage candidates from non-traditional backgrounds to apply. The pace is fast as we work on cutting-edge AI/ML advancements, but we also take time to bond as a team and celebrate successes. Flexibility in working hours and work-life balance are core tenets of our org.

Benefits

• Ongoing mentorship and career growth opportunities, including working with principal-level engineers and directors
• Employee-led affinity groups fostering inclusion and diversity
• Flexible working culture supporting work-life harmony
• Access to learning experiences and events, such as Conversations on Race and Ethnicity (CORE) and AmazeCon (gender diversity) conferences
• Resources for continuous professional development

Amazon is an equal opportunity employer. Los Angeles County applicants: This role includes adhering to safety standards, effective communication, and compliance with all laws and company policies. Pursuant to the Los Angeles County Fair Chance Ordinance, we consider qualified applicants with arrest and conviction records.