Software Development Manager, Neuron Tools, Annapurna Labs

About the role

AWS Neuron is the complete software stack for the AWS Inferentia and Trainium cloud-scale machine learning accelerators and the Trn1 and Inf1 servers that use them. As the Software Development Manager for the Tools Team, you will lead a talented team of engineers to develop and maintain high-performance monitoring and profiling tools for machine learning applications and AI accelerators.

Responsibilities

• Oversee the design, development, and deployment of the Neuron Profiler and other Neuron Tools.
• Ensure the profiler provides deep insights into performance bottlenecks and system behavior for internal and external customers.
• Manage the full development life cycle of the Neuron Profiler/Tools toolchain, focusing on scalability, reliability, and usability.
• Collaborate with cross-functional teams to ensure that the C++ compiler and runtime generate key information for customers to understand and optimize the performance of our custom hardware.
• Drive innovations that allow the profiler to support multiple frameworks like PyTorch, TensorFlow, and XLA.

Requirements

• 3+ years of engineering team management experience
• 7+ years of working directly within engineering teams experience
• 3+ years of designing or architecting (design patterns, reliability and scaling) of new and existing systems experience
• Experience partnering with product or program management teams
• Experience in C++, Go, and Python

Qualifications

• Experience with ML-specific profiler tools (like PyTorch Profiler or TensorFlow Profiler)
• Direct customer-facing experience
• Strong motivation to achieve results