Software Development Manager , EC2 Nitro

About the role

Join our EC2 Nitro Machine Learning Systems team to lead a pivotal performance engineering group at the intersection of state of the art ML research and production-scale infrastructure. You'll build and manage a team focused on establishing EC2 as the definitive source for ML performance optimization across diverse workloads including LLMs, multimodal models, and next-generation AI applications. Your work will directly influence product management, marketing, and executive decision-making by delivering comprehensive performance data and best practices for AWS's accelerated computing platforms.

Responsibilities

• Lead the design, implementation, and delivery of foundational ML performance measurement infrastructure that operates as reliable CI/CD systems across diverse accelerator platforms
• Build and nurture a high-performing engineering team focused on establishing EC2's source for ML performance best-known-configurations
• Drive architectural decisions that influence future platform design by feeding insights from state-of-the-art research and customer workloads into accelerated platform launches
• Develop comprehensive regression coverage across all major component releases including frameworks, firmware, drivers, and networking components
• Establish mechanisms to scale performance engineering practices from current LLM focus to multimodal models, Mixture-of-Experts architectures, and emerging AI application domains

Qualifications

• 3+ years of engineering team management experience
• 7+ years of working directly within engineering teams experience
• 3+ years of designing or architecting (design patterns, reliability and scaling) of new and existing systems experience
• Knowledge of engineering practices and patterns for the full software/hardware/networks development life cycle, including coding standards, code reviews, source control management, build processes, testing, certification, and livesite operations
• Experience partnering with product or program management teams