SoC Platform Software Engineering Manager, Annapurna Labs Machine Learning Acceleration, AWS

About the role

The role is for an engineering manager who will oversee the platform software layer for AWS's custom Trainium and Inferentia ML accelerator chips. This includes managing a team of 6 engineers, setting technical direction, and ensuring the software is stateless, survives live-updates, and is correct down to individual register bits.

Responsibilities

• Manage, coach, and grow a team of 6 engineers — set technical direction, own hiring, and create an environment where strong engineers want to stay
• Own the platform abstraction layer that enables one C++ codebase to compile and run correctly across three target environments with fundamentally different runtime characteristics
• Shape the external API contracts that verification, emulation, and production teams build on — balancing stability for consumers against the need to evolve as new chip generations arrive
• Drive the architecture of our C++ template metaprogramming framework that generates type-safe register interfaces for every hardware block, and our BUTR (Built-in Unit Test for Registers) and HITL (Hardware-in-the-Loop) test infrastructure
• Build and maintain the CI/CD and validation strategy that catches integration issues across all three platforms before they reach customers
• Coordinate across chip architects, RTL designers, verification engineers, validation engineers, and platform software teams — you're the single point of accountability for HAL readiness on every new chip program
• Get into the weeds alongside your team — debug register-level HW/SW interactions, review code, and write code yourself when it matters

Requirements

• 3+ years of engineering team management experience
• 7+ years of professional software development in C or C++, including systems, platform, or infrastructure software
• 4+ years of designing or architecting software systems (platform abstractions, API design, multi-target build systems)
• Experience developing software that interfaces with hardware or runs across multiple execution environments
• Experience designing APIs or abstraction layers consumed by other engineering teams

Qualifications

• No ML background needed. Your platform software is the foundation that enables ML training across clusters of thousands of interconnected accelerators — you'll work on components like PCIe and HBM, but won't need to understand ML itself
• This role can be based in Cupertino, CA or Austin, TX

Benefits

• Comprehensive benefits including health insurance, 401(k) matching, paid time off, and parental leave

Pay

Base salary range: $212,700.00 - $287,700.00 USD annually for the Cupertino, CA location; $184,900.00 - $250,200.00 USD annually for the Austin, TX location

Schedule

Full-time