Sr Technical Program Manager, AWS Generative AI & ML Servers
About the role
AWS Infrastructure Services is seeking a Senior Technical Program Manager to drive end-to-end delivery of GPU-accelerated servers powering AI/ML workloads across our global fleet. You will facilitate requirements gathering with internal customers, coordinate cross-functional engineering teams spanning hardware and software disciplines, manage ODM partnerships across multiple continents, and establish closed-loop quality feedback systems connecting operational data to design improvements. This role requires technical depth to challenge engineering workstreams and translate technical constraints into program risk, combined with program management excellence to deliver complex hardware at global scale. You will maintain program schedules by identifying blockers early, escalate dependencies before they impact critical path, and ensure our AI/ML infrastructure meets reliability commitments through data-driven quality systems.
Responsibilities
- Requirements & Planning: Facilitate requirements gathering sessions with internal customers and stakeholders. Work with engineering teams to validate feasibility, identify dependencies, and establish clear success criteria. Build program timelines with milestone tracking, critical path analysis, and proactive risk assessment. Translate business objectives into program deliverables that engineering teams can execute against.
- Execution & Coordination: Drive cross-functional alignment across hardware, firmware, software, and operations teams to maintain development schedules. Manage ODM partnerships by tracking design reviews, manufacturing readiness gates, and quality checkpoints. Identify blockers early and escalate dependencies before they impact critical path. Facilitate decision-making when teams are stuck on technical trade-offs. Communicate program status to stakeholders with clear visibility into progress against milestones.
- Risk & Issue Management: Identify program risks by challenging technical workstreams and connecting technical constraints to schedule impact. Escalate risks proactively with quantified business impact and proposed mitigation plans. Lead root cause analysis of fleet-wide hardware failures, driving engineering teams to implement corrective actions that improve operational metrics. Establish feedback loops connecting operational telemetry back to validation criteria for future designs.
- Quality & Deployment: Define acceptance criteria and coordinate qualification testing across teams. Manage deployment readiness by tracking open issues, validating documentation completeness, and ensuring operations teams are prepared for production handoff. Facilitate go/no-go decisions with clear risk posture and mitigation status for mission-critical AI/ML workloads.
- Transition & Closure: Conduct knowledge transfer sessions with receiving teams. Document lessons learned with actionable recommendations that improve future program execution. Ensure all program artifacts are complete and accessible.
A day in the life
Your day-to-day responsibilities will include interfacing with internal and external customers to understand project requirements and facilitate system development on GPU-accelerated server platforms. You will analyze operational challenges across the existing fleet with the goal of improving current customer experience and implementing design improvements for future generations. You will work directly with ODM partners to coordinate development activities, manage vendor relationships, and drive manufacturing readiness at scale. As the end-to-end owner of complex server platforms, you will lead root cause analysis of fleet issues and implement closed-loop corrective actions that drive improvements back into development processes and design specifications.
About the team
The Ultra Server Hardware Engineering team is a group of engineers and technical program managers directly responsible for launching GPU-accelerated servers into the AWS fleet. Located in Seattle and Cupertino, we collaborate with global development teams and ODM partners to deliver next-generation AI/ML infrastructure deployed in datacenters worldwide. Our team members bring diverse technical backgrounds but share a common commitment to Bias for Action and strong Ownership. We operate with a startup mentality, delivering fully functional solutions that power AWS's most demanding AI/ML workloads.
Basic qualifications
- 5+ years of technical product or program management experience
- 7+ years of working directly with engineering teams experience
- Experience managing programs across cross functional teams, building processes and coordinating release schedules
- Experience leading engineering design projects and interacting with cross-functional teams
Preferred qualifications
- 8+ years of project management disciplines including scope, schedule, budget, quality, along with risk and critical path management experience
- Knowledge of the electrical and mechanical systems involved in critical data center operations including systems such as feeders, transformers, generators, switchgear, UPS systems, ATS units, PDU units, chillers, pumps, air handling units, and CRAC units
- Experience in machine learning, data mining, information retrieval, statistics or natural language processing, or experience in developing and deploying LLMs in production on GPUs, Neuron, TPU or other AI acceleration hardware
- Experience developing and driving projects with tight schedules and multiple dependencies
- Experience using data and metrics to drive improvements
- Experience coordinating programs with ODM partners across multiple geographies, managing design reviews, manufacturing readiness gates, and quality checkpoints
- Ability communicating program status to executive stakeholders by connecting technical constraints to business impact
Pay
- USA, CA, Cupertino: $171,000.00 - $231,400.00 USD annually
- USA, WA, Seattle: $148,700.00 - $201,200.00 USD annually
Benefits
- Sign-on payments and restricted stock units (RSUs)
- Health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans)
- Employee Assistance Program (EAP), Mental Health Support, Medical Advice Line
- Flexible Spending Accounts
- Adoption and Surrogacy Reimbursement coverage
- 401(k) matching
- Paid time off and parental leave