Cloud Hardware Dev Engineer (AWS Generative AI & ML Servers), AWS Generative AI & ML Servers
About the role
Do you want to build the backbone of Generative AI cloud at AWS? Do you want to build the future of the cloud for AI training and inference? Want to do industry leading work delivering continuous price performance improvements in the cloud for AI model training for multi billion variable LLMs? Come Join us in designing, delivering and operating AWS cloud offerings that enable high performance and scalability in AI/ML and HPC workloads.
Key job responsibilities
- Partner with EC2 to define server architectures based on workload demand and customer requirements
- Translate architectures into detailed supporting designs and component specifications that enable high-performance AI training and inference at scale
- Define and drive validation strategies from PCBA bring-up through server and rack integration, ensuring designs meet performance, thermal, mechanical, power, and signal integrity requirements
- Work with interdisciplinary teams of component, firmware, test, qualification, and integration engineers to lead design and manufacturing partners through development and production
- Triage hardware issues at both ODM facilities and datacenters, conducting root cause analysis, and implementing corrective actions
- Oversee the fleet of servers you develop after launch, monitoring quality metrics and ensuring they meet customer requirements while identifying opportunities for continuous improvement
A day in the life
Your day to day responsibilities will include interfacing with internal customers to understand project requirements and facilitate system development. You will work directly with EC2 teams to align on architecture decisions and translate workload requirements into technical specifications. You will be responsible for learning operational challenges in the existing fleet with the goal of improving customer experience and developing improved systems for future designs. You will work directly with vendors and ODM/JDM design teams to develop and manufacture your product at scale, driving design reviews, resolving technical issues, and ensuring quality throughout the development lifecycle.
About the team
The team comprises both Hardware Design Engineers, System Design Engineers, Software Development Engineers and Technical Program Managers, all with the common goal of delivering the best Accelerated Server fleet possible to our customers.
Why AWS
Amazon Web Services (AWS) is the world's most comprehensive and broadly adopted cloud platform. We pioneered cloud computing and never stopped innovating — that's why customers from the most successful startups to Global 500 companies trust our robust suite of products and services to power their businesses.
Basic qualifications
- 7+ years of equivalent experience
- Experience in developing functional specifications, design verification plans and functional test procedures
- Experience in server technologies such as thermal, mechanical, power, and signal integrity
- Bachelor's degree or above in electrical engineering, computer engineering, or equivalent
- 5+ years of Design/Innovation, research & development, manufacturing, process, industrial engineering, or related experience
- Experience leading process improvement, systems development, and project management
- Experience in English-language communication skills, both written and verbal
- In depth expertise in one or more server technologies such as Thermal / Mechanical design, high speed bus design and signal integrity, failure analysis, server components (e.g. CPU, GPU, SSDs, memory), BIOS, BMC, and networking
Preferred qualifications
- Experience working with technical and product stakeholders to define requirements, prioritize features, and influence product roadmaps
- Experience leading engineering teams as a mentor or tech lead, or experience with general troubleshooting/debugging of hardware
- 7+ years of new hardware product development experience, e.g. server, storage, networking, or large-scale distributed systems experience
- In-depth expertise in one or more server technologies: thermal/mechanical design, high-speed bus design and signal integrity, failure analysis, server components (CPU, GPU, SSDs, memory), BIOS, BMC, and networking
- Experience developing and executing test procedures for mechanical or electrical systems/components
- Experience working with ODMs/manufacturer through the product development and manufacturing lifecycle
- Experience building predictive failure detection or proactive remediation systems at fleet scale
- Experience with storage/compute/GPU/accelerator platforms including integration, diagnostics, or performance validation
- Familiarity with PCIe topology, NVLink, NVMe, and accelerator interconnects
- Experience with large-scale datacenter or cloud environments
Pay
- USA, CA, Cupertino: $183,000.00 - $247,600.00 USD annually
- USA, WA, Seattle: $159,200.00 - $215,300.00 USD annually
Benefits
- Health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans)
- EAP, Mental Health Support, Medical Advice Line
- Flexible Spending Accounts
- Adoption and Surrogacy Reimbursement coverage
- 401(k) matching
- Paid time off
- Parental leave
- Sign-on payments
- Restricted stock units (RSUs)