Senior Production Engineer - DGX Cloud
NVIDIA · Washington, United States · 1 wk ago
RemoteRemoteManagementFull-time
About the role
We are seeking a Senior Production Engineer to join our DGX Cloud team. This role involves scaling up NVIDIA's AI infrastructure and contributing to the development of leading infrastructure solutions for various AI applications.
Responsibilities
- Implementing monitoring and health management capabilities for large-scale GPU clusters to ensure industry-leading reliability, availability, and scalability.
- Working with teams across NVIDIA to maintain reliable and high-performance production AI clusters.
- Evaluating system failures and improving services through a defined incident management process.
- Developing custom software for GPU asset provisioning, configuration, and lifecycle management across cloud providers.
- Managing and automating large-scale distributed systems independently of cloud providers.
- Ensuring operational excellence in maintaining reliable and performant AI infrastructure.
Requirements
- Significant experience with site reliability principles and techniques, including reliability assessments, incident management processes, production system observability, monitoring and alerting, automated deployments, and toil elimination.
- Experience with Production Engineering/DevOps/SRE principles, tools, and techniques.
- BS in Computer Science, Engineering, Physics, Mathematics or a comparable degree or equivalent experience.
- Advanced hands-on experience and deep understanding of cluster management systems such as Kubernetes, Slurm, and Bright Cluster Manager.
- Technical knowledge including a systems programming language (e.g., Go, Python) and a solid understanding of data structures and algorithms.
Qualifications
- Direct experience in a Production Engineering/DevOps/SRE role within a highly technical organization with demonstrable impact from your work.
- Highly motivated with strong communication skills, able to work successfully with multi-functional teams, principles, and architects and coordinate effectively across organizational boundaries and geographies.
- 8+ years of experience in similar roles and experience on large-scale production systems.
Skills
- Strong technical competency in managing and automating large-scale distributed systems independent of cloud providers.
- Advanced hands-on experience and deep understanding of cluster management systems (Kubernetes, Slurm, Bright Cluster Manager).
- Proven operational excellence in maintaining reliable and performant AI infrastructure.
Benefits
- Competitive base salary ranging from $168,000 to $270,250 for Level 4 and from $208,000 to $333,500 for Level 5.
- Eligibility for equity and benefits.
Pay
- Base salary determined based on location, experience, and the pay of employees in similar positions.
Schedule
- Open until July 10, 2026.
Benefits
- NVIDIA is committed to fostering an inclusive work environment and is proud to be an equal opportunity employer.
- We highly value diversity in our current and future employees.