Senior Software Engineer, SRE and Production Engineering - DGX Cloud

About the role

NVIDIA DGX Cloud builds and operates large-scale GPU infrastructure for AI workloads. The team creates software and operational tooling that moves GPU capacity from installed hardware to production service supporting an IaaS environment of BMaaS and VMaaS.

Responsibilities

• Build automation for bare-metal provisioning, hardware validation, firmware and software upgrades, repair, and cluster lifecycle management.
• Develop tools that interact with BMC and Redfish interfaces to monitor hardware health, manage server state, and assist recovery workflows.
• Handle and advance NVIDIA NVL72 systems and BlueField-3 or later DPUs throughout cloud partner and on-premises environments.
• Diagnose failures across servers, DPUs, GPU systems, CPU systems, networking, Linux, and Kubernetes; turn recurring issues into automated detection and repair.
• Define validation and handoff criteria so new capacity enters production safely and consistently.
• Take part in on-call duties, incident response, root-cause analysis, and follow-up to implement permanent solutions.
• Work with hardware, networking, platform, data center operations, and partner teams to resolve issues across ownership boundaries.

Requirements

• 8+ years building software for or operating production infrastructure, including substantial hands‑on bare‑metal experience.
• Strong Go or Python skills, with a record of delivering production automation and services.
• Direct experience with BMC and Redfish in server provisioning, health inspection, power management, or fault diagnosis.
• Practical experience working directly with NVIDIA GPU hardware, such as NVL72 systems, and BlueField‑3 or newer DPUs.
• Experience with Linux, firmware and driver management, network boot, and the server lifecycle from initial provisioning through repair.
• Experience managing production reliability through on‑call duties, incident response, observability, and durable solutions.
• Ability to debug failures across hardware, host operating systems, networking, and distributed services.
• Clear communication and demonstrated ownership of problems that span multiple teams.
• BS/MS in Computer Science or equivalent practical experience.

Skills

• Experience operating BlueField DPUs in DPU mode, including host‑to‑DPU connectivity and lifecycle debugging.
• Background with NVLink, InfiniBand, Spectrum‑X, or GPU cluster performance validation.
• Experience building safe, repeatable workflows for rack‑scale bringup, firmware upgrades, hardware replacement, and customer handoff.
• Experience with Kubernetes, GitOps, Argo CD, SLOs, and fleet‑wide automation.

Benefits

Eligible for equity and benefits.

Pay

Base salary range: 184,000 USD – 287,500 USD (determined by location, experience, and market).