Senior AI Infrastructure Software Engineer - DGX Cloud

About the role

Joining NVIDIA's DGX Cloud Lepton Team means contributing to the leading cloud product that powers innovative AI research and developers. The team builds the AI/ML platform to improve productivity, efficiency, and resiliency of AI workloads, and develops scalable AI infrastructure services globally. As a senior DGX Cloud AI Infrastructure software engineer, you will design, build, and maintain AI platforms that enable large‑scale AI training, inferencing, fine‑tuning, and Agentic AI in production, working in a culture of blameless postmortems, iterative improvement, and risk‑taking.

Responsibilities

• Develop platform and tools for large‑scale AI, LLM, and GenAI infrastructure.
• Develop and optimize tools to improve AI/ML workload efficiency and resiliency.
• Root‑cause, analyze, and triage failures from the application level to the hardware level.
• Enhance infrastructure and products underpinning NVIDIA's AI platforms.
• Co‑design and implement APIs for integration with NVIDIA's resiliency stacks on the platform.
• Define meaningful and actionable reliability metrics to track and improve system and service reliability.
• Apply strong problem‑solving, root‑cause analysis, and optimization skills.

Requirements

• Minimum 8+ years of experience developing software infrastructure for large‑scale AI systems.
• Bachelor's degree or higher in Computer Science or a related technical field, or equivalent experience.
• Strong debugging skills and experience analyzing and triaging AI applications from the application level to the hardware level.
• Proven track record in building and scaling large‑scale distributed systems.
• Experience with AI training, inferencing, and data infrastructure services.
• Familiarity with Kubernetes and operating large‑scale observability platforms (e.g., ELK, Prometheus, Loki).
• Proficiency in Golang, Python, C/C++, and scripting languages.
• Excellent communication and collaboration skills, with a commitment to diversity, intellectual curiosity, problem solving, and openness.

Preferred qualifications

• Experience with large‑scale AI clusters and cloud‑native infrastructure.
• Strong understanding of NVIDIA GPUs, network technologies (RDMA, IB, NCCL).
• Good understanding of deep‑learning frameworks such as PyTorch, TensorFlow, JAX, Dynamo, and Ray.
• Experience with root‑cause analysis of failures at datacenter scale.
• Strong background in software design and development.

Pay

Base salary range: $184,000 – $287,500 USD for Level 4; $224,000 – $356,500 USD for Level 5. Salary is determined based on location, experience, and comparable employee pay.

Benefits

Eligibility for equity and a comprehensive benefits package.