Senior AI Infrastructure Engineer - DGX Cloud

About the role

This engineering role will design, build and maintain large-scale production systems with high efficiency and availability using a combination of software and systems engineering practices. This role demands knowledge across different systems, networking, coding, databases, capacity management, continuous delivery and deployment, and open-source cloud-enabling technologies like Kubernetes and OpenStack.

Responsibilities

• Design, build, deploy, and run internal tooling for large-scale AI training and inferencing platform built on top of cloud infrastructure.
• Conduct in-depth performance characterization and analysis on large multi-GPU and multi-node clusters.
• Engage in and improve the whole lifecycle of services—from inception and design through deployment, operation, and refinement.
• Support services before they become available through activities such as system design consulting, developing software tools, platforms, and frameworks, capacity management, and launch reviews.
• Maintain services once they are live by measuring and monitoring availability, latency, and overall system health.
• Scale systems sustainably through mechanisms like automation, and evolve systems by pushing for changes that improve reliability and velocity.
• Practice sustainable incident response and blameless postmortems.
• Be part of an on-call rotation to support production systems.

Requirements

• BS degree in Computer Science or a related technical field involving coding (e.g., physics or mathematics), or equivalent experience.
• 5+ years of experience.
• A track record showing a good balance between initiating your own projects, convincing others to collaborate with you, and collaborating well on projects initiated by others.
• Background in infrastructure automation and distributed systems architecture focused on building tools to manage large-scale private or public cloud platforms in production.
• Experience working with one or more of the following languages: Python, Go, C/C++, Java.
• Comprehensive understanding in one or more of Linux, Networking, Storage, and Containers Technologies.
• Experience with Public Cloud and Infrastructure as a Code (IAAC) and Terraform.
• Distributed system experience.

Qualifications

• Interest in crafting, analyzing, and fixing large-scale distributed systems.
• Systematic problem-solving approach, coupled with strong communication skills and a sense of ownership and drive.
• Capability to identify issues and improve code performance while automating routine tasks.
• Experience in operating or handling large private and public cloud systems based on Kubernetes or Slurm.

Skills

• Knowledge of AI and machine learning concepts.
• Experience with AI infrastructure and cloud platforms.
• Experience with AI model training and inference.
• Experience with AI model optimization techniques.

Benefits

NVIDIA is widely considered to be one of the technology world’s most desirable employers. We have some of the most forward-thinking and hard-working people in the world working for us. If you're creative and self-motivated, we want to hear from you!

Pay

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 152,000 USD - 241,500 USD for Level 3, and 184,000 USD - 287,500 USD for Level 4.

Schedule

You will also be eligible for equity and benefits.

Application Instructions

Applications for this job will be accepted at least until July 13, 2026. This posting is for an existing vacancy.