Senior MLOps Engineer, GenAI Framework

About the role

The successful candidate will play a crucial role in developing and maintaining the continuous integration pipelines and release processes for NVIDIA's GenAI Frameworks (Megatron-LM and NeMo Framework).

Responsibilities

• Develop and maintain the continuous integration pipelines and release processes of our Generative AI framework and libraries related to Megatron-LM and NeMo Framework.
• Implement efficient and scalable DevOps solutions to allow our fast-growing team to release software more frequently while maintaining high-quality and maximum performance.
• Work with industry-standard tools (Kubernetes, Docker, Slurm, Ansible, GitLab, GitHub Actions, Jenkins, Artifactory, Jira) in hybrid on-premise and cloud environments.
• Auxiliary with cluster operations and system administration (managing: servers, team accounts, clusters).
• Accelerate research and development cycles by automating recurring tasks such as accuracy and performance regression detection.
• Develop new quality control measures, e.g., code analysis, backwards compatibility, and regression testing, while employing and advancing best practices.
• Collaborate with DL frameworks and libraries (CUDA, cuDNN, cuBLAS, and PyTorch) teams and with other engineering teams within NVIDIA that provide software, testing, and release-related infrastructure.

Requirements

• BS or MS degree in Computer Science, Computer Architecture or related technical field (or equivalent experience) and 3+ years of industry experience in DevOps and infrastructure engineering.
• Strong system-level programming in languages like Python and shell scripting.
• Experience with build/release systems and CI/CD with solutions like Gitlab, Github, Jenkins etc.
• Experience with Linux system administration.
• Experience with containerization and cluster management technologies like Docker and Kubernetes.
• Experience in build tools, including Make, Cmake.
• Well-versed in source code management (SCM) solutions such as GitLab, GitHub, Perforce, etc.
• Proven track record with GPU-accelerated systems at scale.
• Expertise in cluster and cloud compute technologies, e.g.: SLURM, Lustre, k8s.
• Software and hardware benchmarking on high-performance computing systems.

Qualifications

• Excellent interpersonal and written communication skills.

Benefits

NVIDIA offers a competitive compensation package, including a base salary range of $152,000 - $241,500 USD, along with equity and benefits.

Schedule

This position is currently open and applications will be accepted until February 23, 2026.

Pay

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions.

Skills

Proven track record with GPU-accelerated systems at scale, expertise in DL frameworks such as PyTorch, Jax, or TensorFlow, and well-versed in cluster and cloud compute technologies, e.g.: SLURM, Lustre, k8s.

Benefits

Equity and benefits are offered to eligible candidates.