Senior Deep Learning Compiler Engineer - XLA

About the role

NVIDIA is seeking versatile software engineers for its XLA team. The XLA team focuses on developing compiler optimization algorithms for deep learning workloads, optimizing inference and training performance for the JAX framework and the OpenXLA compiler on NVIDIA GPUs.

Responsibilities

• Craft and implement compiler optimization techniques for deep learning network graphs.
• Design novel graph partitioning and tensor sharding techniques for distributed training and inference.
• Perform performance tuning and analysis.
• Design user-facing features in JAX and related libraries.
• Contribute to general software engineering tasks.
• Collaborate with GPU hardware engineering teams to design AI compiler software features for next-generation GPUs.

Requirements

• Bachelor's, Master's, or PhD in Computer Science, Computer Engineering, or related field (or equivalent experience).
• 4+ years of relevant work or research experience in performance analysis and compiler optimizations.
• Ability to work independently, define project goals and scope, and lead your own development effort adopting clean software engineering and testing practices.
• Strong foundation in architecture of CPU, GPUs, or other high-performance hardware accelerators.
• Excellent C/C++ programming and software design skills, including debugging, performance analysis, and test design.
• Knowledge of high-performance computing and distributed programming.
• CUDA or OpenCL programming experience is desired but not required.
• Experience with the following technologies is a huge plus: XLA, TVM, MLIR, LLVM, OpenAI Triton, deep learning models and algorithms, and deep learning framework design.
• Strong interpersonal skills are required along with the ability to work in a dynamic product-oriented team.
• A history of mentoring junior engineers and interns is a bonus.

Qualifications

• Experience working with deep learning frameworks such as JAX, PyTorch, or TensorFlow.
• Extensive experience with CUDA or with GPUs in general.
• Experience with open-source compilers such as XLA, LLVM, MLIR, or TVM.

Skills

• Strong foundation in architecture of CPU, GPUs, or other high-performance hardware accelerators.
• Knowledge of high-performance computing and distributed programming.
• CUDA or OpenCL programming experience is desired but not required.
• Experience with the following technologies is a huge plus: XLA, TVM, MLIR, LLVM, OpenAI Triton, deep learning models and algorithms, and deep learning framework design.

Benefits

Competitive salaries and a generous benefits package are offered. Applications for this job will be accepted at least until March 1, 2026. This posting is for an existing vacancy. NVIDIA uses AI tools in its recruiting processes. NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law. #deeplearning