Senior Performance Compiler Engineer - Triton

About the role

The Senior Performance Compiler Engineer will work on the open-source Triton compiler project, focusing on improving AI performance on NVIDIA GPUs. This role involves working with new technologies and compilers to optimize high-level kernel descriptions, enabling breakthroughs in AI applications.

Responsibilities

• Investigating the latest and future NVIDIA GPU hardware architecture and programming models.
• Working on the frontier of AI by understanding advanced algorithms and numerics to identify new opportunities for optimization.
• Designing and implementing compiler technology using MLIR to optimize high-level kernel descriptions, with a focus on generating efficient, low-level GPU code.
• Engaging in a dynamic, iterative process of optimization, sometimes starting with the kernel, sometimes with the compiler, to find the most efficient path to peak performance.
• Collaborating with teams across NVIDIA, including hardware architects and the CUDA compiler team, to influence future products and ensure maximum efficiency.

Requirements

• Bachelor, Masters or Ph.D. degree or equivalent experience in Computer Science, Computer Engineering, Applied Math, or a related field.
• 8+ years of relevant industry experience in software development.
• Demonstrated strong C++ programming and software design skills, with an emphasis on performance analysis and debugging.
• Experienced in parallel programming, including CUDA/OpenCL GPU programming or other parallel models such as OpenMP.
• Solid understanding of computer architecture and hands-on experience with assembly-level programming.

Qualifications

• Experience in tuning BLAS or deep learning library kernels.
• Background in numerics and linear algebra.
• Experience with machine learning compilers like TVM or MLIR.
• Contributions to open-source projects, especially in the AI/ML or compiler space.
• Familiarity with the latest research in AI algorithms and numerics and a strong track record of contributions to open-source projects, particularly in the AI/ML, compiler, or high-performance computing domains.

Benefits

Competitive salaries and a generous benefits package are offered. NVIDIA is widely considered one of the technology world’s most desirable employers, with a diverse and supportive environment where everyone is inspired to do their best work.

Pay

Base salary range: $184,000 - $287,500 USD.

Schedule

Not specified.

Skills

• Strong C++ programming and software design skills.
• Experience with parallel programming, including CUDA/OpenCL GPU programming or other parallel models such as OpenMP.
• Solid understanding of computer architecture and hands-on experience with assembly-level programming.
• Experience with machine learning compilers like TVM or MLIR.
• Contributions to open-source projects, especially in the AI/ML or compiler space.
• Familiarity with the latest research in AI algorithms and numerics.

Benefits

• Not specified.