Senior Software Engineer, CUTLASS Platform

About the role

NVIDIA is seeking a skilled developer to join the CUTLASS team. The ideal candidate will contribute to the development of high-performance linear algebra and Tensor Core primitives using CUDA C++ and CUTLASS Python DSL.

Responsibilities

• Develop core components of the CUTLASS platform including Tensor Core MMAs, copies, synchronization barriers, schedulers, and other GPU hardware features in CUDA C++ and CUTLASS Python DSL.
• Contribute to the advancement of the MLIR-based backend compiler stack for the CUTLASS Python DSL by designing dialects and associated compiler passes.
• Author example kernels utilizing CUTLASS abstractions to showcase the use of novel GPU hardware features that are crucial for achieving high performance.
• Collaborate with GPU architecture, CUDA, and NVVM/PTX compiler teams to provide feedback on programming models and to assess the performance of future GPU hardware features.

Requirements

• Masters or PhD degree in Computer Science, Computer Engineering, or related field (or equivalent experience).
• 3+ years of relevant industry experience.
• Strong proficiency in C++ programming and software design, including debugging, performance evaluation, and testing.
• Experience working with high-performance code generation and knowledge of compiler transformations and optimizations.
• A deep understanding of computer architecture and parallel computing programming models.

Qualifications

• Experience writing high-performance kernels at low levels of abstractions like NVVM/ PTX for GPUs or other similar parallel processing architectures.
• Hands-on compiler design experience, particularly in MLIR.
• Understanding of deep learning models, algorithms, and frameworks.

Skills

• Deep understanding of computer architecture and parallel computing programming models.

Benefits

• NVIDIA is widely considered to be one of the technology world’s most desirable employers.
• The company offers equity and benefits to its employees.

Pay

• Base salary range: $152,000 - $241,500 for Level 3, and $184,000 - $287,500 for Level 4.

Schedule

• Applications for this job will be accepted at least until June 5, 2026.