Senior Software Engineer, CUTLASS Kernels

About the role

NVIDIA's high-performance computing platforms are powering the AI revolution across many applications and industries. Within our software stack, CUTLASS stands out as a popular open-source ecosystem dedicated to high-performance linear algebra and Tensor Core primitives.

Responsibilities

• Write Tensor Core-based deep learning kernels such as grouped-GEMM, attention, and convolution using CUTLASS CUDA C++ and Python DSL for Blackwell, Rubin, and future architectures.
• Optimize kernels for peak throughput on both silicon and software performance simulators.
• Collaborate with teams across NVIDIA including the GPU architecture, NVVM/PTX compiler, CUDA library, and DL frameworks teams to ensure fast, functional, and timely kernel delivery to customers.

Requirements

• Masters or PhD degree in Computer Science, Computer Engineering, or related field (or equivalent experience).
• 3+ years of relevant industry experience.
• Strong proficiency in C++ programming and software design, including debugging, performance evaluation, and testing.
• Experience with CUDA, OpenCL, HIP, SYCL, Mojo, Pallas, Triton, Mosaic, Halide, or any general-purpose or domain-specific programming language targeting highly parallel accelerators.
• Deep understanding of computer architecture and some experience working at the assembly level.

Qualifications

• Experience writing code specifically targeting NVIDIA Tensor Cores, particularly through PTX or CUDA/cuTile.
• Open-source contributions to math kernel libraries or frameworks.

Skills

• Experience with CUDA, OpenCL, HIP, SYCL, Mojo, Pallas, Triton, Mosaic, Halide, or any general-purpose or domain-specific programming language targeting highly parallel accelerators.
• Deep understanding of computer architecture and some experience working at the assembly level.

Benefits

• Your base salary will be determined based on your location, experience, and the pay of employees in similar positions.
• The base salary range is 152,000 USD - 241,500 USD for Level 3, and 184,000 USD - 287,500 USD for Level 4.
• You will also be eligible for equity and benefits.

Pay

• Your base salary will be determined based on your location, experience, and the pay of employees in similar positions.
• The base salary range is 152,000 USD - 241,500 USD for Level 3, and 184,000 USD - 287,500 USD for Level 4.

Schedule

• Not specified.