Senior Software Engineer, CUTLASS Kernels

About the role

NVIDIA's high-performance computing platforms are powering the AI revolution across many applications and industries. Within our software stack, CUTLASS stands out as a popular open-source ecosystem dedicated to high-performance linear algebra and Tensor Core primitives.

Responsibilities

• Write Tensor Core-based deep learning kernels such as grouped-GEMM, attention, and convolution using CUTLASS CUDA C++ and Python DSL for Blackwell, Rubin, and future architectures.
• Optimize kernels for peak throughput on both silicon and software performance simulators.
• Collaborate with teams across NVIDIA including the GPU architecture, NVVM/PTX compiler, CUDA library, and DL frameworks teams to ensure fast, functional, and timely kernel delivery to customers.

Requirements

• Masters or PhD degree in Computer Science, Computer Engineering, or related field (or equivalent experience).
• 3+ years of relevant industry experience.
• Strong proficiency in C++ programming and software design, including debugging, performance evaluation, and testing.
• Experience with CUDA, OpenCL, HIP, SYCL, Mojo, Pallas, Triton, Mosaic, Halide, or any general-purpose or domain-specific programming language targeting highly parallel accelerators.
• Deep understanding of computer architecture and some experience working at the assembly level.

Qualifications

• Experience writing code specifically targeting NVIDIA Tensor Cores, particularly through PTX or CUDA/cuTile.
• Open-source contributions to math kernel libraries or frameworks.

Skills

• Strong C++ programming skills.
• Experience with CUDA and other parallel computing frameworks.
• Understanding of deep learning algorithms and their implementation.
• Knowledge of computer architecture and assembly language.

Benefits

• Competitive base salary ranging from $152,000 to $241,500 for Level 3, and $184,000 to $287,500 for Level 4.
• Equity and comprehensive benefits package.

Pay

• Base salary range: $152,000 - $241,500 for Level 3, and $184,000 - $287,500 for Level 4.

Schedule

• Full-time position.