Jobs · Engineering · California

Senior AI Frameworks Engineer

Thomas To · Santa Clara, CA · 3 mo ago
EngineeringFull-time

About the role

NVIDIA's high-performance computing platforms are powering the AI revolution across many applications and industries. Within our software stack, CUTLASS stands out as a popular open-source ecosystem dedicated to high-performance math primitives. Since 2017, it has provided the community with C++ template abstractions to implement custom GEMM and related computations efficiently on NVIDIA GPUs. We are building the next frontier of this ecosystem: Pythonic CUTLASS (CUTLASS DSL). This initiative aims to bring "speed-of-light" performance and powerful abstractions of our stack directly into the Python environment. Join the CUTLASS team and help bridge the gap between low-level hardware primitives and high-level developer productivity. If you are passionate about building elegant, high-performance DSLs and want to empower the next generation of AI researchers and engineers with better tools, apply today!

What You'll Be Doing

As a core contributor to the CUTLASS project, you will use your expertise in systems programming and API design to create a world-class developer experience for GPU programming and kernel delivery.

  • Design APIs that prioritize user productivity, providing a "native" feel for developers accustomed to modern scientific computing and deep learning frameworks.
  • Develop robust compilation infrastructure—including AST transformations and JIT-friendly execution—to lower Pythonic descriptions into high-performance GPU machine code.
  • Optimize developer experience by creating debugging tools, profiler integrations, and validation methodologies that make writing and using kernels easy.
  • Build production-grade delivery infrastructure for the open-source community, managing everything from package distribution (wheels, conda) to the user-facing documentation and testing.

What We Need To See

  • MS or PhD degree in Computer Science, Electrical Engineering, or related field (or equivalent experience).
  • At least 3+ years of relevant experience.
  • Strong proficiency in Python and C++, specifically regarding the design of Python extensions and foreign function interfaces (FFI).
  • Experience in library or framework development, with a focus on creating intuitive APIs for complex technical systems.
  • Deep understanding of the Python ecosystem's delivery stack, including building, testing, and distributing high-performance compiled extensions.

Ways To Stand Out From The Crowd

  • Active maintainer status or significant contributions to high-performance open-source libraries, AI frameworks or compiler projects (LLVM/MLIR).
  • Understanding of compiler foundations, such as intermediate representations (IR), lowering passes, or AST manipulation.
  • Experience with GPU Architecture and parallel programming models (CUDA).

Pay

The base salary range is 152,000 USD - 241,500 USD for Level 3, and 184,000 USD - 287,500 USD for Level 4. You will also be eligible for equity and benefits.

Similar jobs

Senior AI Engineer

Acadian Asset ManagementBoston, MA· 1 mo ago
$175k–$225k/yrapply on app.greenhouse.io

Senior AI Engineer

MedicaHopkins, MN· 4 mo ago
Engineering$113k–$194k/yrapply on recruiting2.ultipro.com

Senior AI Engineer

Montefiore Health SystemBronx, NY· 6 mo ago
Engineering$184k–$230k/yrapply on montefiore.wd12.myworkdayjobs.com

Senior AI Engineer

Re:Build ManufacturingSeattle, WA· 4 mo ago
Engineering$144k–$216k/yrapply on grnh.se

Senior AI Engineer

Lockheed MartinOffutt Air Force Base, NE· 7 mo ago
Information Technologyapply on sjobs.brassring.com