Jobs · Engineering · New York

Senior Math Libraries Engineer - Dense Linear Algebra

NVIDIA · New York, United States · 2 mo ago
HybridEngineeringFull-time

About the role

We are looking for software engineers to join our development efforts in the area of dense linear algebra kernels for high-performance libraries such as cuSOLVER. Leading commercial and academic organizations worldwide are revolutionizing AI, data analytics, and scientific and engineering simulations using data centers powered by GPUs and high-performance linear algebra libraries. Applications of these technologies include computer-aided engineering (CAE), electronic design automation (EDA), quantum chemistry, autonomous vehicles, LLMs, computer vision, encryption, and many others. Our team develops the GPU-accelerated libraries and SDKs that make these advancements possible.

In this role, you will collaborate with other developers to design, develop, and optimize kernels for algorithms including triangular factorizations, eigenvalue decompositions, and singular value decompositions. Ideal candidates will have experience developing accelerated computing kernels and a passion for advancing the state-of-the-art in accelerated computing domains.

Responsibilities

  • Design, implement, and optimize scalable high-performance numerical dense linear algebra software on GPUs.
  • Provide technical leadership and guidance to library engineers, QA engineers, and interns on projects.
  • Work closely with product management and internal/external partners to understand feature and performance requirements and contribute to technical roadmaps.
  • Identify and realize opportunities to improve library quality, performance, and maintainability through re-architecting and innovative software development practices.

Requirements

  • PhD or MSc degree in Computational Science and Engineering, Computer Science, Applied Mathematics, or a related science or engineering field (or equivalent experience).
  • 5+ years of experience developing, debugging, and optimizing high-performance numerical linear algebra software using C++ and parallel programming (e.g., CUDA, MPI, OpenMP, OpenACC, pthreads).
  • Strong fundamentals in numerical methods such as computational linear algebra, linear system solvers, and methods for eigenvalue, singular value, and other decompositions.
  • Experience developing dense linear algebra libraries such as BLAS, LAPACK, and their parallel counterparts like PBLAS and SCALAPACK.
  • Strong collaboration, communication, and documentation habits.

Skills

  • Good knowledge of CPU and/or GPU hardware architecture.
  • Experience with CI/CD systems and project management tools such as JIRA.
  • Experience working in a globally distributed organization.
  • Strong background in large-scale computing technologies such as PDE solvers, eigenvalue solvers, and time-domain simulation methods (e.g., CFD, FEA).

Pay

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is:

  • 184,000 USD - 287,500 USD for Level 4.
  • 224,000 USD - 356,500 USD for Level 5.

You will also be eligible for equity and benefits.

Similar jobs