Senior Math Libraries Engineer – AI and HPC

About the role

The NVIDIA Math Libraries team seeks a senior engineer to lead development efforts in kernel generation for AI and High Performance Computing (HPC), focusing on matrix operations, Just-In-Time (JIT) compilation, and fusion techniques.

Responsibilities

• Scoping, designing, and implementing high-quality and performance numerical dense linear algebra software on GPUs.
• Owning the execution of projects involving multiple engineers and sometimes teams.
• Providing technical leadership and feedback to library engineers working with you on projects and sometimes mentoring interns.
• Working closely with product management and other internal and external customers to understand feature and performance requirements and contribute to the technical roadmaps of libraries.
• Finding opportunities to improve library performance and reduce code maintenance overhead through re-architecting.
• Exercising leadership, coordinating with multiple teams to work towards goals, and finding complex solutions.

Requirements

• PhD, Master’s, or Bachelor's degree in Computer Science, Applied Math, or related science or engineering field of study (or equivalent experience).
• 8+ years of experience in designing, developing, testing, maintaining, and performance optimizing HPC software using C++.
• Strong fundamentals in kernel generation and composable library design for linear algebra.
• Leadership skills in driving software development projects.
• Strong collaboration, communication, and documentation habits.
• Experience with parallel programming, ideally using CUDA, MPI, OpenMP, OpenACC, pthreads.
• Good understanding of Machine Learning and Deep Learning technologies as well as knowledge of GPU (preferred) or CPU hardware architecture.
• Experience with low-level programming using assembly for performance optimization and operator fusion.
• Experience with agile software development practices using project management tools such as JIRA.
• A scripting language, preferably Python.

Qualifications

• Experience with parallel programming, ideally using CUDA, MPI, OpenMP, OpenACC, pthreads.
• Good understanding of Machine Learning and Deep Learning technologies as well as knowledge of GPU (preferred) or CPU hardware architecture.
• Experience with low-level programming using assembly for performance optimization and operator fusion.
• Experience with agile software development practices using project management tools such as JIRA.
• A scripting language, preferably Python.

Skills

• Kernel generation.
• JIT focus/experience desired.

Benefits

Competitive salary package and benefits. NVIDIA offers equity and benefits to eligible candidates.

Pay

Base salary range: $184,000 - $287,500 for Level 4, and $224,000 - $356,500 for Level 5.

Schedule

NVIDIA offers flexible scheduling options to accommodate the needs of our talented employees.

Benefits

• Health insurance
• Retirement plans
• Flexible spending accounts
• Telecommuting options
• Professional development programs
• Employee referral bonuses

Equal Opportunity Employer

We are committed to fostering a diverse work environment and proud to be an equal opportunity employer. We highly value diversity in our current and future employees.