Deep Learning Software Engineer, Inference - New College Grad 2026

About the role

NVIDIA is seeking a Software Engineer specializing in Deep Learning Inference to join our growing team. The ideal candidate will contribute to the development and optimization of GPU-accelerated software that powers advanced AI applications.

Responsibilities

• Design, build, and optimize GPU-accelerated software for DL models in various domains like LLM, Multimodal and Generative AI.
• Scale performance of DL models across different architectures and types of NVIDIA accelerators.
• Contribute features and code to NVIDIA’s inference libraries, including vLLM and SGLang, FlashInfer and LLM software solutions.
• Work with cross-functional teams to develop innovative solutions for framework, NVIDIA libraries, and inference optimization.
• Identify and drive performance improvements for state-of-the-art LLM and Generative AI models across NVIDIA accelerators, from datacenter GPUs to edge SoCs.
• Implement and optimize model serving pipelines using open-source tools and plugins such as CUTLASS, OAI Triton, NCCL, and CUDA kernels.

Requirements

• Pursuing or recently completed a MS or PhD in Computer Engineering, Computer Science, EECS, AI or related field, or equivalent experience.
• Software development experience.
• Excellent C/C++ programming and software design skills.
• SW Agile skills are helpful, and Python experience is a plus.
• Prior experience with training, deploying, or optimizing the inference of DL models in production.
• Prior background with performance modeling, profiling, debugging, and code optimization, or architectural knowledge of CPU and GPU.
• GPU programming experience (CUDA, OAI TRITON, or CUTLASS).

Qualifications

• Experience with deep learning software projects, such as PyTorch, vLLM, and SGLang.
• Contributions to advancements in the field of deep learning.

Skills

• Open-source tools and plugins expertise (CUTLASS, OAI Triton, NCCL, CUDA kernels).
• Performance modeling, profiling, and code optimization skills.
• Multi-GPU communications (NCCL, NVSHMEM).

Benefits

NVIDIA offers competitive compensation, including a base salary range of $124,000 - $195,500 for Level 2 and $152,000 - $241,500 for Level 3, based on experience and location. Additional benefits include equity and comprehensive health insurance.

Pay

The base salary range is $124,000 - $195,500 for Level 2 and $152,000 - $241,500 for Level 3.

Schedule

Not specified.

Benefits

Comprehensive health insurance, retirement plans, and other benefits are offered.

Ways to Stand Out

Contribute to deep learning software projects, such as PyTorch, vLLM, and SGLang, to drive advancements in the field.

Equal Opportunity Employer

NVIDIA is committed to fostering an inclusive work environment and is proud to be an equal opportunity employer. We highly value diversity in our current and future employees.