Deep Learning Software Engineer, Inference - New College Grad 2026

About the role

NVIDIA is seeking a Software Engineer specializing in Deep Learning Inference to join a dynamic team focused on advancing the frontiers of AI. The ideal candidate will contribute to the development and optimization of GPU-accelerated software that powers cutting-edge AI applications.

Responsibilities

• Design, build, and optimize GPU-accelerated software for efficient large-scale model serving and inference.
• Contribute to the implementation of the latest algorithms for public release in inference frameworks.
• Work with cross-functional teams to develop and maintain NVIDIA’s inference libraries, including vLLM and SGLang.
• Implement and optimize model serving pipelines using open-source tools and plugins such as CUTLASS, OAI Triton, NCCL, and CUDA kernels.
• Identify and drive performance improvements for state-of-the-art Large Language Models (LLM) and Generative AI models across NVIDIA accelerators, from datacenter GPUs to edge SoCs.
• Perform performance modeling, profiling, debugging, and code optimization for CPU and GPU architectures.

Requirements

• Pursuing or recently completed a Master's or PhD in Computer Engineering, Computer Science, EECS, AI, or related field, or equivalent experience.
• Software development experience, including excellent C/C++ programming and software design skills.
• Experience with SW Agile methodologies is helpful, and Python experience is a plus.
• Experience with training, deploying, or optimizing the inference of DL models in production.
• Experience with performance modeling, profiling, debugging, and code optimization, or architectural knowledge of CPU and GPU systems.
• Experience with GPU programming, including CUDA, OAI Triton, and CUTLASS.

Qualifications

• Experience with deep learning software projects, such as PyTorch, vLLM, and SGLang.
• Background in Multi-GPU Communications (NCCL, NVSHMEM).

Benefits

NVIDIA offers competitive compensation, including a base salary range of $124,000 - $195,500 for Level 2 and $152,000 - $241,500 for Level 3, along with equity and comprehensive benefits.

Schedule

The position is available immediately.

Pay

The base salary range for this role is $124,000 - $195,500 for Level 2 and $152,000 - $241,500 for Level 3.

Application Instructions

Applications for this job will be accepted at least until July 26, 2026.