Senior Software Engineer - Local AI

About the role

The Senior Systems Software Engineer will partner with NVIDIA software, research, architecture, and product teams to align strategies and technical needs for fostering the ecosystem of AI on RTX and DGX PCs. They will collaborate with industry partners to advance AI across critical domains including graphics, web browsers, and edge devices, driving innovation in both open and closed source technologies with a focus on system level support.

Responsibilities

• Partner with NVIDIA software, research, architecture, and product teams to align strategies and technical needs for fostering the ecosystem of AI on RTX and DGX PCs.
• Collaborate closely with industry partners to advance AI across critical domains including graphics, web browsers, and edge devices, by driving innovation in both open and closed source technologies with emphasis on system level support.
• Improving performance on current and next-generation GPU architectures by conducting in-depth analysis and end-to-end optimization of AI models, data processing pipelines, and inference runtime features.
• Identifying, evaluating, and implementing compute and memory optimization techniques such as quantization, distillation, and pruning for large AI models; fine-tuning and compressing models to fit edge devices.

Requirements

• Bachelor's, Master's, or PhD in Computer Science, Software Engineering, Mathematics, or a related field (or equivalent experience).
• Excellent C++ programming and debugging skills with a strong understanding of data structures and algorithms.
• 5+ years of experience with proficiency in AI inferencing pipelines and applications using ML/DL frameworks, including ONNX RT, PyTorch, Tensor RT, llama.cpp and vLLM.
• Strong analytical and problem-solving abilities, with the ability to multitask effectively in a dynamic environment.
• Outstanding written and oral communication skills enabling effective collaboration with management and engineering teams.

Qualifications

• Understanding modern techniques in Machine Learning, Deep Neural Networks, and Generative AI with relevant contributions to major open-source projects will be a plus.
• Consistent track record of delivering end-to-end products with geographically distributed teams in multinational product companies.
• Proficiency in lower-level system/GPU programming, CUDA, developing high-performance systems.
• Hands-on experience with building applications using APIs like ONNX RT, DirectX, PyTorch, TensorRT, Vulkan, llama.cpp.

Skills

• Understanding modern techniques in Machine Learning, Deep Neural Networks, and Generative AI with relevant contributions to major open-source projects.
• Hands-on experience with building applications using APIs like ONNX RT, DirectX, PyTorch, TensorRT, Vulkan, llama.cpp.

Benefits

NVIDIA offers a competitive salary and a generous benefits package. The base salary range for Level 3 is $152,000 - $241,500 and for Level 4 is $184,000 - $287,500. Additionally, employees are eligible for equity and benefits.

Pay

Base salary is determined based on location, experience, and the pay of employees in similar positions. The base salary range is $152,000 - $241,500 for Level 3 and $184,000 - $287,500 for Level 4.

Schedule

The Senior Systems Software Engineer will work full-time and be based in the United States.

Ways to stand out

• Understanding modern techniques in Machine Learning, Deep Neural Networks, and Generative AI with relevant contributions to major open-source projects.
• Consistent track record of delivering end-to-end products with geographically distributed teams in multinational product companies.
• Proficiency in lower-level system/GPU programming, CUDA, developing high-performance systems.
• Hands-on experience with building applications using APIs like ONNX RT, DirectX, PyTorch, TensorRT, Vulkan, llama.cpp.