Jobs · Engineering · California

Senior Software Engineer, Real-Time AI and Rendering - Holoscan SDK

NVIDIA · Santa Clara, CA · 1 mo ago
EngineeringFull-time

About the role

The Holoscan Platform is NVIDIA's open-source framework for sensor AI, enabling developers to build, optimize, and deploy GPU-accelerated pipelines for real-time processing of multimodal sensor data. This role will architect the next generation of the Holoscan SDK, focusing on real-time sensor, imaging, and multimodal data processing, while balancing developer usability with peak GPU performance.

Responsibilities

  • Arcitect the next generation of Holoscan SDK by developing intuitive, scalable APIs for real-time sensor, imaging, and multimodal data processing—balancing developer usability with peak GPU performance.
  • Prototype GPU-accelerated algorithms for computer vision, imaging, sensor fusion, and low-latency rendering-translating research into production-grade software.
  • Build and optimize core GPU libraries for accelerated I/O, streaming, decoding, and visualization, employing CUDA, Vulkan, and GPU-resident data paths.
  • Contribute to real-time visualization frameworks for medical, robotic, or industrial applications-integrating Vulkan, OpenGL, or Omniverse/RTX-based rendering back-ends.
  • Benchmark performance rigorously, profiling and optimizing across the full pipeline (Sensor → AI → Render → Display, Sensor → AI → Robotic Control).
  • Create real-time "AI-powered virtual sensors" that behave like real hardware—enabling development and testing long before physical sensors exist.
  • Prototype and optimize neural field (NeRF/SDF/Gaussian) operators for real-time scene reconstruction, view synthesis, and 3D perception—directly within Holoscan’s streaming architecture.
  • Integrate and optimize vision-language and multimodal foundation models for real-time, GPU-resident sensor pipelines.

Requirements

A strong communicator and collaborator able to work across multiple domains—from AI and compute to graphics and visualization. Dynamic programming expertise in C++ (modern standards), plus proven Python skills for prototyping and tooling. Deep passion for real-time AI, computer vision, and sensor-driven systems-plus a passion for high-performance visualization and rendering. Familiarity with multimodal or vision-language models and an understanding of how to adapt them to streaming or real-time workloads is a strong plus. Success designing APIs and frameworks that stand the test of scale and that developers love to use!

Qualifications

  • Experience adapting VLMs or multimodal foundation models to real-time sensor or video pipelines.
  • Background integrating real-time GPU-accelerated processing and visualization pipelines (e.g., CUDA ↔ Vulkan interop).
  • Hands-on expertise with CUDA C/C++ and deep knowledge of GPU architecture and parallel programming paradigms.
  • Knowledge of Omniverse Kit, or other GPU rendering frameworks for real-time visualization.
  • Acute understanding of low-latency streaming pipelines for multimodal sensor fusion.

Skills

  • Strong communicator and collaborator.
  • Dynamic programming expertise in C++ (modern standards).
  • Proven Python skills for prototyping and tooling.
  • Deep passion for real-time AI, computer vision, and sensor-driven systems.
  • Familiarity with multimodal or vision-language models.
  • Experience adapting VLMs or multimodal foundation models to real-time sensor or video pipelines.
  • Background integrating real-time GPU-accelerated processing and visualization pipelines.
  • Hands-on expertise with CUDA C/C++.
  • Knowledge of Omniverse Kit, or other GPU rendering frameworks for real-time visualization.
  • Acute understanding of low-latency streaming pipelines for multimodal sensor fusion.

Benefits

Base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 184,000 USD - 287,500 USD for Level 4, and 224,000 USD - 356,500 USD for Level 5. You will also be eligible for equity and benefits.

Pay

Base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 184,000 USD - 287,500 USD for Level 4, and 224,000 USD - 356,500 USD for Level 5.

Schedule

Not specified.

Application Instructions

Applications for this job will be accepted at least until May 18, 2026.

Similar jobs