Jobs · Engineering

Senior Context Fusion AI Engineer - Autonomous Vehicles

NVIDIA · Nevada, United States · 2 wk ago
RemoteRemoteEngineeringFull-time

About the role

We are looking for a strong engineer to join the DRIVE Road Structure / Online Mapping / Context Fusion team. In this role, you will help craft and guide the future of our L3/L4 autonomous-driving solution by building a complete, learned 3D/4D world model that fuses navigation, ego-motion, perception, and sensor signals. You will work closely with perception, prediction, planning, and simulation teams to deliver a world representation that is complete, temporally consistent, uncertainty-aware, and robust enough to drive through the most challenging roads and intersections in L3/L4 autonomy level. This role is central to our vision for AV: developing a shared multimodal scene representation that can jointly support road understanding, 3D object and occupancy perception, motion prediction, and route-conditioned planning. Are you interested in inventing human-level AI for navigation in the unconstrained world under any conditions? If so, join us!

Responsibilities

  • Design and develop learning-based, multimodal sensor-fusion systems that transform synchronized sensor history, ego-motion, navigation context, and driving context into a unified spatiotemporal world representation.
  • Build architectures that jointly reason over camera, LiDAR, radar, and vehicle-state inputs, with appropriate handling of calibration, synchronization, coordinate transforms, sensor latency, and uncertainty.
  • Develop end-to-end and multi-task models that produce driving-relevant outputs from a shared scene representation, including; road graph elements such as lanes, boundaries, crosswalks, and traffic controls; semantic scene understanding; occupancy and free-space representations, including uncertain and occluded regions;
  • Develop scalable multimodal fusion architectures, including Transformer-based early, late, and hierarchical fusion; BEV, point/voxel, and image-based representations; temporal context aggregation; and cross-modal attention.
  • Create training, fine-tuning, and evaluation pipelines for large-scale multimodal datasets. Define multi-task objectives and metrics that balance perception quality, geometric consistency, prediction accuracy, latency, and safety-critical behavior.
  • Investigate foundation-model approaches for autonomous driving, including vision-language models, multimodal pre-training, representation learning, and efficient deployment of learned world models.
  • Work closely with perception, mapping, prediction, planning, simulation, data, and embedded-software teams to convert research advances into robust, production-quality AV systems.
  • Develop systematic analysis and debugging tools for model failures, cross-sensor disagreement, long-tail scenarios, distribution shift, and regressions in closed-loop simulation and on-road evaluation.

Similar jobs