Jobs · Engineering · California

Senior Vision Language Model Engineer

NVIDIA · Santa Clara, CA · 1 wk ago
EngineeringFull-time

About the role

NVIDIA is seeking a senior vision language model engineer to design and build agentic data and training workflows for Autonomous Vehicles, Robotics, and Medical applications. The ideal candidate will bring technical innovation and a collaborative culture to enhance NVIDIA's dataset search platforms for physical AI developers.

Responsibilities

  • Partner with researchers to develop and evaluate prototypes of VLMs and VLAs for video search, video understanding, and other applications.
  • Enable fundamental advances in autonomous driving, healthcare, and robotics by designing and implementing agentic data workflows.
  • Build, curate, and maintain high-quality multimodal datasets tailored for end-to-end physical AI problems, such as autonomous driving.
  • Explore and productize new data sources including simulation and synthetic data.
  • Use agentic AI workflows across the full applied research lifecycle, from prototyping novel algorithms to integrating prototypes in production codebases.
  • Collaborate with research, model development, performance, and product teams to contribute to NVIDIA's core platforms and products.

Requirements

  • PhD with 4+ years, MS with 6+ years, or BS (or equivalent experience) with 8+ years of relevant experience in Computer Science, Computer Engineering, or a related technical field.
  • Strong background in modern deep learning, including transformer-based architectures, video modeling, and multimodal VLM/VLA or foundation models.
  • Excellent experience training and deploying deep learning models on real-world datasets, including data preprocessing, distributed training, evaluation, debugging, and iterative improvement.
  • Fluent with Python and at least one deep learning framework.
  • Current with the latest research on image and video search in autonomous vehicles, healthcare, robotics, or related physical AI applications.
  • Clear and effective communication skills, with experience working well in a dynamic, product- and research-focused team.

Qualifications

  • Strong track record publishing in top-tier conferences such as CVPR, NeurIPS, ICML, ECCV.
  • Patents in video retrieval or related fields.
  • Experience in large-scale software projects and contributions to open-source projects.
  • Experience with robotic systems such as autonomous vehicles or humanoid robotics.

Skills

  • Strong coding architecture skills.

Benefits

Base salary range: $184,000 - $287,500 for Level 4, and $224,000 - $356,500 for Level 5. Eligible for equity and benefits.

Pay

TBD

Schedule

TBD

Similar jobs