Jobs · Engineering · California

Senior Research Engineer, Computer Vision (LFV/WFM)

Toyota Research Institute · Los Altos, CA · 1 mo ago
HybridEngineering$180k–$259k/yrFull-time

Responsibilities

  • Collaborate directly with research scientists to implement, iterate on, and evaluate new architectures, objectives, datasets, and training strategies.
  • Translate research prototypes into clean, maintainable, reusable code that will be shared across multiple TRI teams and the broader Toyota ecosystem.
  • Build and maintain scalable pipelines for ingesting, converting, validating, and serving heterogeneous datasets (multi-view, multi-modal, multi-embodiment, etc.), across robotics and autonomous driving, into unified training-ready formats.
  • Track and integrate new public and internal datasets as they become available.
  • Support and optimize large-scale distributed training of world foundation models on multi-GPU and multi-node clusters.
  • Manage experiment workflows, profiling, debugging, and hyperparameter sweeps to ensure optimal performance in a timely manner.
  • Develop tools for dataset inspection, experiment tracking, model evaluation, GPU resource management, and visualization.
  • Automate repetitive workflows to improve team velocity.
  • Work with other TRI teams and Toyota affiliates to set up shared pipelines, onboard their data, and support joint training and evaluation efforts.

Qualifications

  • Master’s or PhD in Computer Science, Electrical Engineering, Machine Learning, or a related field, with a minimum of 3 years of relevant experience and strong software engineering skills.
  • Deep proficiency in Python, PyTorch, and the Unix/Linux toolchain.
  • Comfort working in terminal-heavy, SSH-based workflows on shared GPU clusters.
  • Hands-on experience with large-scale deep learning training, including distributed training (DDP, FSDP, DeepSpeed, or similar), GPU profiling, and debugging training failures at scale.
  • Experience building data pipelines for heterogeneous or multi-modal datasets (images, video, depth, point clouds, actions, etc).
  • Experience with video diffusion models, 3D/4D reconstruction, and multi-view geometry.

Bonus Qualifications

  • Experience with cloud training infrastructure (AWS SageMaker, EC2) and containerized workflows (Docker, Kubernetes).
  • Familiarity with standard data formats and collection pipelines (ROS, MCAP, HDF5, etc.) as well as simulation environments.
  • Proficiency with modern AI-assisted development tools (e.g., Copilot, Cursor, Claude Code) for accelerating engineering workflows.
  • Track record of contributions to open-source projects or publications at top venues (CVPR, ICLR, NeurIPS, RSS, ICRA, etc.).

Similar jobs