Research Scientist - World-Action Foundation Model, Robotics

About the role

We are looking for multiple passionate Research Scientists to join the Research Group at Applied Intuition. The mission of the group is to create cutting-edge technology enabling next-generation physical AI, with emphasis on the two most challenging applications reshaping our everyday life: end-to-end autonomous driving and robotic generalist.

Team

The group is composed of leading experts from top institutions and companies, recognized for their exceptional academic and industry contributions—including eight Best Paper awards at premier conferences and journals such as CVPR and ICRA.

What you'll do

• Conduct research on pretraining world-action foundation model with various world modalities including vision and physics associated with ego actions, serving the purpose for both robot action and simulation world generation.
• Dive into relevant topics such as vision-physics modality association, feed-forward Gaussian splatting, world foundation model, human data incorporation, language modality, and spatial reasoning, deformable object modeling and simulation.
• Related topics including 3D/world-action foundation model, multi-modal pretraining, feed-forward Gaussian splatting, world foundation model with applications to autonomous driving, and fundamental topics on 3D vision and generation with broader applications.
• Work closely with other Research Scientists and interns on research publications for submission to top-tier conferences.
• Collaborate with Research Engineers and engineering teams to test and deploy algorithms to our autonomy and simulation products.

Requirements

• Strong research record in the fields of 3D vision, reconstruction and generation for robotics and autonomous systems, with publications in top-tier conferences or journals in the fields of computer vision, machine learning, and robotics.
• MSc or PhD in machine learning and computer vision with autonomy and robotics applications or closely-related fields.
• Passion for next-generation, scalable autonomy and robotics for real-world systems.
• Strong research skills and the ability to work both independently and collaboratively on projects.
• Technical experience in: Python, Pytorch, computer vision, robotics systems, and distributed machine learning model training.

Skills

• Nice to have hands-on experience in at least one of the following fields: 3D foundation model and pretraining, Multi-modal foundation model, Feed-forward Gaussian splatting and reconstruction, World foundation model and generation, 3D/multi-view end-to-end models for autonomous driving or robotics, Human data processing and incorporation.

Benefits

Compensation at Applied Intuition for eligible roles includes base salary, equity, and benefits. Base salary is a single component of the total compensation package, which may also include equity in the form of options and/or restricted stock units, comprehensive health, dental, vision, life and disability insurance coverage, 401k retirement benefits with employer match, learning and wellness stipends, and paid time off.