Jobs · Education · California

Student Researcher (Seed – Multimodal Interaction & World Model - RL Focused) – 2026 Start (PhD)

ByteDance · San Jose, CA · 2 mo ago
Education$85/hrInternship

About Doubao (Seed)

Established in 2023, the ByteDance Seed team is dedicated to pioneering new paths toward artificial general intelligence. We aspire to advance the frontier of intelligence to drive progress for both technology and society. With a long-term vision for the AI sector, the Seed team's research spans MLLM, GenMedia, AI for Science, and Robotics. We maintain a global presence with laboratories and career opportunities across China, Singapore, and the United States. To date, we have launched industry-leading general foundation models and cutting-edge multimodal capabilities. Our technology powers over 50 application scenarios — including Doubao, Jimeng, TRAE, Dola and Dreamnia — and serves enterprise customers through Volcano Engine and BytePlus. Third-party data shows that the Doubao App ranks first in user volume in the Chinese market, while Doubao foundation models lead the industry in average daily token consumption.

Responsibilities

The Seed Multimodal Interaction and World Model team is dedicated to developing models that boast human-level multimodal understanding and interaction capabilities. The team also aspires to advance the exploration and development of multimodal assistant products.

  • Design and implement reinforcement learning (RL) training systems for large-scale multimodal foundation models
  • Develop unified modeling frameworks that integrate video, audio, and language, with a focus on visual latent reasoning
  • Explore RL-based approaches to bridge understanding and generation for multimodal visual reasoning
  • Collaborate with researchers to evaluate models on tasks involving world modeling, reasoning, and instruction-conditioned generation

Qualifications

Minimum Qualifications:

  • Currently pursuing a PhD in Software Development, Computer Science, Computer Engineering, or a related technical discipline
  • Publications in accredited venues, such as CVPR, ECCV, ICCV, NeurIPS, ICLR, ICML, or other leading conferences in AI and ML
  • Strong research background in at least one of the following: reinforcement learning, multimodal learning, video understanding, or vision-language modeling

Preferred Qualifications:

  • Experience with reinforcement learning in multimodal or interactive environments
  • Familiarity with video generation or diffusion-based generative models
  • Experience with large-scale model training (e.g., distributed training, curriculum learning, or memory-augmented transformers)
  • Solid programming and engineering skills, with experience building training or evaluation pipelines for ML models

Pay

The hourly rate range for this position in the selected city is $85–$85.

Benefits

  • Day one access to health insurance, life insurance, wellbeing benefits and more
  • 10 paid holidays per year
  • Paid sick time (56 hours if hired in first half of year, 40 if hired in second half of year)
  • Housing allowance for interns who are not working 100% remote (eligibility may vary)

Schedule

Campus Intern

Similar jobs