Research Scientist in Multimodal Interaction and World Model - Seed - Graduates - 2027 Start (PhD)

About the team

The Seed Multimodal Interaction and World Model team is dedicated to developing models that have human-level multimodal understanding and interaction capabilities. The team is working to advance the exploration and development of multimodal assistant products.

Responsibilities

• Develop multimodal foundation models integrating vision, language, audio, and environment signals.
• Design and optimize world models for reasoning, planning, and interaction.
• Build training pipelines including data curation, alignment, and reinforcement learning.
• Improve agent capabilities such as perception, memory, decision-making, and tool use.
• Explore next-generation interaction paradigms between humans and intelligent systems.

Qualifications

• Minimum Qualifications: Currently pursuing a PhD in computer science, mathematics, engineering, or a related field, with an expected graduation date in 2027 and the ability to commit to an onboarding date by the end of 2027.
• Excellent coding ability, data structures, and fundamental algorithm skills, proficient in C/C++ or Python, etc.
• Experience in multimodal learning, reinforcement learning, or agent systems.
• Familiarity with large-scale model training or simulation environments.

Preferred Qualifications

• Strong research track record in relevant areas.
• Strong problem-solving and collaboration skills.

Job Information

[For Pay Transparency] Compensation Description (Annually) The base salary range for this position in the selected city is $244800 - $450000 annually. Compensation may vary outside of this range depending on a number of factors, including a candidate’s qualifications, skills, competencies and experience, and location. Base pay is one part of the Total Package that is provided to compensate and recognize employees for their work, and this role may be eligible for additional discretionary bonuses/incentives, and restricted stock units. Benefits may vary depending on the nature of employment and the country work location. Employees have day one access to medical, dental, and vision insurance, a 401(k) savings plan with company match, paid parental leave, short-term and long-term disability coverage, life insurance, wellbeing benefits, among others. Employees also receive 10 paid holidays per year, 10 paid sick days per year and 17 days of Paid Personal Time (prorated upon hire with increasing accruals by tenure).