Internship - Multimodal Embodied AI

About the role

MERL is looking for a self-motivated intern to work on problems at the intersection of multimodal large language models and embodied AI in dynamic indoor environments. The ideal candidate would be a PhD student with a strong background in machine learning and computer vision, as demonstrated by top-tier publications. The candidate must have prior experience in designing synthetic scenes (e.g., 3D games) using popular graphics software, embodied AI, large language models, reinforcement learning, and the use of simulators such as Habitat/SoundSpaces. Hands-on experience in using animated 3D human shape models (e.g., SMPL and variants) is desired.

Responsibilities

• Collaborate with researchers in computer vision at MERL to develop algorithms
• Prepare manuscripts for scientific publications
• Design 3D interactive scenes
• Experience with vision-based embodied AI using simulators (implementation on real robotic hardware would be a plus)
• Training large language models on multimodal data
• Experience with training reinforcement learning algorithms

Requirements

• Strong foundations in machine learning and programming
• Strong track record of publications in top-tier computer vision and machine learning venues (such as CVPR, NeurIPS, etc.)

Qualifications

The ideal candidate would be a PhD student with a strong background in machine learning and computer vision, as demonstrated by top-tier publications. The candidate must have prior experience in designing synthetic scenes (e.g., 3D games) using popular graphics software, embodied AI, large language models, reinforcement learning, and the use of simulators such as Habitat/SoundSpaces. Hands-on experience in using animated 3D human shape models (e.g., SMPL and variants) is desired.

Skills

• Experience in designing 3D interactive scenes
• Experience with vision-based embodied AI using simulators
• Experience training large language models on multimodal data
• Experience with training reinforcement learning algorithms

Benefits

MERL provides equal employment opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion, sex, national origin, age, disability or genetics. In addition to federal law requirements, MERL complies with applicable state and local laws governing nondiscrimination in employment in every location in which the company has facilities. This policy applies to all terms and conditions of employment, including recruiting, hiring, placement, promotion, termination, layoff, recall, transfer, leaves of absence, compensation and training.

Pay

Commensurate with experience.

Schedule

N/A