Senior Research Scientist, Multi-Modal Language Models

About the role

NVIDIA is seeking a Senior Research Scientist passionate about multi-modal language models. Our team drives Nemotron Multi-modal technology and with your help, we will continue to drive our models to be state of the art open-source multi-modal models.

Responsibilities

• Driving new abilities into the model
• Improving generalization of existing functionalities by understanding weak points, designing a data synthesis solution, and retraining models
• Developing recipes for training models that mix multiple modalities together, such as text, image, video, audio, etc...
• Designing solutions that improve pareto efficiency
• Collaborating with researchers to translate cutting-edge ideas into production-ready implementations
• Exploring new paradigms for evaluation
• Demonstrating strong engineering practices, and contributing to open-source communities

Requirements

• PhD in Computer science, Electrical Engineering, or related field, or equivalent research experience in LLMs, systems, or related areas
• 4+ years of experiences in computer vision, especially multi-modal LLMs
• Proficiency in Python with hands-on experience in frameworks such as PyTorch
• Solid background in computer science fundamentals: algorithms, data structures, parallel/distributed computing, and systems programming
• Proven ability to collaborate across research and engineering teams in multifaceted environments

Qualifications

• Specific multi-modal LLM research experience
• Experience developing and scaling large distributed systems for deep learning
• Contributions to open-source LLM systems or large-scale AI infrastructure

Skills

• Strong communication and collaboration skills
• Ability to work independently and as part of a team
• Knowledge of deep learning frameworks and techniques
• Experience with distributed systems and cloud platforms

Benefits

• Widely considered to be one of the technology world’s most desirable employers
• Opportunities for career growth and development
• Competitive compensation package including base salary, equity, and benefits

Pay

• Base salary range: $192,000 - $304,750 for Level 4, and $224,000 - $356,500 for Level 5

Schedule

• Full-time position