Senior Deep Learning Scientist, Multimodal Agentic RL

About the role

NVIDIA is widely regarded as one of the technology industry’s most desirable employers. We lead the way in High-Performance Computing, Artificial Intelligence, and Visualization. Our core invention, the GPU, serves as the visual cortex of modern computers and powers our entire product suite. GPU deep learning ignited the modern AI era—the next great computing age—with the GPU acting as the brain for everything from robots and autonomous cars to conversational AI. Today, we are known globally as "the AI computing company." We are looking to grow our teams by bringing in the smartest people in the world. Join us at the forefront of technological advancement. NVIDIA is hiring Senior Deep Learning Scientists to advance our efforts in streaming and agentic multimodal AI. You will demonstrate foundational expertise in deep learning, reinforcement learning, and applied mathematics to help develop models capable of reasoning, planning, and acting across diverse modalities. This is a chance to define core algorithmic improvements for multimodal foundation models, scaling your ideas through our Nemotron Omni and VoiceChat platforms. You will work on high-impact, high-visibility large language models and multimodal AI products that improve the experience for millions of users. If you are creative and passionate about solving real-world agentic AI challenges, come join our Nemotron LLM team. For more details on Nemotron LLM, check https://www.nvidia.com/en-us/ai-data-science/foundation-models/nemotron/

Responsibilities

• Apply fundamental and applied research to develop, train, fine-tune, and deploy large language models for agentic systems encompassing audio-visual reasoning, tool usage, and document understanding.
• Advance post-training and alignment methods including instruction tuning, preference optimization, and RLHF/RLVR/MOPD to improve multimodal agents for complex use cases.
• Research and develop agentic reasoning and grounded perception capabilities, focusing on planning, tool execution, and long-horizon task completion across digital and physical environments.
• Lead the collection, development, and benchmarking of multimodal datasets, ensuring high-quality evaluation of model accuracy, safety, and task completion success.

Requirements

• Master’s degree (or equivalent experience) or PhD in Computer Science, AI, or Applied Math with 8+