Senior Manager, Engineering - Enterprise AI and Automation
NVIDIA · Santa Clara, CA · 1 wk ago
EngineeringFull-time
What You Will Be Doing
- Track and deeply understand evolving agent development patterns across NVIDIA and the broader ecosystem
- Identify gaps and friction in current agent architectures, and translate insights into a platform strategy that boosts developer velocity and agent quality—backed by evaluations, benchmarking, and feedback loops
- Audit and integrate open source and third-party tools where they add leverage; drive clear build-vs-use decisions
- Architect and integrate high-performance data pipelines, RAG systems, vector databases, and GPU-optimized training and inference workflows
- Lead integration of the AI Data Platform into NVIDIA’s on-prem AI Factory, optimizing GPU-to-storage throughput, data locality, and distributed inference performance
- Establish and enforce robust Agent Governance policies across the platform, covering model/tool usage, data lineage, and ensuring adherence to compliance and Responsible AI frameworks
- Design, implement, and maintain a centralized Agent Safety Toolkit, providing developers with pre-vetted components for input/output guardrails and prompt injection defenses
- Lead and grow a high-performing team along with a multi-functional community to standardize procedures and scale adoption
What We Need To See
- Bachelor’s degree in CS/Engineering or equivalent experience
- 10+ overall years in software engineering, including 4+ years managing high-performing teams
- Strong hands-on experience with evolving agent architectures and open-source libraries; deep expertise in LLM/agent architectures—leading POCs and integrating them into real business use cases with measurable adoption/impact
- Proven track record building multi-team developer platforms (APIs/SDKs, reusable components, reference implementations)
- Experience building evaluation/benchmarking systems for agent workflows (metrics, regression, feedback loops)
- Strong judgment integrating OSS/3P tools; clear build-vs-use decision-making and integration strategy
- Product approach for safety and governance: controls, audit ability, monitoring, and risk management
- Leadership and executive communication (engineering, product, security, research)
Ways To Stand Out From The Crowd
- Experience implementing enterprise-grade governance for agent systems (controls, audit-ability, monitoring, policy enforcement) in production autonomous workflows
- Demonstrated wins taking new/open-source agent constructs from POC to production adoption, with clear business impact (cycle time, quality, cost, reliability)
- Built and scaled an agent platform or agent developer experience used by multiple teams (SDKs, templates, reference apps, reusable building blocks)
- Clear point of view and real examples on build-vs-use decisions—when to adopt OSS/3P vs build internal primitives—and how to operationalize the choice
- Clear experience with agent evaluation at scale (long-horizon tasks, tool correctness, reliability testing, automated regressions, offline/online feedback loops)
Base Salary Range: 272,000 USD - 431,250 USD
Applications for this job will be accepted at least until February 27, 2026.