Jobs · Engineering · California

Senior Manager, Engineering - Enterprise AI and Automation

NVIDIA · Santa Clara, CA · 1 wk ago
EngineeringFull-time

What You Will Be Doing

  • Track and deeply understand evolving agent development patterns across NVIDIA and the broader ecosystem
  • Identify gaps and friction in current agent architectures, and translate insights into a platform strategy that boosts developer velocity and agent quality—backed by evaluations, benchmarking, and feedback loops
  • Audit and integrate open source and third-party tools where they add leverage; drive clear build-vs-use decisions
  • Architect and integrate high-performance data pipelines, RAG systems, vector databases, and GPU-optimized training and inference workflows
  • Lead integration of the AI Data Platform into NVIDIA’s on-prem AI Factory, optimizing GPU-to-storage throughput, data locality, and distributed inference performance
  • Establish and enforce robust Agent Governance policies across the platform, covering model/tool usage, data lineage, and ensuring adherence to compliance and Responsible AI frameworks
  • Design, implement, and maintain a centralized Agent Safety Toolkit, providing developers with pre-vetted components for input/output guardrails and prompt injection defenses
  • Lead and grow a high-performing team along with a multi-functional community to standardize procedures and scale adoption

What We Need To See

  • Bachelor’s degree in CS/Engineering or equivalent experience
  • 10+ overall years in software engineering, including 4+ years managing high-performing teams
  • Strong hands-on experience with evolving agent architectures and open-source libraries; deep expertise in LLM/agent architectures—leading POCs and integrating them into real business use cases with measurable adoption/impact
  • Proven track record building multi-team developer platforms (APIs/SDKs, reusable components, reference implementations)
  • Experience building evaluation/benchmarking systems for agent workflows (metrics, regression, feedback loops)
  • Strong judgment integrating OSS/3P tools; clear build-vs-use decision-making and integration strategy
  • Product approach for safety and governance: controls, audit ability, monitoring, and risk management
  • Leadership and executive communication (engineering, product, security, research)

Ways To Stand Out From The Crowd

  • Experience implementing enterprise-grade governance for agent systems (controls, audit-ability, monitoring, policy enforcement) in production autonomous workflows
  • Demonstrated wins taking new/open-source agent constructs from POC to production adoption, with clear business impact (cycle time, quality, cost, reliability)
  • Built and scaled an agent platform or agent developer experience used by multiple teams (SDKs, templates, reference apps, reusable building blocks)
  • Clear point of view and real examples on build-vs-use decisions—when to adopt OSS/3P vs build internal primitives—and how to operationalize the choice
  • Clear experience with agent evaluation at scale (long-horizon tasks, tool correctness, reliability testing, automated regressions, offline/online feedback loops)

Base Salary Range: 272,000 USD - 431,250 USD

Applications for this job will be accepted at least until February 27, 2026.

Similar jobs