Senior Staff Software Engineer - AI Agent Platform

About the role

We are looking for a Sr. Engineer to design, build, and scale the infrastructure powering NVIDIA’s AI agent ecosystem. You will work at the intersection of distributed systems, developer platforms, and agentic AI — building the foundational services that enable teams across the company to develop, deploy, orchestrate, and operate autonomous AI agents at production scale.

Responsibilities

• Build and develop platform services that own the full agent lifecycle from registration through deployment, execution, and teardown
• Architect Kubernetes-based execution environments with pod lifecycle management, namespace isolation, persistent storage, and identity propagation
• Develop and maintain automated CI/CD pipelines using GitLab CI and ArgoCD, including reusable pipeline templates and deployment blueprints that standardize how agents are built across teams
• Build and operate Kafka-based message pipelines and real-time event streaming using Redis PubSub and SSE
• Implement data ingestion pipelines, access interfaces, and storage layers that power AI agent knowledge and context
• Develop multi-layer auth using OAuth 2.0, JWT validation, token exchange, and gateway integration, and manage secrets lifecycle with Vault (provisioning, rotation, container injection)
• Partner with security teams on compliance, access controls, and approval workflows for agent operations

Requirements

• Bachelor's or Master's degree in Computer Science, Engineering, or related field (or equivalent experience), with 12+ years in software engineering — ideally in platform engineering, infrastructure, or developer tools
• Experience building and scaling AI agents in production using frameworks like Claude Code, Codex, or LangGraph
• Deep Kubernetes expertise including pod orchestration, persistent storage, RBAC, and multi-cluster management
• Strong Python skills with production API experience using FastAPI, Flask, or similar async frameworks
• Expertise building and managing robust CI/CD pipelines using GitLab CI and ArgoCD for continuous delivery to Kubernetes
• Experience designing AI data platform components (ingestion pipelines, vector stores, retrieval APIs, data preprocessing workflows) and building developer-facing platform APIs consumed by multiple engineering teams
• Solid grasp of auth and identity: OAuth 2.0, JWT, token exchange, and secrets management with Vault
• History of leading sophisticated technical projects such as migrations or greenfield platform builds, with strong interpersonal skills to drive alignment across teams and write clear design documents

Qualifications

• Experience building or operating AI agent platforms or agentic workflow systems, with hands-on expertise in agent protocols and frameworks like MCP, A2A, LangChain, or LangGraph
• Hands-on experience with RAG architectures, embedding pipelines, and vector databases (Milvus, Pinecone, or Weaviate)
• Full-stack skills with React or Vue for building developer portals and dashboards
• Contributions to open-source infrastructure or platform tooling

Skills

• Full-stack development skills
• Experience with distributed systems
• Experience with Kubernetes
• Experience with CI/CD pipelines
• Experience with Kafka and Redis
• Experience with vector databases
• Experience with OAuth 2.0 and JWT
• Experience with Vault for secrets management

Benefits

• Equity
• Benefits

Pay

• Base salary range: $200,000 - $322,000 for Level 5, and $248,000 - $391,000 for Level 6

Schedule

• Full-time