Senior Manager, AI Engineering & Product

About the role

Senior hybrid individual contributor and people leadership role bridging AI systems architecture, agentic AI, and cross-functional product execution. Operating at IC10 / L7 or equivalent (Client, Google, Amazon, or high-growth AI startup calibre). Expected to own roadmap, stakeholder alignment, and end-to-end delivery independently.

Responsibilities

• Build and scale AI deployment platforms focused on inference speed, latency reduction, and model acceleration
• Architect client software libraries and tooling to push LLM inference and training optimization
• Design and lead multi-agent engineering systems including orchestration, parallelism, and tool usage
• Prototype and incubate R&D innovations with potential patent value
• Drive cross-functional alignment and secure R&D budget from senior leadership
• Lead engineering teams with full autonomy across roadmap, staffing, and delivery

Requirements

• 15+ years in engineering, with 8 to 9 years in applied AI
• Group Manager or Director level experience at a large tech company or high-growth AI startup
• Deep hands-on expertise in LLM systems: transformers, inference optimization, quantization, KV cache, distributed training (PyTorch FSDP, PEFT/LoRA)
• Production-grade experience with AI Agents and agentic frameworks (Claude Code, Agent SDK, or equivalent)
• Infrastructure at scale: Kubernetes, Kafka, Spark, multi-tenant SaaS, AWS, GCP
• Proven record of building AI platforms from zero to enterprise production (F500 clients preferred)
• Experience with vector databases, synthetic data pipelines, RAG, Chain of Thought

Nice to Have

• Published author or recognized thought leader in AI/ML
• Startup founding or enterprise incubation experience
• GPU hardware ecosystem familiarity: CXL, NVMe, PCIe-level AI optimization
• Stanford GSB or equivalent advanced education

Location: San Jose, CA (Hybrid)
Duration: 3+ months