Principal Product Manager

Role Responsibilities

• Develop and manage the architecture for chaining LLM agents, tools, models, and workflows across complex use cases.
• Ensure seamless orchestration, handoffs, state management, and integration across the platform.
• Lead the development of a shared Context Graph that gives agents persistent awareness of users, brands, accounts, workflows, capabilities, data, prior actions, goals, and outcomes.
• Define how context is captured, structured, retrieved, governed, and made available across agents and products.
• Implement and manage context streaming services that provide agents with real-time awareness of user actions, application state, system events, and relevant business data.
• Ensure context remains current, permission-aware, and usable across multi-step workflows.
• Define the telemetry framework required to understand how agents operate in production.
• Instrument and analyze intent routing, agent and tool selection, context utilization, handoffs, latency, errors, completion rates, confidence, user interventions, and business outcomes.
• Build the feedback loops necessary to continuously improve agent performance.
• Build robust evaluation frameworks for testing agent quality, reliability, routing, context utilization, tool execution, and end-to-end workflow completion.
• Establish both offline and production evaluation methodologies that enable measurable improvements over time.
• Lead the creation of a Model Workbench designed for marketers and other non-technical users, enabling them to safely leverage LLMs, traditional ML, agents, and workflows without requiring deep technical expertise.
• Oversee the registration, documentation, governance, and discoverability of Model Context Protocol servers, tools, agents, and platform capabilities.
• Ensure capabilities are easy for both developers and agents to understand, select, and invoke correctly.
• Drive alignment across Product, Engineering, Data Science, Design, Analytics, Security, and business stakeholders around shared agentic architecture, context standards, ownership models, evaluation criteria, and platform priorities.
• Establish clear accountability and operating models for capabilities that span multiple teams.
• Define standards for how agents, tools, context sources, telemetry, and workflows are built and integrated across the organization.
• Balance local team autonomy with the consistency required to create a coherent platform experience.
• Actively participate in troubleshooting and debugging using tools such as LangSmith and related observability platforms.
• Lead by example by rapidly building proof-of-concepts to validate technical approaches, identify architectural constraints, and demonstrate new product opportunities.
• Promote a culture of rapid prototyping, experimentation, and evidence-based iteration.

Requirements

• Demonstrated experience leading complex technical products, particularly those involving LLMs, AI agents, workflow systems, developer platforms, ML infrastructure, or AI-driven applications.
• Strong understanding of LLM agents, tool use, orchestration, multi-agent workflows, state management, context management, and the architectural patterns required to operate agentic systems reliably at scale.
• Experience designing or working with context graphs, knowledge graphs, semantic systems, memory architectures, metadata platforms, or other systems that allow applications and models to understand relationships between users, data, actions, and business objects.
• Strong understanding of instrumentation, telemetry, evaluation, and observability for complex software or AI systems. Ability to define the signals required to distinguish between model failures, orchestration failures, context failures, tool failures, and UX failures.
• Exceptional ability to align senior stakeholders and cross-functional teams around shared technical architecture, product priorities, ownership boundaries, and operating standards. Comfortable leading initiatives where no single team controls the entire outcome.
• Ability to reason across product experience, model behavior, data, infrastructure, APIs, organizational ownership, and operational processes rather than optimizing individual components in isolation.
• Strong technical background with hands-on familiarity with tools such as LangSmith and experience working with APIs, workflow orchestration, LLM agent chaining, MCP, evaluation frameworks, and modern AI development environments.
• Demonstrated ability to troubleshoot ambiguous technical problems, rapidly prototype potential solutions, and translate experimentation into scalable product and architectural decisions.
• Excellent communication skills with the ability to translate highly technical concepts into clear product strategies, operating models, and decisions for technical and non-technical audiences.

Benefits & Perks

• Unlimited PTO
• Excellent medical, dental, and vision coverage
• Employee Equity
• Employee Discounts, Virtual Wellness Classes, and Pet Insurance
• And more!