Full Stack AI Product Engineer

Description & Requirements

• Build end-to-end AI product features across backend services, orchestration layers, and frontend user experiences.
• Develop analyst-facing and internal AI interfaces for workflows such as deal screening, commercial due diligence research, document extraction, and portfolio monitoring.
• Build responsive, high-quality frontend experiences for streaming AI responses, structured outputs, source grounding, review and approval flows, and human-in-the-loop interactions.
• Implement full-stack application patterns for chat, copilot, workspace, and review-based AI experiences, including state management, real-time updates, and error handling.
• Collaborate with Product, Design, and domain stakeholders to translate AI capabilities into intuitive, polished user experiences.
• Contribute to stable contracts between frontend applications and AI/backend services, ensuring outputs are structured, testable, and resilient.
• Support contribution workflows and product surfaces for the Prompt Execution Sandbox and AI Artifact Studio, enabling safe and scalable use by non-engineers where required.
• Ensure AI product features are accessible, observable, and production-ready, with attention to usability, reliability, and edge-case handling.

AI Platform and Agent Workflow Engineering

• Contribute to the Agent Gateway service, including inbound APIs, model routing, context management, response validation, and cost/audit logging.
• Build and maintain LangGraph agent workflows for PE use cases, including streaming, tool-calling, multi-step execution, and human-in-the-loop interrupt patterns.
• Integrate Temporal durable execution with LangGraph, including workflow and activity authoring, checkpointing strategies, retry and backoff policies, and signal/query handling.
• Contribute to AI platform services such as Agent Session Manager, Memory Service, HITL Coordination Service, and Feedback/Correction Service.
• Implement RAG pipelines, including chunking strategies, embedding model selection, vector store integration, re-ranking, and retrieval quality evaluation.
• Support evaluation and regression gates, including golden dataset management, metric definition, qualitative and quantitative evaluation, and CI enforcement on quality regressions.
• Implement context window management strategies such as token budgeting, truncation/compression, and tool-call state persistence to support reliability in longer-running workflows.
• Instrument AI services with structured logging, traces, and metrics to support operational dashboards and alerts for latency, quality, cost, and failure signals.
• Support deployment and operation of AI workloads in Kubernetes, including containerization and Helm-based deployment patterns.

Collaboration and Engineering Standards

• Participate in code reviews and contribute to engineering standards for production AI product engineering across testing, evaluation, documentation, and maintainability.
• Collaborate with Data Platform on feature store access patterns, inference integration, schemas, and data contracts.
• Work with Product Engineering and Design on AI feature surfacing, including streaming experiences, structured output rendering, citation and evidence UX, and HITL review interfaces.
• Use AI coding assistants to accelerate prototyping and development, while validating all production artifacts against testing and evaluation gates before promotion.
• Document agent behavior specifications, tool contracts, and product interaction patterns so behavior is explicit, reviewable, and maintainable.

About You

• Bachelor’s degree in Computer Science, Engineering, Information Systems, Data Science, or a related field, or equivalent practical experience.
• 3+ years of experience building production software, including experience delivering full-stack applications and/or AI-enabled systems in production environments.
• Experience contributing to user-facing AI product features, from backend services through frontend implementation.
• Experience working with agentic systems in production or pre-production, including tool calling, multi-step workflows, RAG, or structured output handling.
• Exposure to evaluation frameworks, including golden datasets, regression gates, or CI controls for quality assurance.
• Experience working with containerized environments such as Docker and Kubernetes, including familiarity with monitoring and reliability practices.
• Experience building modern full-stack applications with frontend architecture and backend integration.
• Frontend engineering skills including React and/or Next.js, TypeScript, component-based UI development, API integration, and application state management.
• Experience building product experiences for workflows such as tables, document-centric interfaces, review flows, or real-time/streaming interactions.
• Understanding of UX patterns for AI systems, including confidence indicators, citations/source grounding, fallback states, edit/retry patterns, and human review steps.
• Good product sense in translating non-deterministic AI behavior into usable and trustworthy product experiences.
• Python proficiency, including FastAPI, Pydantic v2, async patterns, and pytest.
• Hands-on experience with LangChain and/or LangGraph, including stateful graph construction, tool integration, checkpointing, and streaming patterns.
• Familiarity with Google ADK or equivalent agentic orchestration frameworks is a plus.
• Familiarity with Temporal or similar durable execution frameworks, including workflow/activity authoring and retry patterns.
• Prompt engineering skills, including structured output design, system prompt construction, instruction clarity, and multi-turn context management.
• Experience implementing or contributing to RAG pipelines, including chunking, embedding selection, vector store integration, and retrieval quality evaluation.
• Familiarity with LLM evaluation approaches, including golden dataset design, metric definition, and regression gate concepts.
• Awareness of context window management strategies such as token budgeting, truncation, and tool-call state persistence.
• Familiarity with vector databases such as pgvector and/or OpenSearch.
• Experience with Docker and familiarity with Kubernetes deployment concepts.
• Uses AI coding assistants such as Cursor and GitHub Copilot as part of the development workflow, while applying judgement about where generated code is reliable versus where it requires scrutiny.
• Familiarity with multi-agent system concepts including orchestration logic, tool interfaces, and failure-handling patterns.
• Capable of contributing to evaluation pipelines that combine deterministic metrics with LLM-as-judge patterns for qualitative assessment.
• Able to review AI-generated code, including Kubernetes manifests, prompts, and agent graphs, for correctness and safety before production release.

General

• Understands non-determinism as a first-class engineering challenge and contributes to systems that degrade gracefully when model outputs are unexpected.
• Writes evaluation tests before shipping new AI capabilities, not after.
• Prototypes quickly using AI tooling, but validates production artifacts against defined quality gates before promotion.
• Documents behavior specifications, tool contracts, and user-facing interaction patterns rather than leaving critical behavior implicit in code.

U.S. Compensation Information

Compensation for this role includes base salary, annual discretionary performance bonus, 401(k) plan with an annual employer contribution based on years of service and Bain’s best in class benefits package (details listed below).

Some local governments in the United States require a good-faith, reasonable salary range be included in job postings for open roles. The estimated annualized compensation for this role is as follows:

• In Atlanta, the good-faith, reasonable annualized full-time salary range for this role is between $79,250 - $86,500
• In Texas, the good-faith, reasonable annualized full-time salary range for this role is between $83,000 - $90,750
• In Chicago, the good-faith, reasonable annualized full-time salary range for this role is between $87,000 - $95,250