BCG Platinion | Lead AI Tech Architect - AI Platforms

About the role

Lead AI Tech Architects - AI Platforms at BCG Platinion are responsible for designing and guiding the implementation of intelligent, agentic AI platforms. This role bridges platform architecture and hands-on technical leadership, ideal for someone who can design end-to-end AI platform solutions while remaining close to implementation through prototyping and architectural validation.

Responsibilities

• Design system architectures for AI and LLM-based solutions, balancing scalability, performance, modularity, and operational complexity.
• Evaluate emerging AI frameworks and tooling (e.g., LangChain, LlamaIndez, LangGraph, Strands, Google ADK, Semantic Kernel, etc.) and recommend fit-for-purpose usage.
• Design agentic AI solutions to enable intelligent workflow automation, including task decomposition, memory usage, and orchestration patterns.
• Define AI integration patterns such as RAG for context management, model orchestration, prompt workflows, and enterprise system connectivity.
• Contribute to architectural standards and design principles for model lifecycle management, data lineage, and responsible AI practices.
• Support architecture decisions for hybrid pipelines (batch training, real-time inference) with consideration for cost, latency, and operational risk.
• Develop proof-of-concepts and architectural prototypes to validate AI platform designs, RAG flows, and agent orchestration patterns.
• Support implementation of agentic workflows using modern orchestration and automation platforms in collaboration with engineering teams.
• Support teams and clients as AI platforms transition from prototype to production environments.
• Contribute to system performance, observability, and governance approaches as solutions scale.
• Help define development standards for versioning, testing, deployment, and monitoring of AI services and models (LLMOps).
• Translate complex AI platform concepts into clear narratives for both technical and non-technical stakeholders.
• Deliver structured presentations, lead technical discussions, and support client decision-making.
• Collaborate closely with product managers, data scientists, and engineers to align architecture with business objectives.
• Facilitate technical working sessions and design workshops, providing architectural guidance and hands-on mentorship.
• Provide direction and constructive feedback on key technical work items across teams.

Requirements

• Bachelor’s degree in information technology, computer science, engineering, or a related field (Master’s degree is a plus).
• 6+ years of experience in software engineering, data engineering, or AI systems with experience in architecture or technical leadership roles.
• Strong foundation in software architecture and distributed systems.
• Experience designing AI/ML or LLM-based systems in production or near-production environments.
• Proficiency in one or more programming languages (e.g., Python, Javascript, TypeScript) is nice to have.
• Experience using modern AI-assisted coding and development tools (e.g., Cursor, Claude Code, Replit, Lovable) to accelerate prototyping experimentation, and implementation of AI platform solutions.
• Familiarity with modern AI agentic frameworks (LangChain, LangGraph, Semantic Kernel, AutoGen, LlamaIndex, etc.).
• Understanding of Cloud architecture, data platforms, and API-based system integration, with depth in at least one hyperscaler (AWS, Azure, or GCP).
• Experience of deploying AI solutions on cloud AI platforms and services.
• Integration of AI workflow with enterprise systems and data sources.
• Experience with AI developer tools and productivity accelerators is a plus.
• Familiarity with vector databases and retrieval patterns; exposure to Pinecone, Qdrant, Aure Search, or similar is beneficial.
• Strong analytical thinking, problem-solving skills, and attention to engineering quality.
• Ability to explain technical concepts clearly to senior technical and non-technical stakeholders.
• Consulting mindset with comfort operating in ambiguous, fast-paced environments.
• Agile mindset with a focus on delivering business value through modern AI platforms.
• Willingness to travel to work with clients and BCG teams as needed.
• Gen AI fluency (e.g., proven usage of GenAI such as ChatGPT, Claude) and validation of response.

Qualifications

• Bachelor’s degree in information technology, computer science, engineering, or a related field (Master’s degree is a plus).
• 6+ years of experience in software engineering, data engineering, or AI systems with experience in architecture or technical leadership roles.
• Strong foundation in software architecture and distributed systems.
• Experience designing AI/ML or LLM-based systems in production or near-production environments.
• Proficiency in one or more programming languages (e.g., Python, Javascript, TypeScript) is nice to have.
• Experience using modern AI-assisted coding and development tools (e.g., Cursor, Claude Code, Replit, Lovable) to accelerate prototyping experimentation, and implementation of AI platform solutions.
• Familiarity with modern AI agentic frameworks (LangChain, LangGraph, Semantic Kernel, AutoGen, LlamaIndex, etc.).
• Understanding of Cloud architecture, data platforms, and API-based system integration, with depth in at least one hyperscaler (AWS, Azure, or GCP).
• Experience of deploying AI solutions on cloud AI platforms and services.
• Integration of AI workflow with enterprise systems and data sources.
• Experience with AI developer tools and productivity accelerators is a plus.
• Familiarity with vector databases and retrieval patterns; exposure to Pinecone, Qdrant, Aure Search, or similar is beneficial.
• Strong analytical thinking, problem-solving skills, and attention to engineering quality.
• Ability to explain technical concepts clearly to senior technical and non-technical stakeholders.
• Consulting mindset with comfort operating in ambiguous, fast-paced environments.
• Agile mindset with a focus on delivering business value through modern AI platforms.
• Willingness to travel to work with clients and BCG teams as needed.
• Gen AI fluency (e.g., proven usage of GenAI such as ChatGPT, Claude) and validation of response.

Skills

• Software architecture and distributed systems.
• AI/ML or LLM-based systems design.
• Modern AI agentic frameworks (LangChain, LangGraph, Semantic Kernel, AutoGen, LlamaIndex, etc.).
• Cloud architecture, data platforms, and API-based system integration.
• AI developer tools and productivity accelerators.
• Vector databases and retrieval patterns.
• Agentic AI concepts including RAG, multi-agent orchestration, memory patterns, and function-calling.
• Agile and iterative delivery approaches.
• Collaboration and communication skills.
• Technical leadership and mentoring abilities.
• Problem-solving and analytical thinking skills.
• Ability to explain technical concepts clearly to stakeholders.
• Comfort operating in ambiguous, fast-paced environments.
• Willingness to travel.
• Gen AI fluency (e.g., proven usage of GenAI such as ChatGPT, Claude).

Benefits

At BCG, we offer a comprehensive benefit program that includes:

• Zero dollar ($0) health insurance premiums for BCG employees, spouses, and children.
• $10 (USD) copays for trips to the doctor, urgent care visits and prescriptions for generic drugs.
• Dental coverage, including up to $5,000 (USD) in orthodontia benefits.
• Vision insurance with coverage for both glasses and contact lenses annually.
• Reimbursement for gym memberships and other fitness activities.
• Fully vested retirement contributions made annually, whether you contribute or not.
• Generous paid time off including vacation, holidays, and annual office closure between Christmas and New Years.
• Paid Parental Leave and other family benefits such as elective egg freezing, surrogacy, and adoption reimbursement.