BCG Platinion | Principal AI Tech Architect - AI Platforms

About the Role

Boston Consulting Group (BCG) is a global consulting firm that partners with leaders in business and society to tackle their most important challenges and capture their greatest opportunities. Our success depends on a spirit of deep collaboration and a global community of diverse individuals determined to make the world and each other better every day.

BCG's Tech and Digital Advantage (TDA) practice focuses on helping clients deliver competitive advantage and superior business performance through the use of data, technology and digital. Platinion is the fastest growing practice at BCG and at the heart of the strategic impact we have with our clients.

Responsibilities

As a Principal AI Tech Architect at BCG Platinion, you will design, guide, and evolve the architecture of next-generation intelligent agentic systems. This role bridges high-level system design with hands-on AI engineering - ideal for someone who can envision complex AI-enabled ecosystems while still being comfortable prototyping or coding to validate ideas.

• Define system architectures for AI and LLM-based solutions, ensuring scalability, low-latency inference, and modularity.
• Design Agentic AI solutions to optimize business workflow automation, including the use of memory, agentic reflection, and task planning.
• Establish architectural blueprints, design principles, and governance frameworks for model versioning, data lineage and responsible AI solutions across the organization.
• Architect polyglot model runtimes and hybrid pipelines (batch training + streaming inference) with attention to cost, latency, and risk.
• Develop minimal viable prototypes or proof-of-concepts to test model architectures, RAG flows, and agent orchestration.
• Evaluate emerging AI frameworks and tools for suitability and integration.
• Support restructuring IT processes and organization to adopt new systems.
• Oversee system performance, observability, and governance as solutions transition from prototype to production.
• Craft compelling narratives for Agentic reimagination of businesses, translating complex ideas for both technical and non-technical audiences.
• Deliver impactful presentations, leading modules, presenting findings, and building consensus with clients.
• Build collaboration, mentor teams, and share knowledge to drive collective success.
• Manage junior team members by defining and organizing their work and associated analyses.
• Mentor and coach junior team members by building mutual development agreements and manufacturing opportunities for them to grow and develop.
• Stay ahead of the curve on new techniques in distributed AI systems, retrieval-augmented generation (RAG), retrieval/indexing strategies, and agent frameworks.

Requirements

• Bachelor's degree in information technology, business administration, computer science, information systems, or system controls & engineering or a related field (Master’s degree is a plus).
• 10+ years of technology consulting or software engineering experience with more than 5+ years in architecture discipline.
• Strong foundation in software architecture and distributed systems design.
• Proven experience designing or scaling AI/ML or LLM-based applications.
• Proficiency in one or more programming languages: Python, JavaScript, TensorFlow, Keras, PyTorch, TypeScript, or Node.js.
• Familiarity with modern AI frameworks (LangChain, LangGraph, Google ADK, Strands, Semantic Kernel, AutoGen, CrewAI, LlamaIndex).
• Understanding of Agentic AI capabilities and tools such as LangChain agents, AutoGen, multi-agent orchestration, RAG, memory modules, vector DBs, function-calling, observability, safety, deployment strategies and governance.

Qualifications

The ideal candidate will have a strong technical background, excellent problem-solving skills, and the ability to work creatively and autonomously in a fast-paced environment.

• Outstanding ability to work creatively, autonomously, analytically, in a fast-paced problem-solving environment with a focus on customer and results.
• Superior technical knowledge, engineering rigor, and creative problem-solving.
• Ability to explain complex technology topics to senior executives.
• Ideally, experience with multi-agent systems, RAG, or knowledge graph integration.
• Experience with MLOps / LLMOps pipelines, observability, and evaluation frameworks.
• Frontend frameworks (React, Next.js) for intelligent app interfaces.
• Consulting or innovation lab experience - comfortable with ambiguity and rapid iteration.

Skills

• Cloud platforms: AWS (Bedrock, AgentCore), Microsoft (Azure AI Foundry, Copilot Studio), Google (Vertex AI, ADK, Agentspace).
• Design and deployment of autonomous and semi-autonomous agents across multi-cloud and hybrid environments.
• Integration of agent workflows with enterprise APIs, knowledge bases, and vectorized memory stores.
• Containerization and orchestration: Docker, Kubernetes, Helm, Istio with GPU autoscaling for agentic runtime optimization.
• Experience with AI coding tools such as Cursor, Replit, Lovable, Claude code, Codex etc.
• Experience with vector databases, embeddings, context retrieval, and prompt orchestration patterns.

Benefits

At BCG, we care about our people, and offer best in class benefits to support you personally and professionally including:

• An opportunity to work organically across disciplines and across BCG, we offer a unified and unrivaled opportunity that combines strategic thinking with hands-on applications.
• A unique experience to work alongside a team of passionate and driven problem-solvers with a mission to deliver innovative and valuable digital solutions in a supportive environment.

Pay

The base compensation for this role is $230,000 in USD. In addition to your base salary, you will also receive additional benefits.