BCG Platinion | Principal AI Tech Architect - AI Platforms

About the role

At BCG Platinion, we are seeking Principal AI Tech Architects to design, guide, and evolve the architecture of next-generation intelligent agentic systems. This role bridges high-level system design with hands-on AI engineering - ideal for someone who can envision complex AI-enabled ecosystems while still being comfortable prototyping or coding to validate ideas.

Responsibilities

• Define system architectures for AI and LLM-based solutions, ensuring scalability, low-latency inference, and modularity.
• Design Agentic AI solutions to optimize business workflow automation, including the use of memory, agentic reflection, and task planning.
• Design AI integration patterns, such as RAG, for model orchestration, context management, prompt orchestration, and external system connectivity.
• Establish architectural blueprints, design principles, and governance frameworks for model versioning, data lineage and responsible AI solutions across the organization.
• Architect polyglot model runtimes and hybrid pipelines (batch training + streaming inference) with attention to cost, latency, and risk.
• Develop solutions using the latest agentic orchestration engines, such as n8n, Retool, OpenAI Agentkit, Microsoft Copilot Studio, and AWS Flows.
• Support restructuring IT processes and organization to adopt new systems.
• Optimize the application development processes - define standards for versioning, testing, and monitoring of models and AI services (LLMOps).
• Craft compelling narratives for Agentic reimagination of businesses, translating complex ideas for both technical and non-technical audiences.
• Deliver impactful presentations, leading modules, presenting findings, and building consensus with clients.
• Build collaboration, mentor teams, and share knowledge to drive collective success - partner with product managers, data scientists, and engineers to translate business goals into robust AI system designs.
• Facilitate technical and strategic working sessions and workshops with both client and internal teams - provide technical direction and mentorship to engineering teams on architectural patterns, scalability, and best practices.
• Provide directions on key work items and feedback to other team members.
• Manage junior team members by defining and organizing their "module", helping them structure their work and associated analyses.
• Mentor and coach junior team members by building mutual development agreements and manufacturing opportunities for them to grow and develop along explicitly defined objectives.
• Provide quality assurance oversight - Review junior team members’ output for overall correctness, level of insight, clarity, etc.
• Serve as a role model by actively demonstrating and living BCG’s Culture and Values.
• Stay ahead of the curve on new techniques in distributed AI systems, retrieval-augmented generation (RAG), retrieval/indexing strategies, and agent frameworks.
• Drive innovation, uncovering novel ideas and transformative solutions.
• Serve as the subject matter expert on LLM integration, agentic system design, and intelligent automation frameworks.
• Foster a growth mindset, continuously learning and applying new skills to grow your impact.
• Contribute to our thought leadership through written publications and speaking at events and conferences.

Requirements

• Bachelor's degree in information technology, business administration, computer science, information systems, or system controls & engineering or a related field (Master’s degree is a plus).
• 10+ years of technology consulting or software engineering experience with more than 5+ years in architecture discipline.
• Strong foundation in software architecture and distributed systems design.
• Proven experience designing or scaling AI/ML or LLM-based applications.
• Proficiency in one or more programming languages: Python, JavaScript, TensorFlow, Keras, PyTorch, TypeScript, or Node.js.
• Familiarity with modern AI frameworks (LangChain, LangGraph, Google ADK, Strands, Semantic Kernel, AutoGen, CrewAI, LlamaIndex).
• Understanding of Agentic AI capabilities and tools such as LangChain agents, AutoGen, multi-agent orchestration, RAG, memory modules, vector DBs, function-calling, observability, safety, deployment strategies and governance.
• Understanding of cloud architecture, data management, and API-based system integration.
• Experience with AI coding tools such as Cursor, Replit, Lovable, Claude code, Codex etc.
• Experience with vector databases, embeddings, context retrieval, and prompt orchestration patterns.
• Exposure to Pinecone, QDrant, Cosmos DB, Azure Search is a plus.
• Experience with knowledge graphs such as Neo4j and knowledge representation techniques is a plus.
• Exposure to Agentic memory engines such as mem0, Redis Memory, Postgres Memory is a plus.
• Outstanding ability to work creatively, autonomously, analytically, in a fast-paced problem-solving environment with a focus on customer and results.
• Superior technical knowledge, engineering rigor, and creative problem-solving.
• Ability to explain complex technology topics to senior executives.
• Ideal experience with the below technologies: Multi-agent systems, RAG, or knowledge graph integration. MLOps / LLMOps pipelines, observability, and evaluation frameworks. Frontend frameworks (React, Next.js) for intelligent app interfaces. Consulting or innovation lab experience - comfortable with ambiguity and rapid iteration. Agile mindset that moves past blockers and a vision to iteratively migrate to the modern set of architecture capabilities with a lens of business benefits/value.
• Experience with the management of decision processes at large organizations.
• Strong customer and results orientation.
• Confidence and persuasiveness.
• Experience planning and managing large, complex projects.
• Willingness to travel to work with clients and BCG teams.

Qualifications

• Experience with multi-agent systems, RAG, or knowledge graph integration.
• Experience with MLOps / LLMOps pipelines, observability, and evaluation frameworks.
• Experience with frontend frameworks (React, Next.js) for intelligent app interfaces.
• Consulting or innovation lab experience - comfortable with ambiguity and rapid iteration.
• Agile mindset that moves past blockers and a vision to iteratively migrate to the modern set of architecture capabilities with a lens of business benefits/value.
• Experience with the management of decision processes at large organizations.

Skills

• Collaborative.
• Systems thinker.
• Technical expert.
• Comfortable with ambiguity.
• Change agent.
• Agile advocate.
• Innovative.
• Knowledgeable.
• Strategic partner.

Benefits

At BCG, we offer best in class benefits to support you personally and professionally including:

• An opportunity to work organically across disciplines and across BCG, we offer a unified and unrivaled opportunity that combines strategic thinking with hands-on applications.
• A unique experience to work alongside a team of passionate and driven problem-solvers with a mission to deliver innovative and valuable digital solutions in a supportive environment.

Pay

The base compensation for this role is $230,000 in USD. In addition to your base salary, you will also receive a comprehensive benefits package.

Schedule

This role may involve significant travel to client sites. The amount of travel will depend on client needs and nature of projects.