AI Engineer/Architect

About the role

CGI is seeking a highly skilled and experienced Senior AI Engineer/Architect to join our Health Care client in one of our selected client locations. This is an exciting opportunity to work in a fast-paced team environment supporting one of the largest leaders in the Health Care industry. This Senior AI Engineer will be instrumental to design, develop, and lead enterprise grade Generative AI solutions. This role requires deep hands-on expertise in Python, Large Language Models (LLMs), prompt engineering, embeddings, vector databases, and agent-based architectures. The role will work closely with the AI Center of Excellence (AI CoE) to ensure alignment with enterprise AI standards, governance, and best practices while driving adoption across delivery teams. This position can be performed from any Client site Bloomfield, CT, Raleigh, NC or Lafayette, LA in a Hybrid working Model.

Responsibilities

• Architect and implement robust multi agent orchestration using Python and LangGraph, including intelligent routing, dynamic handoffs, shared state management, long term memory, tool calling, error recovery, and follow up conversation flows.
• Define target and reference architectures for agentic AI, retrieval augmented generation (RAG), model access, memory, evaluation, and human in the loop controls.
• Establish reusable architecture patterns, engineering standards, guardrails, and design review practices for enterprise AI solutions.
• Design, develop, and maintain MCP servers using FastAPI and Python to expose tools, resources, prompts, and custom capabilities as part of the agent ecosystem.
• Define standards for tool contracts, discovery, versioning, permissions, schema validation, error handling, and safe execution.
• Build and maintain custom tools and integrations that connect AI agents with internal APIs, enterprise data sources, and legacy systems.
• Design complex AI powered chatbots and insights engines for critical healthcare and pharmacy benefit management workflows, including claims, pharmacy search, drug coverage, and prior authorization.
• Translate business and product requirements into scalable technical designs and guide solutions from proof of concept through production implementation.
• Select appropriate model, RAG, memory, orchestration, and tool use patterns based on quality, latency, cost, security, and compliance requirements.
• Own the architecture and development of high-performance FastAPI services, including streaming responses, asynchronous processing, custom middleware, rate limiting, caching, and authentication and authorization strategies.
• Design resilient integration patterns for APIs and legacy platforms, including retries, idempotency, timeouts, circuit breakers, fallbacks, and auditability.
• Ensure solutions follow security, privacy, responsible AI, secrets management, input/output validation, and regulated data handling best practices.
• Implement comprehensive observability using LangSmith, distributed tracing, monitoring, logging, evaluation, error handling, and performance tuning for AI agent workloads.
• Define service level objectives and quality measures for latency, answer quality, tool accuracy, task completion rate, reliability, and cost.
• Identify and prioritize technical improvements in agent performance, latency, tool accuracy, scalability, and overall system architecture.
• Collaborate cross functionally with frontend, DevOps, product, security, data, and enterprise architecture teams to deliver end to end AI capabilities with high reliability.
• Lead architecture reviews, mentor developers, communicate design trade offs, and establish implementation guidance for distributed delivery teams.
• Evaluate emerging AI technologies pragmatically and recommend adoption based on measurable business value and enterprise readiness.

Required qualifications

• 12+ years of professional software engineering and solution architecture experience, including hands on delivery of enterprise applications and platforms.
• 5+ years of AI/ML experience with recent hands-on delivery of production Generative AI and agentic AI solutions.
• Expert level Python skills and strong experience designing scalable, secure, production grade backend services using FastAPI.
• Hands on experience with LangGraph or a comparable framework for multi agent orchestration, including routing, handoffs, shared state, memory, tool use, recovery, and conversational continuity.
• Experience designing and implementing MCP servers and governing tools, resources, prompts, schemas, permissions, and lifecycle management within an agent ecosystem.
• Deep understanding of LLMs, prompt engineering, RAG, embeddings, vector search, memory patterns, function/tool calling, model evaluation, and guardrails.
• Proven experience designing AI powered chatbots, insights engines, or workflow automation solutions that integrate with enterprise APIs, data sources, and legacy systems.
• Strong knowledge of API and distributed system patterns, including streaming, asynchronous processing, middleware, rate limiting, authentication, authorization, resilience, and observability.
• Experience implementing LangSmith or equivalent AI observability, tracing, evaluation, debugging, and performance monitoring capabilities.
• Strong understanding of cloud native architecture, containers, CI/CD, security, privacy, responsible AI, and operational support for regulated enterprise workloads.
• Demonstrated ability to lead architecture decisions, mentor engineering teams, facilitate design reviews, and communicate complex tradeoffs to technical and business stakeholders.

Expectations

• Own solution architecture end to end, from discovery and design through implementation, production readiness, and adoption.
• Balance innovation with reliability, security, cost, maintainability, and measurable business outcomes.
• Drive architectural simplification, reuse, and consistent engineering practices across AI implementations.
• Operate as a hands-on technical leader who can validate critical designs and implementation patterns through working code and prototypes.
• Build trusted partnerships across product, engineering, DevOps, security, data, and enterprise architecture teams.

Benefits

• Competitive compensation
• Comprehensive insurance options
• Matching contributions through the 401(k) plan and the share purchase plan
• Paid time off for vacation, holidays, and sick time
• Paid parental leave
• Learning opportunities and tuition assistance
• Wellness and Wellbeing programs

Pay

A reasonable estimate of the current range for this role in the U.S. is $80,600.00 – $218,200.00. The determination of this range includes various factors not limited to skill set, level, experience, relevant training, and licensure and certifications.