Vice President, Generative AI Platform Engineering
About the role
The Role: As the Vice President of Generative AI Platform Engineering, you will lead the architecture, engineering, delivery, and operations of the firm's enterprise Generative AI Platform. You will be responsible for building the foundational technology capabilities that enable secure, scalable, and compliant, and governed by the adoption of AI Agents, LLM-powered applications, and agentic workflows across the enterprise.
Responsibilities
Partner closely with the SVP, Head of AI/ML Technology to execute the long-term enterprise AI vision.
Translate strategic AI objectives into scalable platform capabilities and engineering roadmaps.
Own the architecture, delivery, and continuous evolution of Fidelity's enterprise Generative AI Platform and its AI Control Plane which will be the single, governed layer through which every LLM application, AI agent, and agentic workflow across the firm is provisioned, secured, observed, and controlled.
Define the platform's reference architectures, technical standards, and "golden paths" which will be opinionated, pre-approved patterns for building, deploying, and operating GenAI and agentic applications.
Establish the engineering practices (design review, testing, release management) and operational processes (capacity, cost, change, and incident management) that keep the platform reliable at enterprise scale.
Offer reusable building blocks such as RAG pipelines, vector stores, a governed tool/connector catalog, and memory services, as managed, self-service capabilities.
Own end-to-end agent lifecycle management: an agent and tool registry, least-privilege capability boundaries, session state and memory, versioning, and rollback and incident-response mechanisms for AI workflows and agents.
Establish unified identity and access management for both human and non-human (agent) identities across the platform.
Deliver deep observability: end-to-end tracing of agent reasoning and tool calls, telemetry, quality and drift monitoring, and cost and latency dashboards.
Build and lead a high-performing team of engineers, architects, engineering managers, ML engineers, and product leaders.
Create a culture of innovation, accountability, craftsmanship, and operational excellence.
Recruit and develop world-class engineering talent.
Requirements
Bachelor’s degree in computer science, Engineering, Mathematics, or related field. Advanced degree preferred.
15+ years of technology leadership experience. 10+ years leading large-scale software engineering organizations.
3+ years building cloud-native AI/ML platforms. Experience delivering enterprise GenAI and agentic AI platforms.
Hands-on experience building AI solutions, agentic workflows, AI agents, and LLM-powered applications.
Experience with a good understanding of two or more of the following: LangGraph, CrewAI, OpenAI, Anthropic, Amazon Bedrock, Azure AI Foundry, or comparable emerging agent frameworks.
Strong understanding of LLMs and AI orchestration platforms, model capabilities and limitations, context management, token economics, and cost/latency trade-offs.
Solid understanding of the Model Context Protocol (MCP), including its current limitations and security considerations.
Experience operating Kubernetes as the foundation of AI infrastructure is a huge plus. Especially for model serving, GPU scheduling and resource management, and autoscaling inference and agent workloads, along with deep grounding in distributed systems, APIs, and event-driven architecture.
Experience designing or operating a model/LLM gateway to manage LLM access at enterprise scale with centralized authentication and key management, policy-based routing across providers, quotas and rate limits, caching, and per-team cost attribution.
Hands-on experience with multi-cloud environments including AWS and Azure.
Demonstrated experience building and operating production platforms - AI or otherwise adopted by hundreds of users or developers (e.g., internal developer platforms or shared engineering services).
Demonstrated success operating highly available enterprise platforms with defined SLOs and SLAs.
Experience implementing AI governance, model risk management, and regulatory controls.
Familiarity with Responsible AI and AI governance frameworks, and the adaptability to deepen that expertise as security requirements and regulatory expectations evolve.
Experience managing large technology budgets and strategic vendor relationships.
Experience in financial services or another highly regulated industry is a strong advantage.
Qualifications
Think like a platform builder and enterprise architect.
Possess strong product and engineering leadership skills.
Drive innovation while maintaining operational discipline.
Have the executive presence to influence CIOs, CTOs, and business leaders.
Balance speed of innovation with governance and risk management.
Demonstrate a passion for transforming enterprises through AI.
Skills
Deep expertise in distributed systems, AI platform engineering, cloud-native architecture, GenAI technologies, agent frameworks, AI governance, and enterprise-scale operational excellence.
Benefits
Note: Fidelity will not provide immigration sponsorship for this position.
Pay
The base salary range for this position is $140,000-285,000 USD per year. Placement in the range will vary based on job responsibilities and scope, geographic location, candidate’s relevant experience, and other factors. Base salary is only part of the total compensation package. Depending on the position and eligibility requirements, the offer package may also include bonus or other variable compensation.
Schedule
Fidelity’s Onsite Working Model: Fidelity is transitioning to a full-time onsite working model through a phased rollout across regions and roles. Currently, some roles and locations require 100% onsite presence, while others require less. Onsite expectations are likely to evolve as the rollout continues. This transition does not apply to fully remote roles.
Additional Information
Note, the application window closes when the position is filled or unposted. Please be advised that Fidelity’s business is governed by the provisions of the Securities Exchange Act of 1934, the Investment Advisers Act of 1940, the Investment Company Act of 1940, ERISA, numerous state laws governing securities, investment and retirement-related financial activities and the rules and regulations of numerous self-regulatory organizations, including FINRA, among others. Those laws and regulations may restrict Fidelity from hiring and/or associating with individuals with certain Criminal Histories.