Jobs · Engineering · California

Principal AI Engineer

Ontrac Solutions · San Francisco, CA · 2 wk ago
EngineeringContract

About the role

We are seeking a Principal GenAI Architect / Forward Deployed Principal Engineer to lead the design, delivery, and productionization of enterprise-grade Generative AI solutions within a highly regulated banking environment.

Responsibilities

  • Own and define enterprise-grade GenAI architectures for banking and financial services use cases, including RAG pipelines, agentic workflows, prompt orchestration, and multi-model routing strategies.
  • Drive production readiness for GenAI solutions, ensuring scalability, resiliency, observability, latency optimization, security, and cost efficiency.
  • Lead complex architectural decisions across data ingestion, vector databases, model selection, guardrails, API scalability, performance optimization, and secure integration with banking systems.
  • Establish reference architectures, reusable patterns, and best practices to accelerate responsible GenAI adoption across lines of business.
  • Partner with central AI platform teams to align solution architecture with enterprise AI services, platform capabilities, banking technology standards, and long-term roadmap priorities.
  • Act as a Forward Deployed Principal Engineer, partnering directly with business, product, and engineering teams to deliver high-impact GenAI use cases from ideation through production.
  • Translate banking and financial services business problems into clear AI system designs, technical requirements, and non-functional requirements with measurable outcomes.
  • Support GenAI use cases across areas such as customer service, operations, knowledge management, risk, compliance, fraud, employee productivity, document intelligence, and internal workflow automation.
  • Troubleshoot and resolve complex issues across non-production and production environments.
  • Partner closely with application teams to ensure AI solutions integrate effectively into existing banking platforms, enterprise workflows, data environments, APIs, and control frameworks.
  • Influence platform roadmap by feeding real-world banking use-case requirements back into central AI services and enterprise AI platform teams.
  • Ensure all AI solutions align with banking risk, cyber, model governance, data protection, privacy, and regulatory expectations.
  • Partner with Cyber, Model Risk Management, Legal, Compliance, Risk, and Data Governance teams to design compliant AI patterns without slowing delivery.
  • Embed security, privacy, responsible AI, ethical AI, explainability, human oversight, and auditability into solution design by default.
  • Help define practical implementation patterns that balance innovation, speed, governance, regulatory expectations, and enterprise control requirements.
  • Ensure GenAI solutions are designed with appropriate guardrails for sensitive financial data, customer information, personally identifiable information, and regulated business processes.
  • Serve as a recognized GenAI expert across the enterprise, regularly consulted by engineering, architecture, product, risk, compliance, and leadership teams.
  • Mentor senior and staff-level engineers and help raise the technical bar across banking technology teams.
  • Contribute to internal communities of practice, architecture reviews, executive-level technical discussions, AI governance forums, and knowledge-sharing sessions.
  • Represent enterprise GenAI capabilities in internal innovation forums, banking technology discussions, and responsible AI showcases.

Requirements

  • 7+ years of software engineering experience, with significant depth in AI/ML, data-intensive systems, distributed systems, or enterprise-scale platforms.
  • 2+ years of hands-on Python programming experience.
  • 2+ years of experience designing and delivering production-scale Generative AI systems in an enterprise environment.
  • 2+ years of experience with LLMs, prompt engineering, and RAG architecture.
  • 2+ years of experience with vector databases, semantic search, and retrieval systems.
  • 2+ years of experience with API-driven, cloud-native architectures.
  • 2+ years of experience with distributed systems, performance optimization, scalability, and reliability engineering.
  • Experience working within banking, financial services, fintech, or another highly regulated enterprise environment.
  • Strong understanding of banking technology environments and non-functional requirements, including security, scalability, resiliency, observability, latency, auditability, and cost management.
  • Demonstrated Principal-level impact, with influence across multiple teams, platforms, business units, or lines of business.
  • Experience operating in highly regulated environments, with financial services or banking experience strongly preferred.
  • Hands-on experience with agentic AI frameworks, AI workflow orchestration, and multi-model routing.
  • Prior experience in a Forward Deployed Engineer, embedded engineering, or business-facing technical delivery model.
  • Experience partnering with risk, cyber, legal, compliance, data governance, or model governance teams to deliver production AI solutions.
  • Familiarity with banking controls, customer data protection, model risk management, audit requirements, regulatory expectations, and responsible AI principles.
  • Ability to communicate complex technical concepts clearly to senior executives, technical stakeholders, risk partners, compliance teams, and non-technical business leaders.

Qualifications

  • The ideal candidate is a hands-on Principal-level engineer and architect who can move seamlessly between strategy, architecture, and execution in a banking environment.
  • They are comfortable working directly with business teams to understand real-world financial services problems, while also going deep with engineering teams on system design, performance, security, governance, and production readiness.

Skills

  • Strong technical judgment, enterprise banking delivery experience, and the ability to build practical, compliant GenAI solutions that can scale responsibly across a large financial institution.

Benefits

N/A

Pay

N/A

Schedule

N/A

Similar jobs

Principal AI Engineer

JobgetherUnited States· 6 days ago
RemoteEngineering$219k–$290k/yrapply on jobs.lever.co

Principal AI Engineer

Wells FargoChandler, AZ· 1 wk ago
Engineering$159k–$305k/yrapply on tnl2.jometer.com

Principal AI Engineer

SalesforceChicago, IL· 3 days ago
Engineering$218k–$365k/yrapply on salesforce.wd12.myworkdayjobs.com

Principal AI Engineer

eClinical SolutionsMansfield, MA· 5 days ago
Engineering$190k–$210k/yrapply on job-boards.greenhouse.io