Jobs · Engineering · North Carolina

Principal Engineer - Agentic AI Platform Engineering & Performance

Bank of America · Charlotte, NC · Yesterday
EngineeringFull-time

Responsibilities

  • Develops the engineering approach for the entire program/portfolio solution and works with Architecture to develop/analyze/deliver the implementation of technical enablers
  • Leads the planning, definition, and design of the complex features which span multiple teams and explore solution alternatives
  • Leads the technical oversight for teams in solution development including design reviews and code within own domain
  • Defines the technology tool stack for the solution within a range of internally approved and supported technologies
  • Explores state-of-the-art technologies to improve development efficiencies, quality of test/QA coverage, and release management
  • Leads and is responsible for the end-to-end test strategy/creation/adherence, and the integration between teams for a program/portfolio solution
  • Improve the experience for our developers, making it easier to deliver industry-leading solutions, while managing work efficiently and with the right controls
  • Advance our technology platforms through innovation
  • Reduce risk and improve quality across our technology portfolio by aligning to a single enterprise architecture strategy and delivering governance that enables consistency, integration and automation
  • Define how agentic AI systems operate efficiently at scale, ensuring performance, cost, and reliability are engineered as first-class concerns

Requirements

  • Engineering Leadership & Enterprise Platforms: 15+ years of engineering experience with deep technical leadership in enterprise platforms, developer tooling, or AI-enabled engineering systems
  • Demonstrated ownership of architecture, standards, and engineering direction for shared platforms across multiple lines of business
  • Experience operating in highly regulated environments with strong SDLC, risk, and audit requirements
  • Ability to influence senior technology leaders and stakeholders through clear technical strategy and engineering standards
  • AI Platform Engineering, Agent Orchestration & LLMOps: Deep expertise in enterprise AI platforms, including agentic architectures, orchestration frameworks, and reusable service patterns
  • Strong command of LLMOps pipelines, including prompt and model versioning, evaluation frameworks, testing automation, and release lifecycle management
  • Proven ability to establish runtime governance and performance optimization, including: Policy enforcement, observability, resiliency, and safe execution controls
  • Latency optimization, token efficiency, and cost-aware execution of AI workflows
  • Intelligent orchestration strategies balancing quality, cost, and responsiveness
  • Experience building AI developer tooling integrated with SDLC workflows, including assistants, test generation, and evaluation harnesses
  • Hands-on knowledge of secure integration patterns across CI/CD, source control, and enterprise developer platforms
  • Agentic AI Performance Engineering & Optimization: Deep expertise in performance engineering of LLM and agentic systems, including latency profiling, throughput optimization, and scalable execution
  • Strong understanding of token optimization strategies, including: Prompt compression and structured prompting, Context window management and dynamic context injection, Minimizing token usage while preserving output quality
  • Proven ability to implement runtime optimizations such as: Caching (prompt, response, embeddings), Context pruning and retrieval optimization (RAG), and Parallelized agent workflows and efficient tool invocation
  • Proven ability to establish observability and SLAs for AI systems, including token usage, latency, cost, and quality metrics
  • Platform Adoption, Operating Model & Engineering Impact: Ability to define platform operating models, standards, and adoption strategies for AI capabilities across the SDLC
  • Proven success scaling platforms from incubation to enterprise adoption with measurable impact
  • Demonstrated ability to define performance SLAs (latency, cost, token usage) for enterprise AI systems
  • Proven ability to establish governance models ensuring efficient and sustainable scaling of agentic workloads
  • Proven ability to connect platform investments to improved delivery speed, quality, resilience, and cost efficiency

Qualifications

  • Bachelor’s degree in Computer Science, Engineering, Information Systems, Applied Mathematics, or a related technical field
  • Advanced degree in a technical discipline or equivalent record of distinguished technical leadership in AI platforms, developer tooling, or software delivery engineering

Similar jobs