Senior Vice President, AI / Machine Learning Software Engineer

About the role

BNY is seeking a Senior Vice President AI/ML Software Engineer to lead the architecture and delivery of production-grade AI systems built on agentic frameworks, retrieval-augmented generation (RAG), and large language model (LLM) orchestration. This role involves a team of engineers building autonomous AI pipelines that extract, validate, and reason over complex unstructured documents. The role requires a deep understanding of AI/ML systems, RAG architectures, and agentic patterns.

Responsibilities

• Build the agent framework, not just configure one -- custom orchestration engine, not a LangChain wrapper
• Production AI with real consequences -- extraction accuracy directly impacts financial operations
• Full RAG ownership -- from raw OCR bytes through embedding, retrieval, and generation
• Evaluation-driven culture -- golden-truth datasets, automated regression, measurable quality gates
• Greenfield AI + enterprise integration -- build new AI-native systems that plug into established platforms

Requirements

• Bachelor's degree or Advanced degree in computer science engineering or a related discipline, or equivalent work experience required
• 10+ years of professional software engineering experience
• 3+ years leading or technically mentoring engineering teams
• Deep expertise in AI/ML systems:
• LLM orchestration, prompt engineering, chain-of-thought reasoning
• RAG architectures: chunking, embedding, retrieval, re-ranking, context assembly
• Agentic patterns: ReAct, tool-use, planning loops, multi-agent coordination
• Vector databases and embedding models (OpenAI embeddings, sentence-transformers, FAISS, Pinecone, Weaviate, or similar)

Qualifications

• Strong Python (3.11+): FastAPI, async/await, Poetry, Pydantic, pytest
• Solid Java experience: Java 21, Spring Boot 3.x, microservice architecture
• Experience building custom agent frameworks (not just using LangChain/CrewAI out-of-the-box)
• Knowledge of graph-based retrieval -- knowledge graphs, graph RAG, entity-relationship extraction
• Experience with code AI: AI-assisted development tools, code generation pipelines, automated refactoring
• Familiarity with model fine-tuning, LoRA/QLoRA, or RLHF techniques
• Exposure to evaluation-driven development -- automated prompt regression testing, A/B testing of retrieval strategies
• Angular/TypeScript experience for full-stack visibility
• Capital markets or financial services domain knowledge
• Familiarity with enterprise AI governance: content policies, PII handling, data residency

Skills

• AI/Agentic - LLM orchestration, multi-agent systems, ReAct patterns, tool-use, autonomous pipelines
• RAG & Vectors - Embedding models, vector stores, hybrid search, re-ranking, chunk optimization
• LLM - Azure OpenAI, GPT-4o, enterprise model gateways, prompt versioning
• Python - Python 3.12/3.13, FastAPI, Poetry, Pydantic, async pipelines
• Java - Java 21, Spring Boot 3.x, Maven, Resilience4j, Hazelcast
• Frontend - Angular 19, TypeScript, D3.js, ECharts
• Database - Oracle, PostgreSQL, vector databases
• Infrastructure - Docker, GitLab CI/CD, Artifactory
• Observability - Agent traces, token tracking, retrieval quality metrics, audit pipelines

Benefits

• Competitive compensation, benefits, and wellbeing programs
• Flexible global resources and tools for your life’s journey
• Focus on your health, foster your personal resilience, and reach your financial goals
• Generous paid leaves, including paid volunteer time
• 401(k) plan eligibility
• Medical, dental, vision, and basic life insurance plans
• Variety of paid time off benefits, such as vacation and sick time

Pay

The expected base salary for this position when employment commences can be found in the Job Info section at the bottom of the posting. Base salary offered may vary depending on multiple individualized factors, including market location, job-related knowledge, skills, and experience.

Schedule

This role is based in New York, NY.