Vice President, AI/ML Software Engineer

About the role

Vice President AI/ML Software Engineer

At BNY, our culture allows us to run our company better and enables employees’ growth and success. We are seeking a Vice President AI/ML Software Engineer to design and implement agentic AI systems, RAG pipelines, and intelligent document processing services. This is a senior individual contributor role with high autonomy.

Responsibilities

• Design and implement agentic AI systems, RAG pipelines, and intelligent document processing services.
• Own significant components of our AI platform, from embedding pipelines and vector retrieval to multi-agent extraction workflows.
• Work closely with the SVP lead to translate architectural vision into production code.
• Mentor mid-level engineers and drive technical excellence across the team.

Requirements

• Bachelor's degree in Computer Science, Engineering, or related field. Advanced degree preferred.
• 6+ years of professional software engineering experience.
• 2+ years building production AI/ML systems (not just notebooks/prototypes).
• Strong problem-solving skills with the ability to manage complex data processes.
• Excellent collaboration and communication skills to work effectively with cross-functional teams.
• Strong RAG expertise: Embedding models (OpenAI, sentence-transformers, Cohere, or similar); Vector databases (FAISS, Pinecone, Weaviate, Chroma, pgvector, or similar); Chunking and retrieval optimization; Context window management and prompt assembly.
• Agentic AI experience: Agent orchestration (custom frameworks, LangGraph, or similar); Tool-use patterns, function calling, structured output parsing; Memory and state management for multi-turn agent interactions.
• Python proficiency (3.11+): FastAPI, async patterns, Pydantic, Poetry, pytest; LLM integration: prompt engineering, token management, streaming, error handling, rate limiting; NLP & document processing: OCR post-processing, text segmentation, entity extraction; Testing rigor: unit tests, integration tests, golden-truth validation, retrieval metric evaluation; API design: RESTful services, OpenAPI specifications, versioning strategies.

Qualifications

• Bachelor's degree in Computer Science, Engineering, or related field. Advanced degree preferred.
• 6+ years of professional software engineering experience.
• 2+ years building production AI/ML systems (not just notebooks/prototypes).
• Strong problem-solving skills with the ability to manage complex data processes.
• Excellent collaboration and communication skills to work effectively with cross-functional teams.
• Strong RAG expertise: Embedding models (OpenAI, sentence-transformers, Cohere, or similar); Vector databases (FAISS, Pinecone, Weaviate, Chroma, pgvector, or similar); Chunking and retrieval optimization; Context window management and prompt assembly.
• Agentic AI experience: Agent orchestration (custom frameworks, LangGraph, or similar); Tool-use patterns, function calling, structured output parsing; Memory and state management for multi-turn agent interactions.
• Python proficiency (3.11+): FastAPI, async patterns, Pydantic, Poetry, pytest; LLM integration: prompt engineering, token management, streaming, error handling, rate limiting; NLP & document processing: OCR post-processing, text segmentation, entity extraction; Testing rigor: unit tests, integration tests, golden-truth validation, retrieval metric evaluation; API design: RESTful services, OpenAPI specifications, versioning strategies.

Skills

• Experience with knowledge graph construction from unstructured text.
• Familiarity with code AI concepts: code generation, automated testing, AI-assisted refactoring.
• Java/Spring Boot experience for cross-stack contribution.
• Angular/TypeScript for full-stack context.
• Experience with model evaluation: F1 scores, precision/recall for extraction, MRR/NDCG for retrieval.
• Exposure to fine-tuning or prompt optimization techniques.
• Understanding of graph RAG or hybrid retrieval architectures.
• Capital markets or financial services domain exposure.
• Experience with enterprise deployment: Docker, CI/CD, artifact repositories.

Benefits

Our Benefits And Rewards include:

• Competitive compensation, benefits, and wellbeing programs rooted in a strong culture of excellence and our pay-for-performance philosophy.
• Access to flexible global resources and tools for your life’s journey.
• Focus on your health, foster your personal resilience, and reach your financial goals as a valued member of our team, along with generous paid leaves, including paid volunteer time, that can support you and your family through moments that matter.

Pay

The expected base salary for this position when employment commences can be found in the Job Info section at the bottom of the posting. Base salary offered may vary depending on multiple individualized factors, including market location, job-related knowledge, skills, and experience.

Schedule

This role is in New York, NY.