DirectJobHub
Jobs · Engineering · New York

Senior Vice President, AI/ML Software Engineer

BNY · New York, NY · 3 wk ago
EngineeringFull-time

About the role

BNY is seeking a Senior Vice President AI/ML Software Engineer to lead the architecture and delivery of production-grade AI systems built on agentic frameworks, retrieval-augmented generation (RAG), and large language model (LLM) orchestration. This is a hands-on technical leadership role responsible for a team of engineers building autonomous AI pipelines that extract, validate, and reason over complex unstructured documents.

Responsibilities

  • Build the agent framework, not just configure one -- custom orchestration engine, not a LangChain wrapper
  • Production AI with real consequences -- extraction accuracy directly impacts financial operations
  • Full RAG ownership -- from raw OCR bytes through embedding, retrieval, and generation
  • Evaluation-driven culture -- golden-truth datasets, automated regression, measurable quality gates
  • Greenfield AI + enterprise integration -- build new AI-native systems that plug into established platforms

Requirements

  • Bachelor's degree or Advanced degree in computer science engineering or a related discipline, or equivalent work experience required.
  • 10+ years of professional software engineering experience
  • 3+ years leading or technically mentoring engineering teams
  • Deep expertise in AI/ML systems:
    • LLM orchestration, prompt engineering, chain-of-thought reasoning
    • RAG architectures: chunking, embedding, retrieval, re-ranking, context assembly
    • Agentic patterns: ReAct, tool-use, planning loops, multi-agent coordination
    • Vector databases and embedding models (OpenAI embeddings, sentence-transformers, FAISS, Pinecone, Weaviate, or similar)

Qualifications

  • Strong Python (3.11+): FastAPI, async/await, Poetry, Pydantic, pytest
  • Solid Java experience: Java 21, Spring Boot 3.x, microservice architecture
  • Production AI delivery: not just prototypes -- systems handling real workloads with observability, error recovery, and audit trails
  • Document intelligence: OCR pipelines, NLP, structured extraction from unstructured text
  • Testing & evaluation: golden-truth validation, retrieval metrics (MRR, NDCG), extraction F1 scores, agent success rates
  • Enterprise architecture: API design, circuit breakers, caching, event-driven patterns

Skills

  • Experience building custom agent frameworks (not just using LangChain/CrewAI out-of-the-box)
  • Knowledge of graph-based retrieval -- knowledge graphs, graph RAG, entity-relationship extraction
  • Experience with code AI: AI-assisted development tools, code generation pipelines, automated refactoring
  • Familiarity with model fine-tuning, LoRA/QLoRA, or RLHF techniques
  • Exposure to evaluation-driven development -- automated prompt regression testing, A/B testing of retrieval strategies
  • Angular/TypeScript experience for full-stack visibility
  • Capital markets or financial services domain knowledge
  • Familiarity with enterprise AI governance: content policies, PII handling, data residency

Benefits

  • Competitive compensation, benefits, and wellbeing programs
  • Flexible global resources and tools for your life’s journey
  • Focus on your health, foster your personal resilience, and reach your financial goals
  • Generous paid leaves, including paid volunteer time

Pay

The expected base salary for this position when employment commences can be found in the Job Info section at the bottom of the posting. Base salary offered may vary depending on multiple individualized factors, including market location, job-related knowledge, skills, and experience.

Schedule

At BNY, we offer a flexible schedule to accommodate your needs.

Similar jobs