Jobs · Engineering · New York

Senior AI Engineer

Husprey (acq. by Collibra) · New York, NY · 2 mo ago
Engineering$204k–$255k/yrFull-time

Joining Collibra's Artificial Intelligence team means building AI features that ship directly into the Collibra product used by real companies—including some of the largest enterprises and government agencies worldwide. You’ll work on real production AI: streaming responses, agent loops with checkpointing and resumption, and systems running at scale for customers who depend on them daily. This is a hybrid role based in our Brussels office, requiring at least two days per week in the office.

About the role

You’ll combine strong software engineering with data science judgment to build and maintain AI features that power trustworthy enterprise AI. This involves making AI smarter with business context while ensuring that context—and the AI acting on it—stays governed, secure, and compliant. You’ll collaborate with Data Scientists, AI Engineers, MLOps Engineers, and teams across Collibra to take AI products from prototype to production and beyond.

Responsibilities

  • Ship AI features into a live product used by companies around the world, not just prototypes or internal tools.
  • Build, instrument, and evaluate AI/ML models, treating quiet or no-output failures as bugs, not acceptable outcomes.
  • Help shape how Collibra’s AI platform evolves and mentor other engineers.
  • Design and implement agent-loop frameworks (e.g., LangGraph) with tool-calling standards (e.g., MCP), including tool cycles, state management, human-in-the-loop interrupts, checkpointing, and resumption.
  • Architect agent harnesses, including sandboxed code execution, tool permissioning, and safe orchestration of autonomous actions.
  • Apply agent evaluation frameworks to test tool-calling behavior and agent trajectories.
  • Ensure strong observability—silent failures are defects, not non-events.
  • Make retrieval/RAG decisions, including hybrid semantic + keyword search, rank fusion, and precision/recall tradeoffs.
  • Build stateless services at scale, handling multi-replica deployments, no sticky sessions, and concurrent requests.

Requirements

  • 5+ years of software engineering experience building and running production systems.
  • 3+ years applying data science/ML in production (LLM applications, RAG, NLP, recommendation engines).
  • Hands-on experience with agent-loop frameworks (e.g., LangGraph) and tool-calling standards (e.g., MCP).
  • Experience with agent harness architecture, such as sandboxed code execution and tool permissioning.
  • Familiarity with agent evaluation frameworks for testing tool-calling behavior and agent trajectories.
  • Strong observability instincts—no silent failures.
  • Judgment in retrieval/RAG, including hybrid search and rank fusion.
  • Experience building stateless services at scale.
  • Comfortable with SQL and relational databases, plus familiarity with time-series, graph, or vector databases.
  • Strong command of modern Python typing/validation (Pydantic v2) and production AI tooling (LangChain, LangGraph, etc.).
  • A bachelor’s degree or equivalent related working experience.

Qualifications

  • Deeply technical and analytical, driven by system data, not just narratives.
  • Able to cut through AI hype to identify real, shippable problems.
  • Excited by the architectural and mathematical challenges of building sustainable, governed AI.
  • A clear communicator, comfortable with both technical detail and the big picture, for technical and non-technical audiences.
  • Product-minded: you think about how real customers experience AI features, not just technical impressiveness.
  • A renaissance engineer fluent with AI-assisted development but not reliant on it—you own the output and its cost.
  • Curious and generous with what you learn—we’re building the playbook together.

Measures of success

  • First month: Oriented—you understand the architecture, existing AI products, and how they fit into the Collibra platform.
  • Third month: Shipping—new AI/ML features are going out into the SaaS platform with your contributions.
  • Sixth month: Operating and steering—your work is running in production for real customers, and you’re helping shape what we build next.

Pay

The standard base salary range for this position is $204,000 - $255,000 per year. This role is not eligible for additional commission-based compensation. Salary offers are based on experience, skills, and location.

Benefits

  • Competitive total rewards package, including bonus potential and equity for eligible roles.
  • Flex Fund monthly stipend for personalized benefits.
  • Pension/401k plans.
  • Comprehensive health coverage.
  • Flexible time off to support diverse needs and life events.

Similar jobs

Senior AI Engineer

Acadian Asset ManagementBoston, MA· 1 mo ago
$175k–$225k/yrapply on app.greenhouse.io

Senior AI Engineer

AllstateUnited States· 3 mo ago
RemoteEngineeringapply on allstateinsurance.contacthr.com

Senior AI Engineer

Tiger AnalyticsJersey City, NJ· 4 mo ago
RemoteEngineeringapply on apply.workable.com

Senior AI Engineer

MedicaHopkins, MN· 4 mo ago
Engineering$113k–$194k/yrapply on recruiting2.ultipro.com

Senior AI Engineer

Montefiore Health SystemBronx, NY· 5 mo ago
Engineering$184k–$230k/yrapply on montefiore.wd12.myworkdayjobs.com

Senior AI Engineer

Re:Build ManufacturingSeattle, WA· 4 mo ago
Engineering$144k–$216k/yrapply on grnh.se