Jobs · Engineering · New York

Senior Software Engineer, AI

Arya Health · New York, United States · 4 mo ago
On-siteEngineeringFull-time

About the role

We are seeking a Senior Software Engineer in AI to join our team and develop intelligent solutions for Arya’s workforce platform. This role involves working with LLMs and AI toolkits to automate workflows and enhance customer interactions.

Responsibilities

  • Design and implement AI-powered workflows using Vertex AI Agents, Pydantic, and Bland.ai.
  • Integrate LLMs into customer workflows such as natural language scheduling and eligibility insights.
  • Build scalable APIs and services that deliver reliable AI features in production.
  • Implement evaluation, monitoring, and safety checks to ensure AI systems are accurate, fair, and trustworthy.
  • Collaborate with Product and Engineering to identify practical AI use cases.
  • Document integration patterns and best practices for AI deployment.
  • Provide technical leadership and mentorship on AI integrations.

What You'll Do

  • Design and implement AI-powered workflows using Vertex AI Agents, Pydantic, and Bland.ai.
  • Integrate LLMs into customer workflows such as natural language scheduling and eligibility insights.
  • Build scalable APIs and services that deliver reliable AI features in production.
  • Implement evaluation, monitoring, and safety checks to ensure AI systems are accurate, fair, and trustworthy.
  • Collaborate with Product and Engineering to identify practical AI use cases.
  • Document integration patterns and best practices for AI deployment.
  • Provide technical leadership and mentorship on AI integrations.

What This Role Is Not

  • You won't be training LLMs or building foundation models from scratch.
  • You won't be focused on academic research or publishing papers.
  • You won't be working in isolation — this role is highly collaborative with product and engineering teams.
  • You won't be building experimental prototypes only; you'll be delivering production-ready, customer-facing AI features.

What We’re Looking For

  • 5+ years of software engineering experience, with 2+ years working with LLMs or AI frameworks.
  • Strong programming skills in Python or Node.js; familiarity with Pydantic and MCP architecture.
  • Expert in SQL and proficient with Postgres optimization.
  • Hands-on experience with Vertex AI, OpenAI, or other model APIs.
  • Familiarity with CI/CD pipelines and cloud environments (GCP preferred).
  • Experience designing APIs and backend services that integrate AI features at scale.
  • Clear communication skills and a collaborative, pragmatic mindset.

Nice to Have

  • Experience with retrieval-augmented generation (RAG) pipelines and vector databases.
  • Exposure to compliance-aware AI systems in regulated industries.
  • Contributions to open-source AI/LLM frameworks.
  • Knowledge of monitoring/evaluation techniques for AI systems.

What To Expect In The First 90 Days

  • By Day 15 — Onboarding & Environment Setup
  • By Day 30 — Initial Contributions & Familiarity
  • By Day 60 — Ownership of Integration Scope
  • By Day 90 — Scaling & Strategic Impact

Similar jobs