Jobs · Engineering · New York

AI Agent Engineer

David Joseph & Company · New York, NY · 1 wk ago
On-siteEngineering$200k–$300k/yrFull-time

Compensation: $200,000–$300,000 + 0.25%–1% equity

About The Company

A venture-backed, seed-stage startup using generative AI to automate consumer debt collection, a $35B US market. Its AI agents handle the full late-stage recovery process and already outperform human collectors at a fraction of the cost, running millions of calls per month with strong early revenue traction.

  • Founded 2024
  • Seed-stage (1–10 people)
  • Industry: AI Tools

About the Role

Build and own the company's voice AI agent infrastructure end-to-end on LiveKit — the orchestration layer, the prompting strategy across millions of consumer interactions, and continuous performance improvement through rigorous testing and iteration. This role suits either a deep voice AI engineer or a strong, analytical, business-minded infrastructure engineer.

Responsibilities

  • Build the voice AI infrastructure on LiveKit from the ground up
  • Design and own the architecture of real-time voice agent systems: orchestration, state management, latency optimization, prompting, and reliability
  • Own the end-to-end prompting strategy: conversation flows, tone, compliance-safe phrasing, guardrails, and edge-case handling
  • Build and maintain testing and evaluation frameworks: A/B testing, regression testing, conversation QA, benchmarking, and KPI reporting
  • Continuously expand AI prompting to cover more real-world scenarios
  • Iterate on performance data and call outcomes to improve containment, conversion, liquidation rates, and customer satisfaction
  • Optimize ASR, STT, TTS, turn-taking, interruption handling, and state transitions to improve voice quality
  • Build scalable systems and tooling to support millions of voice interactions
  • Work closely with product, operations, and leadership to translate business goals into high-performing voice agent behavior

Tech stack: LiveKit, Node.js, AWS, SQL; ASR/STT/TTS, real-time audio pipelines, SIP/telephony

Requirements

  • 2+ years of experience in voice AI, conversational AI, prompt engineering, speech systems, or related agentic workflows
  • 3+ years of experience in platform, infrastructure, or backend engineering
  • Strong experience with Node.js, AWS, and SQL
  • Experience building and shipping production systems in a startup or similarly fast-paced environment
  • Experience with voice orchestration platforms or agent frameworks such as LiveKit or equivalent
  • Strong prompt writing instincts and ability to design clear, effective, and resilient conversational flows for real-world edge cases
  • Strong analytical skills and comfort tying technical work directly to business outcomes and ROI

Green Flags

  • Voice AI experience in production, even from a no-name company or non-prestigious background
  • Has built AI infrastructure or agentic systems at a startup or AI company, understands what production-grade means at real scale
  • LiveKit experience or direct experience with voice orchestration frameworks
  • Business-minded, can connect technical decisions to liquidation rates, containment rates, and conversion metrics, not just engineering metrics
  • Strong prompt engineering instincts, has designed conversational flows that handle edge cases gracefully under compliance constraints
  • Infrastructure depth in Node.js, AWS, and SQL in a startup-paced environment where they owned what they built
  • Experience with telephony infrastructure such as SIP trunking is a strong additional signal

Red Flags

  • Pure academic or research background with no production deployment experience
  • No analytical instincts, builds technically but cannot connect the work to business outcomes and ROI
  • English communication skills not at native or near-native level. This is a hard filter due to the prompt engineering and compliance-sensitive consumer communication component
  • Not willing to be in-person in Manhattan 4 to 5 days per week
  • No experience with real-time systems or low-latency infrastructure

Why Join

  • Build the voice AI infrastructure in-house from scratch and own the full stack end-to-end
  • Work at real production scale — millions of consumer interactions per month
  • Early-stage team with strong traction and clear business impact from day one

Schedule

On-site in Manhattan, 4 to 5 days per week

Similar jobs

AI Agent Engineer

GigFinder.aiMichigan, United States· 1 mo ago
Engineeringapply on gigfinder.ai

AI Agent Engineer

IntelePeerDania, FL· 1 mo ago
RemoteEngineeringapply on careers.intelepeer.ai

AI Agent Engineer

LumosUnited States· 1 mo ago
RemoteEngineering$175k–$300k/yrapply on lumos.com

AI Agent Engineer

ProdigalSan Francisco, CA· 2 mo ago
Engineeringapply on ycombinator.com

AI Agent Engineer

Benchmark MotionIrvine, CA· 4 mo ago
Engineeringapply on benchmarksports.com