Senior Backend Engineer, LangSmith Deployments
About the role
We're building purpose-built infrastructure for running AI agents. Unlike traditional web apps, agents run for long durations, collaborate asynchronously with humans and other agents, and need to survive failures mid-execution. LangSmith Deployments is the runtime that makes this work, with durable checkpointing, fault-tolerant orchestration, and horizontal scaling, deployed across cloud and self-hosted environments.
Responsibilities
- Design distributed queue and worker systems that handle concurrent agent execution, background tasks, and multi-agent coordination across horizontally scalable infrastructure
- Own core data infrastructure — state persistence, atomic job claiming, connection management, and schema evolution
- Collaborate on architectural decisions, ensuring solutions are scalable and robust
- Ship resumable streaming infrastructure so clients can disconnect and reconnect mid-execution without losing state
- Instrument and monitor production systems — tracing, metrics, and alerting to keep the platform healthy
- Participate in on-call rotations and own incident response for the runtime
- Create and maintain technical documentation, including system design and operational runbooks
- Contribute to and extend open-source LangGraph, which is used by thousands of developers to build agent applications
Requirements
4+ years of professional backend engineering experience
Strong proficiency in Go and/or python
Experience with distributed systems — consensus mechanisms, queueing, state machines, and/or workflow orchestration
Experience with scaling and sharding databases in high throughput environments
Familiarity with Kubernetes, infrastructure-as-code, and at least one major cloud platform
Strong communication skills and ability to work cross-functionally on a small team
Qualifications
Annual salary range: $175,000-$240,00 USD
Compensation Philosophy: We offer competitive compensation that includes base salary, variable compensation for relevant roles, meaningful equity, benefits, and perks.
Actual compensation and offerings will vary based on role, level, and location.
Benefits
Benefits include medical, dental, and vision coverage, flexible vacation, a 401(k) plan, meals on in-office days in the US and more.