AI Backend Engineer
Haystack · United States · 3 days ago
RemoteRemoteEngineeringFull-time
About the Role
We are working with a company at the forefront of leveraging artificial intelligence to drive decision-making, automation, and orchestration across its robust platform. This organisation is building the foundational systems that power next-generation AI solutions, impacting production experience through rigorous attention to latency, correctness, reliability, and cost.
Responsibilities
- Build and operate backend systems supporting AI-powered workflows in production
- Design and implement AI orchestration layers connecting models, APIs, and business logic
- Develop inference pipelines for LLM-based and AI-assisted automation systems
- Optimise AI services for latency, throughput, and cost through various techniques
- Design stable service boundaries between backend systems, ML components, and product APIs
- Implement comprehensive observability, including logging, metrics, tracing, and incident response
Requirements
- Strong experience in production backend engineering
- Demonstrated experience with Artificial Intelligence (AI) concepts and applications
- Proficiency in building or operating high-throughput, low-latency services
- Familiarity with AI Systems such as LLMs, Embeddings, or AI Workflows
- Experience with distributed systems and production debugging practices
- Strong understanding of APIs, data flows, and system design principles
Benefits
- Fully remote position within a global engineering team
- Opportunity to work at the core of an advanced AI stack
- Exposure to cutting-edge AI technologies and distributed systems
- Competitive benefits package including medical, dental, vision, and savings plans