Senior Backend AI Engineer
Tata Consultancy Services · New York, NY · 3 wk ago
Engineering$100k–$130k/yrFull-time
About the role
We are looking for a talented and experienced Senior Backend Engineer to join our growing team. The Senior Backend Engineer will be responsible for designing, developing, and maintaining scalable and efficient backend systems that power our applications. The ideal candidate will have a strong background in backend development, solid understanding of distributed systems, LLM systems, agentic workflows and experience with cloud technologies.
Responsibilities
- Design, develop, and maintain high-performance backend services and APIs.
- Collaborate with cross-functional teams to gather requirements, architect solutions, and implement features that meet business needs.
- Optimize backend systems for performance, scalability, and reliability, ensuring smooth operation under high load.
- Drive technical direction for agentic AI initiatives, influencing architecture patterns, autonomy boundaries, and system design.
- Design, build, and operate production-grade agentic AI systems used across multiple products.
- Own and evolve shared agentic AI capabilities, including:
- Agent frameworks and orchestration layers
- Planning, tool use, and memory strategies
- Retrieval and grounding (RAG) pipelines
- LLM infrastructure, inference, and model gateways
- Evaluation, observability, and safety tooling for autonomous systems
- Lead technical design reviews and help teams navigate tradeoffs involving autonomy, safety, reliability, scalability, and cost.
- Implement best practices for code quality, testing, and deployment automation.
- Work closely with DevOps teams to deploy and manage backend services in cloud environments (e.g., AWS, Azure, Google Cloud).
- Collaborate with frontend engineers to define API contracts and ensure seamless integration between frontend and backend systems.
- Communicate effectively with team members, stakeholders, and management to provide project updates, status reports, and technical recommendations.
Requirements
- Experience Required: 7+ years.
- Bachelor’s degree in computer science, Engineering, or related field. Master's degree preferred.
- 10+ years of experience building large-scale distributed systems with a strong proficiency in NodeJS/Javascript/Typescript, and/or Golang.
- Strong experience with LLM systems, agentic workflows or