Sr AI Engineer - Software

About the role

The client is a technology organization operating at the scale of a major financial enterprise, building AI agents that serve millions of customers directly. This is not a chatbot bolt-on or an innovation-lab experiment: the agentic platform sits in the production path of real customer conversations, with the reliability, latency, and safety bar that implies.

Responsibilities

• Architect, develop, and maintain LLM-based agentic systems in production.
• Design and implement robust agent stacks using LangChain, LangGraph, prompt/context engineering, tool/function calling, and RAG pipelines.
• Fine-tune, debug, and optimize model behavior with PyTorch and LLM serving/inference tools (vLLM, TGI, TensorRT-LLM).
• Integrate with commercial APIs (OpenAI, Anthropic, Bedrock/Vertex) and ensure seamless service integration using Python and Java.
• Apply distributed-systems fundamentals: APIs, queues, caching, observability, and CI/CD.

Requirements

• 7+ years of software engineering experience, with senior/lead-level ownership of production systems.
• Proven hands-on delivery of LLM-based agentic systems in production (not coursework or POCs).
• Strong proficiency in Python (primary agent/ML stack) and Java (service integration).
• Depth in the standard agent stack: LangChain, LangGraph, prompt/context engineering, tool/function calling, RAG pipelines.
• Working knowledge of PyTorch and model fundamentals for fine-tuning, debugging, and tradeoff analysis.
• Experience with LLM serving/inference (vLLM or comparable: TGI, TensorRT-LLM) and commercial APIs (OpenAI, Anthropic, Bedrock/Vertex).
• Solid distributed-systems fundamentals: APIs, queues, caching, observability, CI/CD.

Skills

• Hands-on experience with agent-builder platforms (e.g., Sierra, Decagon) for deploying, extending, or evaluating customer-service use cases.
• Voice agents, real-time/streaming inference, or contact-center integration.
• Experience in regulated industries (finance, healthcare) with model risk, compliance review, and audit trails.
• Eval frameworks (LangSmith, Braintrust, custom harnesses) and LLM safety/guardrail tooling.

Location: NY/NJ, Columbus, or Dallas (On-Site)

Level: Senior Engineer (VP-equivalent)