Enterprise AI Platform Engineer
Headquarters is in Charlotte, NC. Recently expanded to nearshore. Ranked for SMB Payroll in the 2023 Sapient Report. Voted top places to work in USA 2023.
About The Role
We're building the internal platforms that will let teams across the company automate their own work and processes. This is early, and it's a chance to help build an internal platform for all of our employees from the ground up. It's infrastructure for internal use including orchestration layers, MCP tool infrastructure, LLM integrations, and the services that connect them. We're building to take repetitive, manual effort off people's plates so they can focus on higher-value work. This is a builder role focused on production internal systems, not model training, research, or customer-facing product features. You'll help shape and implement the platform components that agents and internal tools run on. If you like backend and systems engineering and want to go deep on the fast-moving agent-infrastructure layer and help define what it becomes, this is that job.
Responsibilities
- Build and maintain backend services and APIs (REST) that power agent orchestration, tool execution, and LLM integration for internal automation workflows.
- Develop and operate MCP servers and clients including tool registration, integration of databases and enterprise systems into agent workflows, versioning, and lifecycle management.
- Integrate LLM services (streaming, structured outputs, tool/function calling) with robust error handling across agent workflows.
- Implement multi-agent and multi-step workflows using an orchestration framework.
- Contribute to observability, evaluation, and reliability for non-deterministic systems including tracing, monitoring, and cost/latency visibility.
- Collaborate with architecture, DevOps, and security to ship secure, well-tested services following CI/CD best practices.
Requirements
- Strong software engineering fundamentals and a track record of shipping and maintaining production backend systems.
- Proficiency in Python.
- Solid backend/API experience building REST APIs at scale and comfort with relational databases.
- Experience integrating LLM APIs into real applications.
- Hands-on comfort with MCP (building and/or consuming servers and clients).
- Experience with at least one agent orchestration framework (e.g., LangGraph, CrewAI, AutoGen, Semantic Kernel).
- Understanding of common agent design patterns, and how the right choice for a given task (e.g., deterministic workflows vs. role-based vs. autonomous agents).
- Experience with agentic software development - building with AI coding tools and agent-based workflows as part of how you work.
- Working familiarity with agent-to-agent (A2A) concepts and interoperability patterns.
- Comfortable working in a cloud environment and on the command line; fluent with Docker, Git, and CI/CD.
- Sound instincts around secrets management and authentication/authorization.
Skills
- Experience with Node/TypeScript or C#.
- Rust from the infrastructure/systems-engineering side - CLI tools, proxies, and other performance-sensitive behind-the-scenes components.
- Depth in multi-agent architectures - supervisor/worker patterns, hierarchical graphs, ReAct-style loops.
- RAG and vector database experience (chunking, hybrid search, re-ranking).
- Redis-backed queues or other high-throughput backend patterns.
- Experience shipping software in a regulated or governed environment (security, privacy, compliance).
- Familiarity with Azure and Microsoft Entra ID.
- Observability/eval tooling for LLM systems (LangFuse, Prometheus, or similar).
About Isolved
isolved is an employee experience leader, providing intuitive, people-first HCM (Human Capital Management) technology. Our solutions are delivered directly or through our partner network to more than five million employees and 145,000 employers - who use them every day to boost performance, increase productivity, and accelerate results while reducing risk. Our HCM platform, isolved People Cloud, seamlessly connects and manages the employee journey across talent management, HR & payroll, workforce management and engagement management functions. No matter the industry, we help high-growth organizations employ, enable and empower their workforce by transforming employee experience for a better today and a better tomorrow.