Agentic AI Engineer
Booz Allen Hamilton · Annapolis Junction, MD · Yesterday
Hybrid$99k–$225k/yrFull-time
About the role
We are seeking a highly skilled Agentic AI Engineer to lead the shift in our AI strategy from passive LLM chatbots to proactive, multi-agent orchestrations. Your expertise in agent orchestration frameworks, RAG, knowledge graphs, and fine-tuning Small Language Models (SLMs) for edge deployment will be pivotal in driving our AI solutions forward.
Responsibilities
- Design and implement intelligent agent architectures that can reason, plan, and take actions using LangChain, LangGraph, and AutoGen.
- Develop and deploy multi-agent systems using Model Context Protocol (MCP) and Agent-to-Agent (A2A) protocols to facilitate communication, tool usage, and collaborative task solving.
- Build advanced RAG pipelines integrating unstructured data with Knowledge Graphs (KG) to enhance reasoning accuracy and context retention.
- Fine-tune SLMs for specific domains and optimize them for edge device performance, including ONNX, GGML, or Ollama.
- Develop evaluation frameworks to test agent reliability, safety, and performance, moving from prototype to production, including ReAct loops and human-in-the-loop.
Requirements
- 4+ years of experience in software development
- 3+ years of experience as an ML engineer building production-grade ML solutions using tools like Docker or Kubernetes, including, GenAI, LLMs, DL, RL, AI agents, agentic workflows, or complex automation frameworks
- 3+ years of experience with LangChain, LangGraph, AutoGen, PydanticAI, CrewAI, or LlamaIndex
- 3+ years of experience working in cloud environments, including AWS and Azure, and evaluating architectural tradeoffs and designing robust service-based software applications for scalable use
- Experience with MCP for tool integration and A2A for agent-to-agent collaboration and with RAG architecture and KG, including Neo4j or NebulaGraph
- Experience fine-tuning LLMs or SLMs using Hugging Face, PEFT, or LoRA, evaluating LLM performance and behavior through evaluations, and building observation layers for stakeholders, including Grafana, Langfuse, LangSmith, or Phoenix
- Knowledge of modern software design patterns, including microservice design or edge computing
- Ability to adapt in a rapidly changing environment and navigate ambiguity
Qualifications
- TS/SCI clearance with a polygraph
- Bachelor’s degree
Skills
- Experience deploying agentic systems in a production environment
- Experience deploying agents on edge devices such as Android or local models
- Experience integrating coding agents such as Cursor or Windsurf into an efficient development pipeline with measured results
- Experience with programming, including ML frameworks such as TensorFlow, PyTorch, llama.cpp, and vLLM
- Experience engineering AI capabilities in on-premise or multi-classification environments
Benefits
- Health, life, disability, financial, and retirement benefits
- Paid leave
- Professional development
- Tuition assistance
- Work-life programs
- Dependent care
Pay
$99,000.00 to $225,000.00 (annualized USD)
Schedule
Full-time and part-time employees working at least 20 hours a week on a regular basis are eligible to participate in Booz Allen’s benefit programs. Individuals that do not meet the threshold are only eligible for select offerings, not inclusive of health benefits.