AI/ML Engineer

About the role

The AI/ML Engineer will design, create, and implement complete AI systems that transform client operations, increase data accessibility, and optimize AI and ML systems. They will ensure solutions consider the broader ecosystem and future functionality, and deepen their skills in software engineering, MLOps, and software deployment.

Responsibilities

• Create and deploy production-grade AI and ML solutions, including LLMs, agents, and complex automation frameworks.
• Work within data science or data research environments, training and deploying models across multiple data modalities.
• Deploy and integrate production-grade ML models using tools like Docker and Kubernetes.
• Evaluate LLM performance and build observation layers for stakeholders using tools like Grafana, Langfuse, LangSmith, and Phoenix.
• Design and develop robust service-based software applications for scalable use in various mission environments.
• Manage data brokering solutions such as Kafka, Red Panda, Confluent, and related services.
• Collaborate with clients and stakeholders to ensure solutions meet their needs and expectations.

Requirements

• 3+ years of experience as a ML engineer and building production-grade ML solutions.
• Experience working in cloud environments, including AWS or Azure.
• Experience with large language models (LLM), deep learning (DL), and reinforcement learning (RL).
• Experience with AI agent frameworks such as MCP, LangChain, LangGraph, PydanticAI, or llamaindex.
• Ability to obtain a Secret clearance.

Qualifications

• Bachelor’s degree.
• Experience with programming, including ML frameworks such as TensorFlow, PyTorch, llama.cpp, and vLLM.
• Experience in connecting agents to APIs, cloud platforms, or databases.
• Experience evaluating LLM performance and building observation layers for stakeholders.
• Experience with client engagements, client-facing project work, and business development.
• Experience with project work in deep learning, computer vision, NLP, or signal processing.

Skills

• Software engineering.
• Machine learning operations (MLOps).
• Software deployment and integration.

Benefits

• Health, life, disability, financial, and retirement benefits.
• Paid leave.
• Professional development.
• Tuition assistance.
• Work-life programs.
• Dependent care.
• Recognition awards program.

Pay

$99,000.00 to $225,000.00 (annualized USD)

Schedule

Full-time and part-time employees working at least 20 hours a week on a regular basis are eligible to participate in Booz Allen’s benefit programs. Individuals that do not meet the threshold are only eligible for select offerings, not inclusive of health benefits.