AI Prompt Engineer

About the role

The BEAGLE (Border Enforcement Applications for Government Leading-Edge Information Technology) Agile Solution Factory (ASF) Team supports Customs and Border Control (CBP) clients in Northern Virginia. This role is ideal for someone who thrives on experimentation, understands how Large Language Models (LLMs) interpret language, and is passionate about unlocking the full potential of generative AI.

Responsibilities

• Prompt Design & Optimization: Develop, refine, and iterate on prompts for various generative AI models (LLMs) to elicit desired behaviors, responses, and creative outputs.
• Iterative Testing & Analysis: Conduct testing to compare prompt variations, analyze results, and drive continuous improvement.
• Collaboration: Work closely with multiple groups to integrate prompts to streamline manual processes.
• Research & Development: Stay abreast of the latest advancements in LLMs, generative AI, and prompt engineering techniques.
• Fine-tuning & RAG Support: Provide input and collaborate on strategies for model fine-tuning and Retrieval Augmented Generation (RAG) to further improve accuracy.
• Problem Solving: Debug unexpected model behaviors, identifying root causes within prompt structure, model limitations, or data context.

Qualifications

• U.S. Citizen with the ability to pass CBP background investigation.
• Bachelor’s degree in Computer Science, Software Engineering, Information Technology, or related field (or equivalent experience).
• 1+ year of hands-on experience working with Large Language Models (e.g., OpenAI GPT series, Llama, Gemini) or other generative AI models.
• Experience with at least one programming language (Python, JavaScript/TypeScript).
• Familiarity with prompt engineering techniques (few-shot, chain-of-thought, structured outputs, function calling).
• Desired problem-solving skills, with a data-driven approach to experimentation and optimization.
• Written and verbal communication skills, with an ability to articulate complex technical concepts clearly.
• Ability to work independently and collaboratively in a fast-paced, evolving environment.
• Exposure to RAG concepts, including embeddings and vector databases.
• Understanding of AI safety considerations (e.g., prompt injection, bias, data privacy).
• Exposure to Agile/Scrum development environments.

Pay

The Proposed Salary Range For This Position Is $66,700 - $133,300. Our employees value the flexibility at CACI that allows them to balance quality work and their personal lives. We offer competitive compensation, benefits, and learning and development opportunities.