Senior AI Engineer (Agentic AI & Conversational AI)

Beacon Hill Technologies is seeking a Senior AI Engineer with expertise in Agentic AI and Conversational AI.

Requirements

• 8+ years of software engineering experience with Senior, Lead, Staff, or Principal-level responsibilities.
• Hands-on experience designing, building, and deploying production AI applications.
• Strong expertise with Large Language Models (LLMs), Agentic AI, and AI orchestration frameworks.
• Experience developing conversational AI solutions, chatbots, or virtual assistants.
• Proven ability to evaluate AI models, frameworks, and emerging technologies to recommend scalable solutions.
• Experience creating AI testing, evaluation, and monitoring frameworks to ensure accuracy, quality, and reliability.
• Strong background in software architecture, production deployment, and AI performance optimization.
• Experience collaborating with cross-functional teams including Product, UX, and Engineering.

Responsibilities

• Design and implement agentic AI workflows and multi-step reasoning systems.
• Build, optimize, and deploy conversational AI solutions into production.
• Evaluate AI frameworks, models, and tools to identify the best technical approach.
• Develop AI evaluation, testing, and monitoring strategies to measure quality, accuracy, and reliability.
• Improve AI recommendation engines through personalization and performance optimization.
• Define AI architecture, engineering standards, and governance best practices.
• Monitor production AI systems and continuously enhance performance and user experience.
• Partner with cross-functional stakeholders to translate business requirements into scalable AI solutions.

Benefits

• Medical, dental, and vision coverage.
• Federal and state leave programs as required by applicable agency regulations (eligibility applies).