AI Engineer Lead

About the role

At Allstate Investments, we are seeking an AI Developer who is a fast learner and rapid problem solver, capable of quickly understanding new domains, technologies, and business problems, and translating them into high impact proof-of-concept (PoC) solutions. This role requires the ability to move quickly from idea to working prototypes, validate value early, and then guide successful PoCs into scalable, production-ready AI solutions. As a member of the Investments Technology group, your work directly supports an $80bn portfolio and an organization of 300+ experts committed to excellence, innovation, and the highest ethical standards.

Responsibilities

• Collaborate with a highly talented and diverse team of professionals
• Continuously expand your skill set by learning new technologies, tools, and methodologies
• Proactively identify opportunities for innovation, with the autonomy to rapidly explore, prototype, and validate new ideas
• Play a key role in the design, development, and deployment of AI/ML solutions
• Lead the transition of AI/ML initiatives from proof of concept to scalable, production-ready solutions

Qualifications

• Minimum of 5 years of python development
• Minimum of 3 years of experience working on AI projects, with a focus on productizing AI/ML solutions
• Deep understanding of machine learning fundamentals and ability to apply them in developing and implementing AI/ML solutions
• Experience with GenAI technologies and techniques (e.g., RAG, fine-tuning, vector stores, Agentic frameworks)
• Data-driven decision making, combining robust analytical thinking with sound business judgment
• Excellent communication with both technical and non-technical team members
• Comfort with hands-on involvement in AI/ML experimentation and model development
• Solid grasp of software development principles, including design patterns, testing, and version control such as Git

Key Skills

• Programming & Engineering Excellence: Python (advanced), APIs, pipelines, and AI orchestration
• Java/ReactJS (optional)
• LLM & GenAI Engineering: Hands-on experience with LLMs (preferably GPT models), prompting patterns and structured outputs, model evaluation including accuracy/faithfulness checks, hallucination mitigation, regression testing, safety/guardrails patterns appropriate for enterprise use, demonstrated ability to leverage GitHub Copilot for code acceleration
• Data Skills: SQL + SQL Server, Microsoft Fabric (optional)
• Designing MCP servers/tool endpoints and integrating them into LLM apps
• Implementing agentic workflows, A2A patterns such as multi-agent collaboration (planner/executor/reviewer/retriever roles)
• CloudMS Azure Fabric preferred
• Observability & Production Support: Experience operating and supporting AI-enabled services in production: logging, metrics, tracing (APM tools such as Datadog), model/prompt monitoring, drift signals, quality regression detection

Pay

Compensation offered for this role is $151,700.00 - $221,675.00 annually and is based on experience and qualifications.

Schedule

N/A

Benefits

N/A

Skills Building

N/A

Architecture

N/A

Emerging Technologies

N/A

Ideation

N/A

Large Language Model (LLM) Fine-Tuning

N/A

Python (Programming Language)

N/A

Structured Query Language (SQL)

N/A