Agentic Data Engineer // Chicago IL

Visa independent candidates only Position: Agentic Data Engineer Location: Chicago, Illinois (Remote flexibility available) Duration: Contract 12+ months Candidates should be local to Chicago IL only Role Overview We are seeking an experienced Data Engineer with advanced expertise in agentic AI systems and multi-agent architectures to join our Innovation & Data Office on a contract basis. You will lead the design and implementation of autonomous, agent-driven data pipelines and governance frameworks within our Data Domains initiative. This role combines deep technical expertise in data engineering with knowledge of agentic AI patterns, multi-agent orchestration, and insurance domain requirements. You will architect intelligent, self-managing data systems that leverage Databricks, Unity Catalog ABAC (Attribute-Based Access Control) and Row-Level Security (RLS), and modern data lake/lakehouse patterns all coordinated through multi-agent systems that autonomously handle data ingestion, transformation, quality assurance, and governance across Marsh's global operations. Design and architect multi-agent systems that autonomously manage ETL/ELT pipelines using Databricks, Delta Lake, and Auto Loader, with specialized agents for data ingestion, validation, transformation, and quality monitoring Architect agent-driven data lake/lakehouse solutions with medallion architecture (Bronze/Silver/Gold layers) where autonomous agents handle promotion logic, schema evolution, and data quality enforcement across multi-region environments Develop intelligent agentic governance frameworks leveraging Unity Catalog, ABAC policies, and Row-Level Security (RLS), where agents autonomously detect data sensitivity levels, enforce fine-grained access control, and manage compliance across distributed systems Design and implement multi-agent orchestration patterns that enable agents to communicate, coordinate workflows, share state, and resolve conflicts in a scalable manner across multiple cloud regions Architect agents for autonomous data discovery, cataloging, and metadata management using Unity Catalog, enabling self-describing data ecosystems Design fallback mechanisms, error recovery patterns, and human-in-the-loop workflows for complex scenarios requiring agent intervention or escalation Stay current with evolving agent frameworks, LLM integration patterns, Databricks agentic capabilities, AWS services, and industry best practices in autonomous data engineering Proven experience designing and implementing multi-agent systems and agentic workflows Deep understanding of agent orchestration, communication protocols, and inter-agent coordination patterns Knowledge of prompt engineering, agent reasoning patterns, and retrieval-augmented generation (RAG) for data-specific contexts Familiarity with agentic AI frameworks and LLM integration patterns for data engineering use cases Proficiency in Python and SQL for agentic system and data pipeline development Hands-on experience with Databricks (Delta Lake, Spark, Notebooks, Jobs, DLT, AgentBricks) and agentic job orchestration Deep understanding of data lake and lakehouse architecture patterns, including medallion architecture and autonomous layer promotion Familiarity with Unity Catalog for data governance and autonomous metadata management Experience with multi-region data architecture, federation, data residency requirements, and cross-region agent coordination Best Regards Suman (Sue) Technical Recruiter Global Business Ser 4u Inc. Email: Sue@gbs4u.com | Web: www.gbs4u.com USA: 1755 Park Street, Suite 200, Naperville, IL 60563