Principal Data Engineer
Position Summary
The Principal Data Engineer serves as a senior technical leader responsible for architecting, developing, and governing enterprise-scale data platforms, pipelines, and analytics solutions. This role provides hands-on technical leadership across data engineering initiatives, cloud modernization efforts, real-time integrations, and enterprise data strategy.
Position Responsibilities
Enterprise Data Architecture & Engineering Design, development, and optimize enterprise-scale data pipelines and integration frameworks supporting analytics, reporting, operational, and AI/ML workloads.
Architect scalable data lake, warehouse, and real-time streaming solutions using cloud-native technologies.
Design and maintain logical and physical data models aligned with enterprise architecture standards and normalization best practices.
Build robust ingestion, transformation, orchestration, and delivery pipelines across structured and semi-structured data sources.
Arcitect cross-functional data solutions that integrate data from core insurance systems (e.g., policy admin, claims, billing, CRM) and third-party sources.
Technical Leadership
Serve as the technical lead for data engineering initiatives and provide architectural guidance across engineering teams.
Mentor and coach junior and mid-level engineers while promoting engineering excellence and continuous improvement.
Establish best practices for coding standards, CI/CD, infrastructure as code, monitoring, observability, and operational support.
Lead design reviews, technical solutioning sessions, and enterprise architecture discussions.
Cloud & Platform Engineering
Develop cloud-native data solutions using AWS, Azure, and modern data platforms including Snowflake, Spark, Kafka, Airflow, Glue, and related technologies.
Drive modernization initiatives involving hybrid-cloud and multi-cloud architectures.
Build reusable frameworks and automation solutions to improve scalability, reliability, and engineering productivity.
Data Integration & Processing
Integrate enterprise data from core operational systems, third-party vendors, APIs, and streaming platforms.
Develop and optimize ETL/ELT pipelines using SQL, Informatica/IICS, Python, Spark, and cloud-native processing tools.
Ensure high-performance query optimization, workload tuning, and efficient data processing across enterprise platforms.
Governance, Security & Compliance
Ensure compliance with enterprise security standards, governance policies, and regulatory requirements including HIPAA, SOX, GDPR, and NAIC standards applicable.
Implement data quality, metadata management, lineage, auditing, and observability capabilities.
Partner with cybersecurity, governance, and compliance teams to enforce secure and compliant data engineering practices.
Leadership & Collaboration
Collaborate with architects, analysts, actuaries, data scientists, developers, and business stakeholders to deliver scalable and trusted data solutions.
Translate complex business requirements into enterprise data architectures and engineering solutions.
Support strategic initiatives including underwriting analytics, claims automation, customer analytics, and regulatory reporting.
Provide technical mentorship and architectural oversight to junior and mid-level engineers across teams.