Lead Data Engineer Data Product
Shrive Technologies · Warsaw, IN · 4 wk ago
Information TechnologyFull-time
Role Summary
Lead the design and build of Data Products in the GOLD layer, driving the Data Product Factory approach for MVP use cases.
Key Responsibilities
- Own the build of 5 source-aligned data products + 2 MVP data products
- Lead dbt project setup (profiles, sources, seeds, models across RAW CURATED GOLD)
- Implement anonymization macros (SHA-256 hashing) reused across all sources
- Drive Data Product publishing, catalog registration, lineage capture in Horizon
- Coordinate with Gen AI Engineer to expose Gold-layer products to AI/BI semantic layer
- Sprint planning, backlog grooming, code reviews for 4+ engineers
Must-Have Skills
- 8+ years in data engineering with 4+ years leading teams
- Expert in Snowflake SQL, dbt (Core/Cloud), Python
- Strong on ADF orchestration, Snowpipe, COPY INTO, dynamic tables
- Data Product design patterns (FAIR principles, Data Contracts)
- Git, CI/CD (Azure DevOps), version-controlled DDL
Good-to-Have
- Kimball/Data Vault modeling
- Healthcare data (Claims, EHR) experience