Senior Data Engineer
eTeam · Normal, IL · 3 days ago
On-siteInformation TechnologyContract
What You’ll Do
- Design, build, and operate data ingestion pipelines from operational, quality, test, and service systems into Databricks using Fivetran/AWS/Databricks and standardized ELT patterns.
- Develop and maintain dbt models for operational, quality, and ramp metrics, following our standard patterns for analytics.
- Set up and maintain data quality checks, audits, and monitoring for freshness, completeness, and contract compliance across key pipelines.
- Optimize Databricks jobs, Fivetran connectors, and dbt runs for performance, cost, and reliability, including orchestration, alerting, and runbooks.
- Collaborate with analytics engineers and product teams to turn models into high-value data products powering analytics applications.
- Contribute to the semantic layer and catalog so GenAI agents and self-service tools can reliably discover and query operational data.
- Drive improvements in upstream systems and schemas to reduce data issues at the source.
Qualifications
- 5+ years of experience in Data Engineering, Analytics Engineering, or Software Engineering working with production data systems.
- Strong expertise in SQL and Python for building scalable data pipelines and transformations.
- Hands-on experience building ELT pipelines using modern cloud data platforms (Databricks strongly preferred).
- Deep experience with dbt, including model development, testing, documentation, and CI/CD integration.
- Experience with managed ingestion tools such as Fivetran, Airbyte, or similar.
- Experience designing and operating production-grade data pipelines with monitoring and observability.
- Strong collaboration skills and ability to partner with engineering teams, analysts, and operational stakeholders.
- Bachelor’s or Master’s degree in Computer Science, Engineering, Mathematics, or related field, or equivalent practical experience.