Data Engineer - Manager
PeopleCaddie · Chicago, IL · 6 days ago
Information Technology$80–$85/hrContract
Key Responsibilities
- Design, develop, and maintain scalable and resilient data pipelines for ingesting, transforming, and delivering data from diverse internal and external sources.
- Integrate data across databases, data warehouses, APIs, and third-party platforms while ensuring data accuracy, consistency, and integrity.
- Apply data cleansing, validation, aggregation, enrichment, and transformation techniques to prepare analytics-ready datasets.
- Optimize data pipelines and processing workflows for performance, scalability, reliability, and cost efficiency.
- Monitor and tune data systems; identify performance bottlenecks and implement indexing, caching, and optimization strategies.
- Embed data quality checks, validation rules, and governance controls directly within data pipelines.
- Collaborate with architects, data scientists, AI engineers, and analysts to support advanced analytics, business intelligence, and AI/ML use cases.
- Take ownership and accountability for maximizing the value of enterprise data assets used for insights, automation, and decision support.
- Clearly communicate complex technical concepts to both technical and non-technical stakeholders, including senior leadership.
Required Experience & Qualifications
- Bachelor’s degree in Computer Science, Data Science, Software Engineering, Information Systems, or a related quantitative field.
- 8+ years of experience in data engineering, including:
- Data modeling and architecture
- ETL / ELT and data integration
- Data warehousing and analytics platforms
- Data quality, master data management, and governance
- Business intelligence and advanced analytics (predictive and prescriptive)
- Strong programming experience with Python, SQL, Java, and/or C#.
- Hands-on Experience With Modern Data Platforms And Tools, Including Microsoft Azure technologies (SQL Server IaaS/PaaS, Synapse, Cosmos DB, Azure Data Factory, Databricks, HDInsight, Fabric, Power BI)
- Informatica Cloud (CIH, DIH, CDGC, Master Data Management, Data Quality)
- Snowflake and other leading cloud data technologies