Data Engineer-Snowflake
Apex Systems · Pittsburgh, PA · 3 days ago
Information TechnologyContract
Key Responsibilities
- Data Ingestion (Primary Focus)
- Design and build scalable data pipelines to ingest data from multiple sources into Snowflake (via AWS S3 or APIs)
- Support ingestion patterns including batch loads, API-based ingestion, and near real-time streaming where applicable
- Standardize ingestion into RAW data layers in Snowflake SPN
- Partner with upstream teams (Core Tech, WFM, external vendors) to onboard new data sources
- Monitor ingestion jobs and resolve failures, latency, or data completeness issues
- Snowflake Data Modeling & View Creation (Data Products)
- Design and develop Snowflake views (curated & consumption layers) aligned with business requirements
- Transform RAW data into domain-aligned, analytics-ready data products
- Implement reusable Mesh views across domains (e.g., Workforce Management, Core Tech)
- Optimize performance of queries and views for downstream consumption
- Align view design with Power BI reporting and API consumption needs
- Data Quality & Governance
- Implement validation checks to ensure data accuracy, completeness, and consistency
- Support data classification, lineage, and metadata documentation (data dictionary)
- Ensure compliance with enterprise data governance and security standards
- Manage role-based access and secure data sharing in Snowflake
- Platform Operations & Automation
- Develop and maintain scheduling and orchestration workflows for ingestion pipelines
- Maintain high availability and reliability of data pipelines and views
- Troubleshoot data issues and support production releases
Required Skills & Experience
- Strong hands-on experience with Snowflake (tables, views, performance tuning)
- Advanced SQL skills and data transformation expertise
- Experience building data ingestion pipelines (ETL/ELT)
- Experience working with cloud storage (e.g., AWS S3) and data integration patterns
- Understanding of data modeling for analytics (star schema, dimensional models)
- Experience with API-based ingestion and/or file-based ingestion pipelines
- Strong troubleshooting and data quality analysis skills
- Experience working in Agile POD/team environments
Success Measures
- Reliable and scalable ingestion pipelines into Snowflake SPN
- Timely onboarding of new data sources
- High-quality, validated curated views used by Power BI and downstream consumers
- Reduced data latency and improved data availability
- Strong alignment with business and reporting requirements