Data Engineer
Haystack · New York, United States · 2 mo ago
RemoteRemoteInformation TechnologyFull-time
About the Role
Develop, maintain, and optimize SQL-based ETL processes, stored procedures, and data transformations across various platforms. Define enterprise data engineering architecture and technology standards. Build and maintain data pipelines using tools like IBM DataStage and UNIX scripting. Govern platform health, including capacity planning, performance benchmarks, and disaster recovery compliance. Lead workload rationalization to consolidate, retire, or re-engineer data pipelines. Monitor pipeline health, detect anomalies, and resolve data quality and availability issues.
Requirements
- Bachelor's degree in Engineering, Statistics, Mathematics, Computer Science, Data Science, Economics, or a related quantitative field
- AWS certification (Data Engineer Professional, Solutions Architect Professional, or equivalent)
- 8+ years of data engineering experience with deep expertise in enterprise ETL/ELT architecture
- Expert-level SQL proficiency in IBM DB2 and SQL Server, including complex schema design and query optimization
- Expert-level IBM DataStage experience, including architecture, parallel job design, and performance tuning
- Proven AWS data engineering experience in S3, Glue, RDS, Redshift, Lambda, and IAM-governed data access
Benefits
- Comprehensive benefits including medical, dental, and vision insurance
Additional Opportunities
- Opportunity to work on large-scale enterprise data platforms
- Engagement in modern data stack adoption initiatives
- Collaborative environment with downstream analytics consumers