AWS Data Engineer
Haystack · Atlanta, GA · 1 mo ago
On-siteInformation TechnologyFull-time
About the role
Develop and maintain scalable data pipelines using AWS services. Implement large-scale data processing solutions with Python and PySpark. Design and optimize SQL queries for data modeling and extraction. Ensure data quality and integrity through robust ETL practices. Collaborate with teams on version control and CI/CD workflows.
What You'll Need
- Strong experience with Python and PySpark for large-scale data processing
- Proven hands-on experience with AWS services like Lambda, SNS, SQS, Glue, Redshift, and Step Functions
- Solid SQL skills and familiarity with data modeling and query optimization
- Experience with ETL best practices, data quality checks, and monitoring/alerting
- Familiarity with version control (Git) and basic DevOps/CI-CD workflows