AWS Data Engineer
Grinteq · New York, NY · 9 mo ago
Information TechnologyContract
Responsibilities and duties
- Design, implement, and support a platform providing secured access to large datasets.
- Develop and maintain end to end scalable data infrastructure and data pipelines.
- Design and implement routines to extract, transform, and load data from a wide variety of data sources using Python, SQL, scripting, and AWS big data technologies.
- Design and implement complex ETL pipelines and other BI solutions.
- Work closely with product owners, developers, and data strategists to explore new data sources and deliver the data.
Qualifications and skills
- At least 3- 5 years of hands-on experience in developing data ingestion, data processing and analytical pipelines for big data, relational databases, NoSQL, and data warehouse solutions on AWS Cloud Platform.
- AWS data services experience in particular AWS Glue, Lambda, RDS PostgreSQL, S3, Redshift, Athena, and other data infrastructure automation services.
- Experience with scripting in a serverless architecture using Python.
- Experience with Data modeling, querying, and optimization for relational, NoSQL, data warehouses and data lakes.
- Experience working with data lake and federated data architectures.
Nice to Have
- Knowledge of AWS step functions or similar orchestration tool.
- Experience with Visual Studio Code, Docker and Git.
What we offer
A decent salary level, which allows you to think about our mutual success and not about tomorrow.
Flexible working hours. You create your own schedule.
Possibility to work remotely. You prefer home office or traveling around? Easy, that's exactly how we operate.