Data Engineer , AWS Infrastructure Supply Chain Intelligence
About the role
You’ll join a diverse team of software, hardware, and network engineers, supply chain specialists, security experts, operations managers, and other vital roles. You’ll collaborate with people across AWS to help us deliver the highest standards for safety and security while providing seemingly infinite capacity at the lowest possible cost for our customers. And you’ll experience an inclusive culture that welcomes bold ideas and empowers you to own them to completion.
About The Team
This team provides data engineering and business intelligence engineering services to the rest of MOTOR. We are the data experts behind the scenes helping the operational teams focus on operations by ensuring they have accurate, timely data and provide business insights to help improve operational excellence.
Responsibilities
- Build and maintain the infrastructure to answer questions with data, using software engineering best practices, data management fundamentals, data storage principles, recent advances in distributed systems, and operational excellence best practices.
- Build datasets that analysts and scientists use to generate actionable insights.
- Define the data engineering processes that leverage various AWS services to improve accessibility, redundancy, data integrity, cost, and storage requirements.
- Develop high quality solutions for the faster development of the products/models that solve the business needs in a scalable format, while also anticipating future requirements.
- Collaborate with Research/Applied Scientists, Data Engineers, Business Intelligence Engineers, Data Scientists, Business Analysts, and Product/Program Managers to understand the business and technical requirements, and make decisions that help make the products/programs smoother.
- Interface with other technology/data engineering teams to extract, transform, and load data from a wide variety of data sources using AWS data technologies.
- Lead the technical design and implementation of the data infrastructure.
- Design and manage data audit, quality, and reconciliation processes in collaboration with various stakeholders.
Requirements
- 3+ years of data engineering experience
- Experience with data modeling, warehousing and building ETL pipelines
Qualifications
- Experience with AWS technologies like Redshift, S3, AWS Glue, EMR, Kinesis, FireHose, Lambda, and IAM roles and permissions
- Experience with non-relational databases / data stores (object storage, document or key-value stores, graph databases, column-family databases)