Data Engineer II, Prime Video Advertising

About the role

Prime Video is a first-stop entertainment destination offering customers a vast collection of premium programming in one app available across thousands of devices. As part of the Prime Video team, you’ll get to work on projects that are fast-paced, challenging, and varied. You’ll get to experiment with new possibilities, take risks, and collaborate with remarkable people.

Responsibilities

• Design and implement scalable, fault-tolerant data pipelines using AWS technologies and internal Amazon tools to extract, transform, and load data from multiple sources.
• Collaborate cross-functionally with Business Intelligence Engineers (BIEs), Data Scientists, Product Managers (PMs), and Software Development Engineers (SDEs) to understand data requirements and deliver customized data solutions.
• Automate infrastructure deployment with CI/CD pipelines and ensure streamlined processes for deployment and maintenance.
• Ensure data quality through robust validation, cleansing, and deduplication techniques.
• Implement data governance standards, including access control, encryption, data retention, deletion policies, and audit mechanisms to ensure compliance and security.
• Continuously improve and optimize data pipelines and infrastructure, staying up to date with emerging technologies and implementing automation and monitoring tools.
• Build a scalable and reliable data platform supporting analytics and experimentation for intuitive, self-service data products.
• Write high quality code and build scalable applications that interface with critical services and APIs to extract and process unstructured data.
• Build/operate highly available, distributed systems of data extraction, ingestion, and processing of large data sets.

Requirements

• Bachelor's degree
• 3+ years of data engineering experience
• Experience with data modeling, warehousing, and building ETL pipelines
• Knowledge of professional software engineering & best practices for full software development life cycle
• Experience with SQL
• Experience with distributed systems as it pertains to data storage and computing
• Experience with batch and streaming data architectures like Kafka, Kinesis, Flink, Storm, Beam
• Experience as a data engineer or related specialty (e.g., software engineer, business intelligence engineer, data scientist)
• Experience in at least one modern scripting or programming language, such as Python, Java, Scala, or NodeJS
• Experience with Apache Spark / Elastic Map Reduce

Qualifications

• Master's degree in computer science, engineering, analytics, mathematics, statistics, IT or equivalent
• Experience programming with at least one modern language such as C++, C#, Java, Python, Golang, PowerShell, Ruby
• Strong analytical skills, attention to detail, and effective communication abilities

Skills

• Experience with AWS technologies like Redshift, S3, AWS Glue, EMR, Kinesis, FireHose, Lambda, and IAM roles and permissions
• Experience with non-relational databases / data stores (object storage, document or key-value stores, graph databases, column-family databases)

Benefits

Amazon offers comprehensive benefits including health insurance, 401(k) matching, paid time off, and parental leave. Learn more about our benefits at https://amazon.jobs/en/benefits.