Data Engineer II, Prime Video Advertising

About the role

The Prime Video team is looking for a highly skilled and technically adept Data Engineer to join our PVA Data Engineering team. This role involves designing, building, and maintaining scalable, fault-tolerant data pipelines and infrastructure to support data-driven insights. You will leverage native AWS technologies and Amazon’s internal tools to handle data ingestion, transformation, integration, and ensure high standards of data quality through validation, cleansing, and deduplication.

Responsibilities

• Design and implement scalable, fault-tolerant data pipelines using AWS technologies and internal Amazon tools to extract, transform, and load data from multiple sources.
• Collaborate cross-functionally with Business Intelligence Engineers (BIEs), Data Scientists, Product Managers (PMs), and Software Development Engineers (SDEs) to understand data requirements and deliver customized data solutions.
• Automate infrastructure deployment with CI/CD pipelines and ensure streamlined processes for deployment and maintenance.
• Ensure data quality through robust validation, cleansing, and deduplication techniques.
• Implement data governance standards, including access control, encryption, data retention, deletion policies, and audit mechanisms to ensure compliance and security.
• Continuously improve and optimize data pipelines and infrastructure, staying up to date with emerging technologies and implementing automation and monitoring tools.
• Build a scalable and reliable data platform supporting analytics and experimentation for intuitive, self-service data products.
• Write high quality code and build scalable applications that interface with critical services and APIs to extract and process unstructured data.
• Work with a range of data technologies, including Python, EMR, Spark, Iceberg, Airflow, and many AWS data services like Glue, Athena, Redshift to create end-to-end pipelines that consolidate data from disparate systems.

Requirements

• Bachelor's degree
• 3+ years of data engineering experience
• Experience with data modeling, warehousing, and building ETL pipelines
• Experience with SQL
• Knowledge of professional software engineering & best practices for full software development life cycle
• Knowledge of distributed systems as it pertains to data storage and computing
• Knowledge of batch and streaming data architectures like Kafka, Kinesis, Flink, Storm, Beam
• Experience as a data engineer or related specialty (e.g., software engineer, business intelligence engineer, data scientist)
• Experience in at least one modern scripting or programming language, such as Python, Java, Scala, or NodeJS
• Experience with Apache Spark / Elastic Map Reduce

Qualifications

• Bachelor's degree
• Master's degree in computer science, engineering, analytics, mathematics, statistics, IT or equivalent
• Experience programming with at least one modern language such as C++, C#, Java, Python, Golang, PowerShell, Ruby
• Experience building/operating highly available, distributed systems of data extraction, ingestion, and processing of large data sets
• Experience that includes strong analytical skills, attention to detail, and effective communication abilities, or experience in technical support

Benefits

Final compensation will be determined based on factors including experience, qualifications, and location. Amazon offers comprehensive benefits including health insurance, 401(k) matching, paid time off, and parental leave. Learn more about our benefits at https://amazon.jobs/en/benefits.