Senior Data Engineer
Ampcus Inc · Seattle, WA · 2 mo ago
Information TechnologyFull-time
About the role
Ampcus Inc. is seeking a Senior Data Engineer to join our talented team. The ideal candidate will be responsible for developing and maintaining automated ETL pipelines, implementing and supporting reporting and analytics infrastructure, and developing data security and permissions solutions.
Responsibilities
- Develop and maintain automated ETL pipelines (with monitoring) using scripting languages such as Python, Spark, SQL and AWS services such as S3, Glue, Lambda, SNS, SQS, KMS.
- Implement and support reporting and analytics infrastructure for internal business customers.
- Develop and maintain data security and permissions solutions for enterprise scale data warehouse and data lake implementations including data encryption and database user access controls and logging.
- Develop data objects for business analytics using data modeling techniques.
- Develop and optimize data warehouse and data lake tables using best practices for DDL, physical and logical tables, data partitioning, compression, and parallelization.
- Develop and maintain data warehouse and data lake metadata, data catalog, and user documentation for internal business customers.
- Work with internal business customers and software development teams to gather and document requirements for data publishing and data consumption via data warehouse, data lake, and analytics solutions.
Requirements
- Fixing automation issues daily
- Quality of works / fixes
Qualifications
- 5 years of data engineering experience
- Experience with data modeling, warehousing and building ETL pipelines
- Experience with SQL
- Experience in at least one modern scripting or programming language, such as Python, Java, Scala, or NodeJS
- Mentoring team members on data engineering best practices