Senior Data Engineer

Responsibilities

• Design and develop batch and streaming data pipelines using cloud technologies (GCP, AWS, BigQuery, Snowflake, etc).
• GCP and BigQuery experience preferred.
• Build, maintain, and optimize data models and dimensional warehouses to support analytics and BI tooling as well as other operational workflows.
• Design and develop robust ETL/ELT processes for ingesting, transforming, and validating terabytes of structured data.
• Troubleshoot complex data pipeline issues to determine root cause and corrective actions.
• Research, analyze, recommend, and implement technical approaches for solving complex data transformation and integration problems within a Medallion data warehouse architecture.
• Collaborate with business analysts, data scientists, and stakeholders to understand complex data problems and translate business requirements into technical solutions and a structured backlog.
• Lead and mentor other data engineers to follow the team’s evolving data engineering standards and best practices.
• Analyze, support and improve the performance, reliability, and scalability of our data infrastructure.
• Define and Implement data quality, data governance, privacy-first practices, and validation mechanisms to ensure accuracy and compliance (e.g., GDPR).
• Document pipelines, systems, and workflows to improve our internal data catalog.
• Stay current with emerging technologies and evaluate their relevance in our stack.

Qualifications

• 8+ years of professional data engineering and programming skills building scalable ETL/ELT systems.
• Degree in Computer Science or related field, or equivalent practical experience.
• 6+ years of experience with Python and SQL.
• Advanced analytical problem solving and troubleshooting skills.
• Extensive experience working with cloud data warehouses (e.g. BigQuery or Snowflake), and Google Data tools (DataFlow, DataForm, Pub/Sub, GCS).
• 3+ years of experience with Airflow (Cloud Composer), data modeling (star/relational schema), and test case development.
• Solid understanding of columnar vs. row-based storage solutions and when to use each (e.g., Snowflake vs. Postgres).
• 3+ years experience writing design documents and breaking work down into a well-structured backlog.
• Proven ability to work in agile, cross-functional teams.
• Excellent verbal and written communication skills; a team player who enjoys learning and teaching.
• Willingness to dig into “why” to help build the right solutions and data products for our business to scale our data capabilities.