Senior Data Engineer

The fellowship you’ll be joining

You will be part of the Data, Analytics & AI team, collaborating closely with Infrastructure, Software Engineering, Product, and ML/AI engineers. We're in the middle of a GCP-native modernisation — migrating away from Snowflake toward BigQuery, Bigtable, Pub/Sub, and Dataflow — so we're looking for someone who's opinionated about clean architecture, allergic to over-engineering, and comfortable owning systems end-to-end. If retiring a legacy warehouse and standing up its replacement sounds like a good time, you'll fit right in.

Technology tools & weapons you’ll be using

• Cloud & warehouse: GCP, BigQuery, Bigtable, Cloud Storage
• Streaming & messaging: Pub/Sub, Kafka
• Processing: Dataflow (Apache Beam), with Flink/Spark where appropriate
• Orchestration: Airflow (Cloud Composer)
• Analytical store: ClickHouse
• Languages: Python, SQL
• Modelling & quality: dbt, data quality gates
• Containers & CI/CD: Docker, Kubernetes, GitHub Actions / equivalent
• Legacy (being retired): Snowflake

Skills, knowledge, and experience points required to unlock the role of the Senior Data Engineer at Hack The Box

• Strong data modelling and warehouse architecture skills (dimensional modelling, event-driven, lakehouse patterns)
• Hands-on experience with GCP data services — BigQuery is a must; Pub/Sub, Dataflow, Bigtable, Cloud Composer are strong pluses
• Production experience with streaming pipelines on Dataflow/Beam, Flink, or Spark Structured Streaming, ingesting from Kafka and/or Pub/Sub
• Solid SQL and strong Python — you write production-quality code, not just notebooks
• Experience with ClickHouse or another columnar OLAP engine in production
• Workflow orchestration experience with Airflow (or Prefect/Dagster)
• Experience with dbt or equivalent transformation frameworks
• Experience migrating off legacy warehouses (Snowflake, Redshift, Synapse) onto cloud-native stacks is a plus
• Working knowledge of ML in production — feature engineering, feature stores, model deployment, drift monitoring, retraining
• Docker & Kubernetes experience
• CID/CD mindset, infrastructure-as-code sensibility, and a bias for simple, observable systems
• CDC tooling (Datastream, Debezium), Vertex AI / Feature Store

The gems you’ll be enjoying as a Senior Data Engineer at Hack The Box

• Comp: $140,000-160,000
• Medical, Dental & Vision (employee coverage 100% paid for by Hack The Box)
• 401K w/ employer match
• Employer-paid Life and AD&D Insurance
• Supplemental Life Insurance
• Short-term and Long-term Disability
• Healthcare and Dependent Care FSAs
• Paid parental leave
• 25 annual leave days
• Home Office Allowance
• Dedicated budget for training and professional development, participation in conferences
• State-of-the-art equipment
• Full access to the Hack The Box lab offerings; so you can learn how to hack 😉