Senior Data Engineer

The Fellowship

You will be part of the Data, Analytics & AI team, collaborating closely with Infrastructure, Software Engineering, Product, and ML/AI engineers. We're in the middle of a GCP-native modernisation — migrating away from Snowflake toward BigQuery, Bigtable, Pub/Sub, and Dataflow — so we're looking for someone who's opinionated about clean architecture, allergic to over-engineering, and comfortable owning systems end-to-end.

Technology Tools

• Cloud & Warehouse: GCP, BigQuery, Bigtable, Cloud Storage
• Streaming & Messaging: Pub/Sub, Kafka
• Processing: Dataflow (Apache Beam), with Flink/Spark where appropriate
• Orchestration: Airflow (Cloud Composer)
• Analytical Store: ClickHouse
• Languages: Python, SQL
• Modelling & Quality: dbt, data quality gates
• Containers & CI/CD: Docker, Kubernetes, GitHub Actions / equivalent
• Legacy (being retired): Snowflake

Skills, Knowledge, and Experience

• Strong data modelling and warehouse architecture skills (dimensional modelling, event-driven, lakehouse patterns)
• Hands-on experience with GCP data services — BigQuery is a must; Pub/Sub, Dataflow, Bigtable, Cloud Composer are strong pluses
• Production experience with streaming pipelines on Dataflow/Beam, Flink, or Spark Structured Streaming, ingesting from Kafka and/or Pub/Sub
• Solid SQL and strong Python — you write production-quality code, not just notebooks
• Experience with ClickHouse or another columnar OLAP engine in production
• Workflow orchestration experience with Airflow (or Prefect/Dagster)
• Comfortable with dbt or equivalent transformation frameworks
• Experience migrating off legacy warehouses (Snowflake, Redshift, Synapse) onto cloud-native stacks is a plus
• Working knowledge of ML in production — feature engineering, feature stores, model deployment, drift monitoring, retraining
• Docker & Kubernetes experience
• CID/CD mindset, infrastructure-as-code sensibility, and a bias for simple, observable systems
• CDC tooling (Datastream, Debezium), Vertex AI / Feature Store

Benefits

• Comp: $140,000-160,000
• Medical, Dental & Vision (employee coverage 100% paid for by Hack The Box)
• 401K w/ employer match
• Employer-paid Life and AD&D Insurance
• Supplemental Life Insurance
• Short-term and Long-term Disability
• Healthcare and Dependent Care FSAs
• Paid parental leave
• 25 annual leave days
• Home Office Allowance
• Dedicated budget for training and professional development, participation in conferences
• State-of-the-art equipment
• Full access to the Hack The Box lab offerings; so you can learn how to hack 😉

Application Instructions

To complete the Quest of Becoming Hack The Box's Senior Data Engineer, follow these steps:

1. Complete level one's objective by submitting your application.
2. Meet the Talent Acquisition team.
3. Meet the hiring team and connect with them to share your achievements.
4. Complete 2 assignments that align with day-to-day job-related tasks and responsibilities, including a debriefing session with the hiring team.
5. Have a constructive, final conversation with senior leadership to explore the role and your future at HTB.
6. Accept the offer.