Data Engineer

Responsibilities

• Develop and automate large scale, high-performance data platform pipelines and infrastructure to drive business growth and enable data-driven decision making.
• Design and develop reusable components and frameworks for ingestion, cleansing, and data quality.
• Streamline the ingestion of raw data from various sources into our Data Lake and Data Warehouse.
• Design data models for optimal storage and retrieval that represent the tangible business domains across ecosystem.
• Cook up close with the Operations, Sales, and Product Development teams daily to push FinTech strategy and improve the overall profitability of the business.

Qualifications

• 6+ years of professional experience in a data engineering or data-driven software engineering role
• Exceptional Python and SQL skills
• Extensive experience with orchestration frameworks (Prefect, Airflow, Dagster, etc.)
• Deep understanding of OLAP (Snowflake, Databricks) and OLTP (PostgreSQL, MongoDB) databases and ELT frameworks (dbt, dlthub)
• Experience developing and deploying code to Cloud environments (AWS, GCP, Azure)
• Possess a strong grasp of object-oriented and functional programming and an ability to write easy-to-scale, high-quality code
• Experience leveraging stream processing frameworks (Kafka, Flink, Spark)
• Knowledge of infrastructure-as-code frameworks (terraform or cloud formation)
• Detail-oriented and able to multitask and work in a fast-paced environment
• Able to work independently while also being a strong team player
• Excellent written and verbal communication
• Passionate about learning and mastering cutting-edge technologies
• Professional experience with JVM based languages such as Scala, Java, and Kotlin is preferred
• Knowledge of financial markets and financial instruments is preferred