Senior Data Engineer

What You'll Do

• Work with our traders to understand analytic needs to improve trading performance.
• Design and maintain a modular data architecture to facilitate and scale future analysis.
• Ensure high data quality for all analytical trading datasets.
• Hold other team members to data standards, including modular design, testing, and documentation.
• Hold other team members to visual standards, including modular design, testing, and documentation.
• Ensure technical solutions are simple and scale well for future use cases.

What You'll Need

• Experience designing and developing big data warehouses and ETL pipelines.
• Proven knowledge of SQL and Python.
• Demonstrated ability to navigate and integrate data across multiple data platforms, including RDBMS, NoSQL, and Time Series.
• Experience with real time messaging systems, such as Kafka, Kinesis, and Pulsar, and with developing a stream processing framework, such as Flink or Spark, a plus.
• Proficiency in crafting high-performance BigQuery queries, optimizing for efficiency and scalability to handle large datasets effectively.
• Excellent verbal and written communication, analytical, and problem-solving skills.