Data Engineer
Jobot · Chicago, IL · 3 wk ago
On-siteInformation Technology$180k–$250k/yrFull-time
This role is hosted by Jim Quirk.
About us
We are a fast-growing, tech-driven firm operating in a fast-paced market environment where data is central to our competitive edge. Our technology organization values high-performance engineering, hybrid-cloud scalability, and rigorous data quality. We foster a collaborative, Agile culture where engineers enjoy deep technical ownership, mentor peers, and directly impact mission-critical operations.
Why join us?
Drive High-Impact Innovation: You will have full ownership of the architecture, pushing our data platform beyond current tech limits to support rapid business growth.
Responsibilities
- Work within a growing Data Engineering division supporting the strategic role of data at the firm.
- Drive the ongoing design and expansion of our data platform across a wide variety of data sources, supporting an array of streaming, operational, and research workflows.
- Work closely with Trading, Quant, Technology, and Business Operations teams throughout the firm to identify how data is produced and consumed, helping to define and deliver high-impact projects.
- Build and deploy batch and streaming pipelines to collect and transform our rapidly growing Big Data set within our hybrid cloud architecture utilizing Kubernetes/EKS, Kafka/MSK, and Databricks/Spark.
- Mentor junior engineers in software and data engineering best practices.
- Produce clean, well-tested, and documented code with a clear design to support mission-critical applications.
- Build automated data validation test suites that ensure data is processed and published in accordance with well-defined Service Level Agreements (SLAs) pertaining to data quality, data availability, and data correctness.
- Challenge the status quo and help push our organization forward as we grow beyond the limits of our current tech stack.
Requirements
- BS/MS/PhD in Computer Science, Engineering, Physics, Math, or equivalent technical field.
- 5+ years of professional experience developing software applications.
- Java/Scala experience required; Python experience is a significant plus.
- Highly motivated and willing to take ownership of high-impact projects upon arrival.
- Prior hands-on experience with data platforms and technologies such as Delta Lake, Spark, Kubernetes, Kafka, ClickHouse, and/or Presto/Trino.
- Experience building large-scale batch and streaming pipelines with strict SLA and data quality requirements.
- Must possess excellent communication, analytical, and problem-solving skills.
- Demonstrated experience working with diverse data sets and frameworks across multiple domains—financial data experience is not required, but a strong plus.
- Recent hands-on experience with AWS Cloud development, deployment, and monitoring necessary.
- Demonstrated experience working on an Agile team employing software engineering best practices, such as GitOps and CI/CD, to deliver complex software projects.
- The ability to react quickly and accurately to rapidly changing market conditions, including the ability to quickly and accurately respond and/or solve math and coding problems, are essential functions of the role.
Pay
$180,000 - $250,000 per year