Equities Data Engineer
DRW · New York, NY · 1 wk ago
On-siteEngineering$175k–$200k/yrFull-time
Key Responsibilities
- Partner with traders, researchers, and analysts to deliver well-structured data that powers trading strategies, predictive models, and AI/ML applications.
- Build, automate, and maintain resilient pipelines for cleaning, validating, and transforming batch and streaming data that feed into medallion architectures.
- Develop observability, monitoring, and alerting tools to provide complete visibility into pipeline reliability and performance.
- Optimize tiered data storage and elastic processing across on-prem, cloud, and hybrid environments to ensure scalable and cost-effective solutions.
- Enforce data governance, controls, and security standards to preserve confidentiality and operational integrity.
- Implement data quality frameworks (validation, reconciliation, anomaly detection) to detect gaps, staleness, and corporate action/market data inconsistencies.
- Maintain point-in-time correctness across datasets used for research and live trading; ensure reproducibility of signals and backtests.
- Collaborate with platform/infrastructure teams to productionize pipelines, improve runtime efficiency, and meet latency and availability requirements.
Qualifications
- Over five years of demonstrated experience designing ingestion pipelines.
- Familiarity with equities, equity indices, futures, or delta one trading data preferred.
- Experience processing real-time and batch financial market data.
- Proven ability to work in an agile, fast-paced environment and handle trading environment demands.
- Strong understanding of financial point-in-time and time-series data and analysis.
- Proven expertise in developing data quality control processes to detect gaps or inaccuracies.
- Experience with monitoring, observability, and alerting systems for data pipelines.
- C competent in both on-premise Linux systems and cloud platforms.
- Proficient in automated testing, CI/CD practices, and MLOps.
- Well-versed in compressed and optimized file formats such as Parquet and Iceberg.
Pay
The annual base salary range for this position is $175,000 to $200,000 depending on the candidate’s experience, qualifications, and relevant skill set. The position is also eligible for an annual discretionary bonus.
Benefits
DRW offers a comprehensive suite of employee benefits including group medical, pharmacy, dental and vision insurance, 401k (with discretionary employer match), short and long-term disability, life and AD&D insurance, health savings accounts, and flexible spending accounts.