ETL Engineer
MedReview Inc. · New York, NY · 2 mo ago
On-siteEducation$120/hrFull-time
Responsibilities
- Design and develop ETL pipelines using SSIS, Azure Data Factory, and Databricks
- Build and optimize ClickHouse ingestion pipelines (batch + streaming)
- Develop transformations for structured and semi-structured data
- Optimize SQL Server and ClickHouse queries for performance and scalability
- Improve data models, partitions, and materialized views in ClickHouse
- Integrate data from multiple sources (APIs, SQL Server, cloud storage, Kafka/Event Hubs)
- Maintain and monitor pipeline performance to ensure low latency and high reliability
- Implement data quality checks, error handling, and lineage tracking
- Partner with BI teams to support dashboards (Power BI, etc.)
Requirements
- Strong hands-on experience in ETL tools such as Azure Data Factory, SSIS, and Databricks
- Proficiency in writing, optimizing, and troubleshooting complex SQL queries
- Experience with ClickHouse (including schema design, ingestion, and optimization)
- Experience with cloud environments, particularly Azure
- Programming skills in Python or Scala for data processing
Nice to Have
- Experience with streaming data technologies like Kafka and Event Hubs
- Exposure to big data frameworks
- Understanding of DevOps and data pipeline deployment practices
- Experience supporting BI tools such as Power BI and Tableau
- Ability to independently build and optimize ETL pipelines
- Knowledge of making data systems faster, cleaner, and more scalable
- Comfortable working across engineering, analytics, and business teams
- Proactive identification and resolution of performance issues
Pay
$120-130K
Schedule
On-site role Monday - Thursday with remote Fridays