Senior Data Engineer
Tatari · New York, NY · 3 wk ago
HybridInformation Technology$170k–$200k/yrFull-time
About the role
As a Senior Data Engineer in our Reporting and Measure pillar, you will design, build, and own the large-scale data pipelines that turn high-volume raw data into curated, production-grade datasets powering Tatari’s reporting and measurement products. You will be responsible for taking data products from requirements through tech spec, implementation, validation, and production rollout—partnering closely with data science on methodology, backend and frontend engineers on serving layers, and product on requirements.
Responsibilities
- Design, build, and operate production ETL pipelines at scale.
- Develop and maintain large-scale data pipelines that transform raw data into curated datasets.
- Own data products end-to-end, from requirements gathering to production rollout.
- Collaborate with data science, backend/frontend engineers, and product teams.
- Ensure rigorous data quality through validation, reconciliation, and methodology comparison.
- Debug and optimize distributed data systems for performance and reliability.
- Create and maintain tech specs, documentation, and incident writeups.
Requirements
- 5+ years of dedicated experience designing, building, and operating production ETL pipelines at scale.
- Strong programming skills in Python (or a similar language) and SQL.
- Deep hands-on experience with Spark/PySpark, Databricks, and Delta Lake.
- Experience with workflow orchestration tools such as Airflow, including DAG design, backfills, and failure recovery.
- Strong data modeling skills for analytics, including curated/gold-layer datasets, schema design, partitioning, and data contracts.
- Interest in agentic developer workflows, such as testing agent harnesses, building them, and agent loop engineering.
- Proven track record of owning datasets end-to-end in a cross-functional environment.
- Strong written communication and collaboration skills.
Benefits
- Total compensation: $170,000–200,000 annually, plus equity.
- Health insurance coverage for you and your dependents.
- 401K, FSA, and commuter benefits.
- $150 monthly spending account.
- $1,000 annual continued education benefit.
- $500 Newbie Productivity Perk.
- Unlimited PTO and sick days.
- Monthly Company Wellness Day Off.
- Snacks, drinks, and catered lunches at the office.
- Team-building events.
Schedule
Hybrid RTO of 2 days per week in the office.