Senior Data Engineer

About the role

The Senior Data Engineer will design, build, operate, and improve large-scale data pipelines and foundational data products that power Komodo’s Healthcare Map. This is a hands-on engineering role focused on processing complex healthcare data at scale, improving reliability and performance, and contributing to the technical direction of core data systems.

Responsibilities

• Build, operate, and optimize large-scale production data pipelines using Python, SQL, Airflow, cloud infrastructure, and distributed processing frameworks.
• Transform massive healthcare claims, EHR, and reference datasets into trusted, performant Healthcare Map data products and serving-ready data assets.
• Strengthen pipeline reliability through data quality checks, validation, lineage, observability, monitoring, and alerting.
• Debug complex data, system, and performance issues across computationally intensive workflows.
• Persistently partner with Data Product Quality, Product, Platform, and Engineering teams to translate healthcare data needs into scalable technical solutions.
• Contribute to system design, architecture, code quality, testing, documentation, CI/CD, and rotational production support.
• Enable downstream analytics, product, and AI/ML use cases through high-quality, well-modeled, reliable data.

Requirements

• Healthcare data experience across claims, clinical, RWE, provider, patient, or life sciences datasets, including coding systems such as ICD-10, CPT, NDC, or NPI.
• Strong hands-on experience building, operating, and debugging production-grade data pipelines at scale.
• Advanced Python and SQL skills, with experience in Airflow or similar workflow orchestration tools.
• Experience with Spark or comparable distributed data processing frameworks.
• Proven experience designing and operating data solutions in AWS.
• Strong instincts for data quality, reliability, root-cause analysis, and production troubleshooting.
• Ability to communicate technical trade-offs clearly and collaborate with engineering, product, and data partners.
• Comfort using AI-assisted engineering tools for productivity, debugging, documentation, and technical exploration.

Qualifications

• Experience delivering external-facing data products through customers, APIs, serving layers, or production access patterns.
• Ability to optimize high-scale data architectures for performance, cost, versioning, and large-volume productization.
• Experience applying AI or agentic workflows to engineering, data quality, delivery, or operations.
• Success in high-growth or ambiguous environments that require balancing architecture, speed, and quality.

Skills

• Leverage AI-augmented engineering tools, such as ChatGPT, Gemini, or Claude, to improve productivity and technical decision-making.

Benefits

• Comprehensive health, dental, and vision insurance.
• Flexible time off and holidays.
• 401(k) with company match.
• Disability insurance and life insurance.
• Leaves of absence in accordance with applicable state and local laws and regulations and company policy.

Pay

• $180,000 - $207,000 USD for All Other US Locations.
• $207,000 - $238,000 USD for San Francisco Bay Area and New York City.

Schedule

• Open to US remote, OR SF/NYC hybrid.