Data Engineer - Remote

About The Company

Humana Inc. (NYSE: HUM) is a leading healthcare organization dedicated to making it easier for individuals and families to achieve their best health. With a comprehensive portfolio that includes insurance services through Humana and healthcare services via CenterWell, the company is committed to delivering high-quality, accessible care across the United States. Humana's innovative approach focuses on integrating data-driven solutions and modern technology to enhance healthcare delivery, improve patient outcomes, and foster healthier communities. The organization values diversity, inclusion, and a culture of continuous improvement, striving to create a supportive environment where employees can thrive and contribute meaningfully to the company's mission of personalized, compassionate care.

About The Role

The Lead Data Engineer at Humana will play a pivotal role in shaping and maintaining the data foundation of the NBA platform on the Databricks Lakehouse architecture. This position involves overseeing the design, development, and operational management of scalable data pipelines, feature layers, and streaming architectures that support decision intelligence, machine learning, reinforcement learning, agentic AI, and real-time decision-making processes. The successful candidate will lead a small team of engineers and contractors, providing technical guidance while remaining actively involved in building and evolving data pipelines, data quality controls, and governance practices. This role demands a strategic thinker with deep technical expertise and strong leadership skills to ensure the platform's reliability, security, and compliance, especially within regulated healthcare environments. The Lead Data Engineer will collaborate cross-functionally with data science, decision intelligence, AI engineering, and platform teams to deliver high-quality, governed data assets that drive innovation and operational efficiency across the organization.

Qualifications

• Bachelor's degree in computer science, information technology, or a related field
• 7+ years of experience in data engineering, with at least 1-2 years in a lead or senior technical role
• Expert-level proficiency in SQL and Python programming languages
• Extensive experience with Spark-based data platforms and Databricks environments
• Deep understanding of modern Lakehouse architectures, including Delta Lake and Medallion Architecture (Bronze/Silver/Gold)
• Proven experience designing and managing large-scale batch and streaming data pipelines
• Strong knowledge of data quality engineering, validation frameworks, lineage, and observability tools
• Experience with data governance, compliance standards (PHI, HIPAA), and secure data management practices
• Demonstrated ability to lead and mentor engineering teams, fostering best practices and technical excellence
• Excellent communication skills, capable of translating complex technical concepts to diverse stakeholders

Responsibilities

• Own end-to-end delivery of data engineering projects, including planning, execution, quality assurance, and operational readiness
• Design and evolve the NBA Databricks Lakehouse architecture, establishing standards for data layers, lineage, and governance
• Build and maintain scalable batch and real-time data pipelines processing diverse datasets such as clinical, claims, behavioral, and socioeconomic data
• Lead the development and management of Gold-layer feature tables and reusable data products supporting machine learning and decision intelligence workloads
• Implement streaming ingestion and processing patterns using Kafka, Spark Structured Streaming, and related technologies for near real-time decision-making
• Establish platform-wide data quality, validation, monitoring, and observability standards, treating data issues as production incidents
• Optimize Spark workloads, storage patterns, and query performance to support enterprise-scale data volumes efficiently
• Ensure compliance with regulatory requirements through data governance tools such as Unity Catalog and lineage tracking
• Lead, mentor, and review the work of engineers and contractors, promoting best practices and continuous improvement
• Collaborate with cross-functional teams including Decision Intelligence, Data Science, AI Engineering, and Platform teams to ensure seamless, governed data delivery across the ecosystem

Benefits

• Competitive salary within the range of $142,300 - $195,700 annually, with eligibility for performance-based bonuses
• Comprehensive health benefits including medical, dental, and vision coverage
• Retirement savings plans such as 401(k) with company matching
• Paid time off, holidays, and parental leave to support work-life balance
• Short-term and long-term disability insurance, life insurance, and wellness programs
• Opportunities for professional development and career growth within a supportive environment
• Flexible work arrangements including remote and hybrid options, with occasional travel for training and meetings