Data Engineer - Cloudera & AWS Lakehouse

About the role

Be part of a team that unleashes the power of leading-edge technologies to help improve the health and well-being of those most vulnerable in our country and communities. As a Data Engineer specializing in Cloudera & AWS Lakehouse, you will contribute your skills to harness technology that improves healthcare for vulnerable populations.

Responsibilities

• Head up technical teams and workstreams to design, develop, test, and install complex database applications with server, client, and web components.
• Oversee relationships between application architects and developers to ensure design requirements result in flexible, reusable system components.
• Write highly complex design, coding, and testing documentation to create purpose-built technical products that meet real client needs.
• Serve as a subject-matter expert in development, domain, application design, and database methodologies and best practices.
• Provide technical consulting on highly complex projects, refining existing applications and designing new modules and components.
• Mentor and guide less experienced application designers.

Requirements

• 5+ years of hands-on experience with Cloudera Data Platform, including data processing, data governance, and cluster management.
• 5+ years of advanced PySpark development experience, building, optimizing, and maintaining large-scale data pipelines.
• 5+ years of AWS data engineering experience, including Spark workload management across EMR, Glue, and S3-based data lake environments.
• 5+ years of Apache Iceberg knowledge, including Lakehouse table management, schema evolution, performance optimization, and Spark integration.
• 5+ years of Airflow orchestration experience, including DAG development, workflow monitoring, and integration with AWS services such as S3, EMR, Lambda, and CloudWatch.

Location & Schedule

This is a remote position based in or near Irving, Texas (225 E John W Carpenter Fwy Ste 500, Irving, TX 75062). Travel may be required (0-10%). A flexible schedule is expected to accommodate business needs and occasional travel.

Video cameras must be used during all interviews and the initial week of orientation.

Pay

The pay range for this position is $90,900.00 - $129,900.00 per year. Base pay may vary depending on geographic region, internal equity, job-related knowledge, skills, and experience.

Benefits

• Generous, flexible vacation policy.
• 401(k) employer match.
• Comprehensive health benefits.
• Educational assistance.
• Leadership and technical development academies to build skills and capabilities.