Aws Data Engineer

About the role

Principal AWS Data Engineer: a top‑level technical leader who designs, builds, and manages large‑scale, cloud‑native data platforms and pipelines using Amazon Web Services. The role is hands‑on for the Retirement Partners project, overseeing and leading the data team (equivalent to a VP) while requiring 10+ years of experience and the ability to work directly with the team on a day‑to‑day basis. Position is hybrid, based in Fort Mill, SC.

Responsibilities

• Design, build, and manage large‑scale cloud‑native data platforms and pipelines using AWS services (Glue, S3, Apache Iceberg, Snowflake, ETL/ELT).
• Lead and mentor the data engineering team, providing technical direction and hands‑on support.
• Ensure data solutions are scalable, secure, and high‑performance.
• Implement Infrastructure as Code (Terraform, CloudFormation, CDK).
• Establish CI/CD pipelines and DevOps practices.
• Enforce data governance, data quality, and security controls.
• Support AI/ML and Generative AI initiatives through modern data architectures.
• Work with streaming technologies such as Kafka and Kinesis.
• Collaborate with stakeholders in financial services, wealth management, brokerage, banking, or fintech domains.

Required Qualifications

• 10+ years of Data Engineering experience.
• 5+ years designing and implementing AWS‑based data solutions.
• Deep expertise with AWS Glue and cloud‑native ETL frameworks.
• Hands‑on experience with Apache Iceberg in production environments.
• Strong Snowflake architecture and engineering experience.
• Experience building enterprise‑scale data lake and lakehouse platforms.
• Advanced SQL and data modeling expertise.
• Strong programming skills in Python and/or Scala.
• Experience with Infrastructure as Code (Terraform, CloudFormation, CDK).
• Experience with CI/CD pipelines and DevOps practices.
• Strong understanding of data governance, data quality, and security controls.

Preferred Qualifications

• Experience within financial services, wealth management, brokerage, banking, or fintech organizations.
• Knowledge of advisor, client, trading, operational, compliance, and regulatory data domains.
• Experience supporting AI/ML and Generative AI initiatives through modern data architectures.
• Experience with Kafka, Kinesis, or other streaming technologies.
• Familiarity with Databricks or Spark‑based ecosystems.
• AWS Certified Data Engineer, AWS Solutions Architect, or similar cloud certifications.

Skills

• AWS
• ETL
• Snowflake
• Glue
• Apache Iceberg
• S3

Benefits

• Medical, dental & vision
• Critical Illness, Accident, and Hospital
• 401(k) Retirement Plan (Pre‑tax and Roth post‑tax contributions available)
• Life Insurance (Voluntary Life & AD&D for employee and dependents)
• Short and long‑term disability
• Health Spending Account (HSA)
• Transportation benefits
• Employee Assistance Program
• Time Off/Leave (PTO, Vacation or Sick Leave)

Pay

The pay range for this position is $60.00 - $87.00/hr. Individual compensation offered for this position within this range will depend on many factors, including qualifications, skills, relevant experience, job knowledge, geographic location, internal equity, and other pertinent job‑related factors.