Lead Cloud Data Engineer

Responsibilities

• Design and develop scalable ETL pipelines using AWS Glue and PySpark.
• Integrate data from various sources into Amazon Redshift, ensuring data quality and consistency.
• Optimize the performance of data processing jobs and Redshift queries.
• Deploy infrastructure as code (IaC) with Terraform.
• Monitor and troubleshoot data pipelines to ensure reliability and efficiency.
• Collaborate with data scientists, analysts, and other stakeholders to understand data requirements.
• Ensure compliance with security policies and regulations.
• Document data workflows and best practices.
• Mentor and guide junior engineers on the team.
• Continuously explore new AWS services and technologies to improve existing solutions.

Requirements

• Expert level experience with AWS Cloud Services is preferred, knowledge of other Cloud Providers is a plus.
• Experience and understanding of AWS Cloud Services components like Redshift, S3, Kafka, Glue, AirFlow, SageMaker, EMR, Athena, Lake Formation, DynamoDB, Aurora, VPC, IAM and many other Cloud Service modules.
• Working experience in Python is preferred, Java and other languages are a plus.
• Nice to have Terraform or other Infrastructure as Code experience.
• Knowledge and experience with Analytics, Data Warehouse and Big Data concepts across both batch and streaming patterns.
• Solid understanding of networking, infrastructure, cost management, SRE concepts.
• Create patterns for adoption from scratch and be able to document and articulate coding and architecture standards for others to follow.
• Performance tuning and optimization of code and infrastructure.
• Create a culture of continuous improvement, performs code reviews and makes recommendations for improvement or streamlining patterns.
• Relevant experience in various database platforms, ETL solutions/products, Infrastructure, ETL architecture and On-Prem or Cloud Services.
• Financial Services Industry knowledge is a plus.
• Ability To Identify and understand issues, problems and opportunities for automation.
• Good communication and organization skills that clearly convey information and ideas through a variety of media to individuals or groups in a manner that engages the audience and helps them understand and retain the message.
• Use effective approaches for choosing a course of action or developing appropriate solutions; recommend or take action that is consistent with available facts, constraints and probable consequences.
• Demonstrate a satisfactory level of technical and professional skill or knowledge in position-related areas; remains current with developments and trends in areas of expertise.
• Develop and use collaborative relationships to facilitate the accomplishment of work goals.
• Make internal and external clients and their needs a primary focus of actions; develop and sustain productive client relationships.

Qualifications

• Bachelor’s: Computer and Information Science (Required).

Skills

• Expert level experience with AWS Cloud Services is preferred, knowledge of other Cloud Providers is a plus.
• Experience and understanding of AWS Cloud Services components like Redshift, S3, Kafka, Glue, AirFlow, SageMaker, EMR, Athena, Lake Formation, DynamoDB, Aurora, VPC, IAM and many other Cloud Service modules.
• Working experience in Python is preferred, Java and other languages are a plus.
• Nice to have Terraform or other Infrastructure as Code experience.
• Knowledge and experience with Analytics, Data Warehouse and Big Data concepts across both batch and streaming patterns.
• Solid understanding of networking, infrastructure, cost management, SRE concepts.
• Create patterns for adoption from scratch and be able to document and articulate coding and architecture standards for others to follow.
• Performance tuning and optimization of code and infrastructure.
• Create a culture of continuous improvement, performs code reviews and makes recommendations for improvement or streamlining patterns.
• Relevant experience in various database platforms, ETL solutions/products, Infrastructure, ETL architecture and On-Prem or Cloud Services.
• Financial Services Industry knowledge is a plus.
• Ability To Identify and understand issues, problems and opportunities for automation.
• Good communication and organization skills that clearly convey information and ideas through a variety of media to individuals or groups in a manner that engages the audience and helps them understand and retain the message.
• Use effective approaches for choosing a course of action or developing appropriate solutions; recommend or take action that is consistent with available facts, constraints and probable consequences.
• Demonstrate a satisfactory level of technical and professional skill or knowledge in position-related areas; remains current with developments and trends in areas of expertise.
• Develop and use collaborative relationships to facilitate the accomplishment of work goals.
• Make internal and external clients and their needs a primary focus of actions; develop and sustain productive client relationships.

Benefits

• The total compensation for this position includes base salary or wages, and may include components such as additional compensation (cash or equity), discretionary bonuses, or commissions.
• This position is eligible for a benefits package that may include medical, dental, and vision; life insurance; critical illness insurance and accident insurance; disability benefits; retirement savings; paid time off (including vacation, holidays, and sick leave); and parental leave.
• Eligibility for benefits and specific offerings may vary based on position and employment status.
• To view more details of the benefits offered, visit Myrjbenefits.com.

Pay

• The total compensation for this position includes base salary or wages, and may include components such as additional compensation (cash or equity), discretionary bonuses, or commissions.

Schedule

• The position follows a hybrid work model, with expectations to be in the office 2-3 days a week (10-12 days a month) at the following office locations: St. Petersburg, FL/ Memphis, TN/ Denver, CO/Southfield, MI.