Data Engineer

About the role

A well-known Financial Services Company is looking for a Data Pipeline Engineer in Charlotte, NC or Irving, TX (Hybrid).

Responsibilities

• Work with the brightest minds at one of the largest financial institutions in the world.
• This is a long-term contract opportunity that includes a competitive benefit package!
• Our client has been around for over 150 years and is continuously innovating in today's digital age.
• Design and develop ETL/ELT workflows and data pipelines for batch and real-time processing.
• Build and maintain data pipelines for reporting and downstream applications using open source frameworks and cloud technologies.
• Implement operational and analytical data stores leveraging Delta Lake and modern database concepts.
• Optimize data structures for performance and scalability across large datasets.
• Apply best practices for data governance, lineage tracking, and metadata management, including integration with Google Dataplex for centralized governance and data quality enforcement.
• Develop, schedule, and orchestrate complex workflows using Apache Airflow, with strong proficiency in designing and managing Airflow DAGs.
• Consult on complex initiatives with broad impact and large-scale planning for Software Engineering.
• Review and analyze complex multi-faceted, larger scale or longer-term Software Engineering challenges that require in-depth evaluation of multiple factors including intangibles or unprecedented factors.
• Contribute to the resolution of complex and multi-faceted situations requiring solid understanding of the function, policies, procedures, and compliance requirements that meet deliverables.
• Strategically collaborate and consult with client personnel.
• Troubleshoot and resolve issues in data pipelines and ensure high availability and reliability.

Qualifications

• 5+ years of Software Engineering experience, or equivalent demonstrated through one or a combination of the following: work or consulting experience, training, military experience, education
• Ability to design and develop ETL/ELT workflows and data pipelines for batch and real-time processing. (GCP or any other cloud platforms are fine I.E. PYSPARK)
• Build and maintain data pipelines for reporting and downstream applications using open source frameworks and cloud technologies
• Implement operational and analytical data stores leveraging Delta Lake and modern database concepts
• Optimize data structures for performance and scalability across large datasets
• Apply best practices for data governance, lineage tracking, and metadata management, including integration with Google Dataplex for centralized governance and data quality enforcement
• Develop, schedule, and orchestrate complex workflows using Apache Airflow, with strong proficiency in designing and managing Airflow DAGs
• Consult on complex initiatives with broad impact and large-scale planning for Software Engineering
• Review and analyze complex multi-faceted, larger scale or longer-term Software Engineering challenges that require in-depth evaluation of multiple factors including intangibles or unprecedented factors
• Contribute to the resolution of complex and multi-faceted situations requiring solid understanding of the function, policies, procedures, and compliance requirements that meet deliverables
• Strategically collaborate and consult with client personnel
• Troubleshoot and resolve issues in data pipelines and ensure high availability and reliability

Benefits

• Motion Recruitment Partners (MRP) is an Equal Opportunity Employer.
• All applicants must be currently authorized to work on a full-time basis in the country for which they are applying, and no sponsorship is currently available.
• Employment is subject to the successful completion of a pre-employment screening.
• Accommodation will be provided in all parts of the hiring process as required under MRP’s Employment Accommodation policy.
• Applicants need to make their needs known in advance.