Sr. Data Engineer - Cloud, AWS and Snowflake

About the role

The Data Engineer at Regions is responsible for evaluating, designing, and executing data structures and systems to deliver business value through operational and analytical data assets. They collaborate with business subject matter experts and technical partners to create enterprise data assets and ensure data quality and integrity.

Responsibilities

• Partners with Regions Technology partners to Design, Build, and Maintain the data-based structures and systems in support of Data and Analytics and Data Product use cases
• Builds data pipelines to collect and arrange data and manage data storage in Regions’ big data environment
• Buils robust, testable programs for moving, transforming, and loading data using big data tools such as Spark
• Coordinates design and development with Data Products Partners, Data Scientists, Data Management, Data Modelers, and other Technical partners to construct strategic and tactical data stores
• Ensures data is prepared, arranged, and ready for each defined business use case
• Designs and deploys frameworks and micro services to serve data assets to data consumers
• Collaborates and aligns with technical and non-technical stakeholders to translate customer needs into Data Design requirements, and work to deliver world-class visualizations, data stories while ensuring data quality and integrity
• Provides consultation to all areas of the organization that plan to use data to make decisions
• Aids in the development of information delivery and supports the automation of data products
• Acts as a trusted adviser and partner to business leads - assisting in the identification of business needs & data opportunities, understanding key drivers of performance, interpreting business case data drivers, turning data into business value, and participating in the guidance of the overall data and analytics strategy
• Ensures compliance with risk management programs, rules and regulations, and cybersecurity practices; identifies opportunities for and supports process improvements; applies disciplined change management practices

Requirements

• Ph.D. and four (4) years of experience in a quantitative/analytical/STEM field
• Master’s degree and six (6) years of experience in a quantitative/analytical/STEM field or technical related field
• Bachelor's degree and eight (8) years of experience in a quantitative/analytical/STEM field or technical related field
• Five (5) years of working programming experience in Python/PySpark, Scala, SQL
• Five (5) years of working experience in Big Data Technology in Hadoop, Hive, Impala, Spark, or Kafka

Preferences

• Background in Big Data Engineering and Advanced Data Analytics
• Experience developing solutions for the financial services industry
• Experience in Agile Software Development
• Experience or exposure to cloud technologies and migrations
• Prior banking or financial services experience

Skills and Competencies

• Ability to interpret and ensure compliance with applicable rules, regulations, and industry guidance
• Experience building data solutions at scale
• Experience designing and building relational data structures in multiple environments
• Experience with DevOps principals, CI/CD, and Software Development Lifecycle
• Experience with No-SQL databases
• Experience with large-scale data Lakehouses at Enterprise scale
• Proven record of accomplishment of delivering operational Data solutions including Report and Model Ready Data Assets
• Significant experience working with senior executives in the use of data, reporting and visualizations to support strategic and operational decision making
• Strong ability to transform and integrate complex data from multiple sources into accessible, understandable, and usable data assets and frameworks
• Strong background in synthesizing data and analytics in a large (Fortune 500), complex, and highly regulated environment
• Strong technical background including database and business intelligence skills
• Strong communication skills through written and oral presentations