Data Engineer

About the Role

The Select Group is seeking a Data Engineer to support a FlexCube Upgrade Project in a lead data engineering capacity. This role focuses on designing, developing, maintaining, testing, and optimizing data applications and pipelines while supporting data quality, integration, security, and data warehouse initiatives. The successful candidate will bring strong data engineering expertise, particularly with SAP BODS ETL tools, Informatica IICS, Python, Unix scripting, SQL, and Redwood Scheduler. The role also involves mentoring onsite and offshore data engineers, collaborating with stakeholders, supporting UAT and end-user training, and working with both modern and legacy data warehouse technologies.

Responsibilities

• Lead the design, development, and maintenance of data applications supporting the FlexCube Upgrade initiative.
• Design, develop, and maintain data pipelines.
• Ensure data quality, integrity, security, and integration testing.
• Troubleshoot and resolve issues within data applications.
• Guide and mentor onsite and offshore data engineers.
• Establish and drive data engineering workflow guidelines covering data collection, ingestion, cleansing, storage, and serving.
• Learn and apply new technologies while supporting legacy data warehouse tools and technologies.
• Design dimensional data models to optimize data storage and analytical access.
• Develop complex SQL queries for data extraction, transformation, and loading.
• Design, architect, and optimize data warehouses for large datasets.
• Design and implement ETL pipelines to prepare data for analysis.
• Test data pipelines to ensure data quality and reliability.
• Mentor test engineers in developing comprehensive data pipeline testing strategies.
• Collaborate with stakeholders to understand data requirements and develop appropriate data solutions.
• Conduct User Acceptance Testing (UAT).
• Provide end-user training.
• Work with technologies including SAP BODS, Informatica IICS, DataStage, Oracle, Netezza, Python, and Redwood.
• Work with Oracle PL/SQL and, where applicable, Snowflake and AWS services including S3, Glue, Lambda, DynamoDB, and Redshift.

Required Qualifications

• Strong data engineering experience.
• Experience with SAP BODS ETL tools.
• Experience with Informatica IICS.
• Strong Python scripting skills.
• Strong Unix scripting skills.
• Very strong SQL skills.
• Experience with Redwood Scheduler.
• Experience designing, developing, and maintaining data pipelines.
• Experience with ETL development.
• Experience with data quality, integrity, and integration testing.
• Experience with data warehouse design and optimization.
• Experience with dimensional data modeling.
• Ability to troubleshoot and resolve data application issues.
• Ability to mentor data engineers and collaborate with stakeholders.

Preferred Qualifications

• Experience with AWS.
• Experience with Snowflake.

Skills & Competencies

• Data Engineering
• SAP BODS
• ETL
• Informatica IICS
• Redwood Scheduler
• Python
• Unix Shell Scripting
• SQL
• PL/SQL
• Data Pipeline Development
• Data Integration
• Data Quality
• Data Testing
• Data Warehouse Design
• Data Warehouse Architecture
• Dimensional Data Modeling
• Large-Scale Data Processing
• Oracle
• DataStage
• Netezza
• AWS
• Amazon S3
• AWS Glue
• AWS Lambda
• DynamoDB
• Amazon Redshift
• Snowflake
• Troubleshooting
• UAT
• End-User Training
• Technical Mentoring
• Stakeholder Collaboration

Experience

• Experience in data engineering.
• Experience with SAP BODS ETL tools, Informatica IICS, Redwood Scheduler, Python/Unix scripting, and SQL.
• Experience designing and maintaining data pipelines and ETL processes.
• Experience with data warehouse design, architecture, optimization, and dimensional modeling.
• Experience with data quality and pipeline testing.
• Experience mentoring data engineers.

Work Arrangement & Schedule

• Remote
• Location: Raleigh, NC, US
• Job duration: 8 months
• Start date: April 1
• Number of openings: 1
• Project: FlexCube Upgrade Project