Data Engineer III

Essential Functions

• Investigates and analyzes feasibility of data integration prototypes and program requirements
• Develops specifications and plans the full range of programming actions to produce data integration components
• Maintains complex automated ETL/ELT pipeline architecture that cleans, transforms, and aggregates data from disparate sources using architecturally approved tools, programming languages, and services to deliver a data mesh approach
• Maintains complex automated ETL/ELT monitoring and alarming solutions using architecturally approved languages and services
• Monitors, troubleshoots, and optimizes data pipelines for quality, performance, and reliability creating a single source of truth providing business customers with highly reliable and quality data
• Balances and designs data analytics product solutions based on cost and performance to meet data needs and business requirements
• Guides business customers to develop, troubleshoot, and optimize complex SQL and ETL/ELT solutions to solve reporting, metrics, and analytics problems
• Develops, maintains, tests, and deploys code with architecturally approved toolsets using Dev Ops practices, ETL/ELT pipelines, data catalogs and data queries
• Maintains data solutions in a divest state to ensure business functionality until replaced with new technology
• Collaborates with cross-functional teams to understand data requirements for data analytics products and translate them into scalable and efficient data solutions
• Partners with users and stakeholders to understand data needs and business requirements
• Develops and maintains documentation related to the design of applications and interfaces to enterprise and third-party systems in accordance with departmental and team standards
• Collaborates with data governance on ensuring what is being produced in data analytics products enables data governance to publish a data asset
• Works with business customers and software development teams to gather and document requirements for data publishing and data consumption via data mesh architecture
• Maintains systems documentation

Data analysis

• Collaborates with cross-functional teams to understand data requirements for data analytics products and translate them into scalable and efficient data solutions
• Leverages data governance, data security, and privacy principles to support data lineage and reference data needs
• Collaborates with cross-functional teams to understand business and downstream application (BI reporting, Data Science, Data Governance, other System integrations) and consumer requirements to deliver data-driven solutions that implement best practices for data management, security, and governance

Data Modeling

• Develops complex data objects for business analytics using data modeling techniques
• Models front-end and back-end data sources to help draw a more comprehensive picture of user flows throughout the system and to enable powerful data analysis
• Builds complex detailed logical models based on the conceptual model, specifying data types, constraints, and keys to ensure data integrity
• Implements complex logical models into appropriate database management systems, considering database features, storage optimization, and performance considerations
• Designs complex data pipelines to extract data from source systems, transform it as needed based on the data model, and load it into the target database

Documentation

• Participates in creating and maintaining documentation related to the design of applications and interfaces to enterprise and third-party systems in accordance with departmental and team standards
• Collaborates with data governance on ensuring what is being produced in data analytics products enables data governance to publish a data asset
• Works with business customers and software development teams to gather and document requirements for data publishing and data consumption via data mesh architecture
• Maintains systems documentation