Data Engineering Team Lead

About the role

The Technical Lead will support development tracks to develop and deliver data pipelines for a complex data analytics platform and provide production support for existing data pipelines in production. This individual will participate in data acquisition and data integration strategic initiatives and workgroups.

Responsibilities

• Serves as a technical lead focused on acquiring, transforming and delivering data to the users of the analytics platform. Work involves planning, assigning and tracking the work of the development team to deliver data analytics pipelines and coordinating all tasks necessary to accomplish the work. Ensures that designs comply with data security requirements for each category of data contained in a solution.
• Serves as the point of contact for business users. Communicates project status and issues. Answers questions about schedule and functionality. Coordinates scheduling with customer representatives as needed. Attends meetings to understand current and upcoming challenges.
• Participates in analyzing systems and procedures, documenting requirements, analyzing the current state and desired state of data acquisition/transformation solutions, identifies gaps between the two states.
• Develops or revises existing code; schedules, tests, installs, and implements systems; writes or revises standards and procedures.
• Leads and coordinates production support efforts for a critical system to ensure any incidents are investigated and resolved timely, while keeping key stakeholders informed and ensuring the solution meets all requirements for data security and data quality.
• Participates as a consultant and subject matter expert during project development and planning stages of data acquisition/transformation initiatives that cross functional agency systems, other IT groups and other state entities that require coordinating, planning, and scheduling. Provides options in the determination and implementation of optimal solutions.
• Performs other duties as assigned.

Requirements

• Bachelor's degree in the areas of computer science, math, or a related field, or equivalent experience, is required.
• Three (3) years of experience, minimum, leading a data engineering team focused on Enterprise Analytics projects is required.
• A minimum of five (5) years of experience handling enterprise level data sets using Snowflake, Oracle, SQL Server, or an equivalent database system, is required.
• Proficient in scripting using Python preferred.
• Experience in implementing data pipelines using Informatica PowerCenter/IICS/Informatica Data Quality (IDQ) preferred.
• Experience in building data pipelines in Amazon Web Services (AWS), Microsoft Azure, Google Cloud Platform (GCP), or Oracle Cloud Infrastructure (OCI) is preferred.
• Candidates with AI knowledge will be preferred.

Qualifications

• Knowledge of new cloud technologies and the analytical services available from the major cloud services providers.
• Knowledge of cloud delivery models: PaaS, SaaS, IaaS.
• Knowledge of agile (scrum/Kanban) methodology and ceremonies.
• Knowledge of cloud-based services for AWS, Microsoft Azure or GCP.
• Knowledge of AI technologies and experience implementing AI features.
• Knowledge and hands-on experience of the limitations and capabilities of computer systems, information technology equipment, applicable programming languages, computer hardware and software, and computer operating systems.
• Skilled as a technical lead for software development, data analytics, performance management system, or data warehousing project.
• Skilled with JIRA software.
• Strong technical writing and diagraming skills, including proficiency with modeling and mapping tools (e.g., Visio, Erwin), the Microsoft Office Suite (Word, Excel, PowerPoint, and MS Project).
• Skilled with data engineering, including acquisition/ETL tools such as Informatica PowerCenter, IDQ, and cloud technologies like Open Flow, DBT, Informatica IICS etc.
• Skills acquiring data from multiple data sources/technologies for use by data visualization tools like Tableau and Power BI. Technologies should include Snowflake and others such as Oracle, SQL Server, Microsoft Excel, Postgres, Mongo DB, salesforce etc.
• Skill analyzing technology systems capabilities, limitations, defects, and business problems to draw evidence-based conclusions and devise innovative solutions.

Skills

• Ability to work under pressure and successfully manage multiple overlapping deadlines, and able to handle multiple cross-agency projects.
• Ability to produce reliable, accurate, high-quality results.
• Prefer Knowledge of Data Governance tools like Informatica Enterprise Data Catalog, Axon or similar tools from other Industry providers.
• Ability to demonstrate strong analytical and problem-solving skills.
• Ability to be adaptable and learn quickly.
• Ability to deliver work within defined schedules, cost and quality.
• Ability to communicate with a high level of effectiveness both verbally and in written formats.
• Ability to lead the creation of best practices and procedures.

Benefits

Comprehensive benefits package including 100% paid employee health insurance for full-time eligible employees, a defined benefit pension plan, generous time off benefits, numerous opportunities for career advancement and more.