Sr Data Engineer (967)

Key Responsibilities

• Data Pipelines & ETL Design, development, and maintenance
• Develop and maintain SQL Server reporting requirements using SSIS and integration processes
• Implement batch and streaming ETL using Azure Data Factory, Spark, Python, and Scala on Databricks
• Optimize ingestion and transformation processes for efficient, scalable data flows

Data Modeling & Quality

• Develop and maintain data models, schemas, and data dictionaries
• Perform data profiling, cleansing, validation, and quality checks
• Maintain database performance through query tuning and index optimization

Power BI & Reporting

• Develop Power BI dashboards, reports, and visualizations
• Implement data transformations, modeling, and integration processes in Power BI
• Communicate data insights clearly to business stakeholders

DevOps & Agile Delivery

• Use Azure DevOps, GitHub, and Jenkins for build and deploy workflows
• Deliver features incrementally on an Agile team using Jira and Confluence
• Create and maintain technical documentation for databases, schemas, and reporting solutions

Continuous Improvement

• Stay current with industry trends in data engineering and Power BI
• Proactively recommend and implement improvements to data infrastructure
• Multi-task across priorities and adapt within a team environment

Required & Preferred Skills

• Azure Data Factory
• Databricks Delta Lake
• Medallion Architecture
• Unity Catalog
• Python
• Scala
• Spark
• SQL Server
• SSIS
• Azure Data Lake Storage
• Azure SQL
• Power BI
• Data Warehousing
• ETL / ELT
• Azure DevOps
• GitHub
• Jenkins
• Jira / Confluence
• MS Office

Preferred

• REST API / JSON
• Banking / Financial Domain
• Azure / GCP / AWS Cert.
• Java / JavaScript / C++
• Docker / Kubernetes
• Bash / Shell Scripting
• Power Automate
• Power Apps
• Collibra Data Lineage
• Collibra Data Quality

Education & Work Experience

• BS Computer Science
• BS Information Systems
• Equivalent Work Experience