Data Platform DevOps Engineer
Job Purpose
The incumbent report into the AI and Data management unit (“AI & Data unit”), that is accountable to the Director of the DTD. The other units and teams reporting to the DT Director include the Enterprise Architecture, Strategy & Planning unit, the Digital development and management unit, the Infrastructure & Security Team and the Global Service Desk and Endpoint Management team. Under the leadership of the Director, these units and teams serve as members of the global DTD management team, along with the CISO and Regional DT managers. The AI & Data unit is responsible to deliver greater value from IFRC’s data, and ensures the development and implementation of IFRC’s data and AI governance and strategy, in close collaboration with the IFRC’s Data Protection Office and through indirect management of data professionals in other departments.
Job Duties And Responsibilities
- Design, build, and maintain the Microsoft Fabric data platform infrastructure, including OneLake, Data Warehouse, Lakehouse, Data Factory pipelines, Real-Time Intelligence, and Power BI environments.
- Implement and manage platform architecture supporting data engineering, data science, analytics, and business intelligence workloads across the organization.
- Develop and maintain Infrastructure as Code (IaC) solutions using Terraform, Azure Resource Manager templates, or similar tools for consistent, repeatable deployments.
- Architect multi-region, scalable solutions within Microsoft Fabric to support global humanitarian operations.
- Design and implement OneLake storage structure, shortcuts, mirroring configurations, and data lake optimization strategies.
- Build and maintain comprehensive CI/CD pipelines for Microsoft Fabric workspaces using Azure DevOps.
- Implement automated deployment strategies utilizing Fabric REST APIs, Git integration, Fabric deployment pipelines, and fabric-cicd tools.
- Manage source control integration with Microsoft Fabric workspaces, establishing branching strategies and deployment workflows across development, test, and production environments.
- Automate infrastructure provisioning, configuration management, and deployment processes for all Fabric components.
- Develop and maintain deployment rules, parameterization strategies, and environment-specific configurations.
- Perform ongoing maintenance of Microsoft Fabric platform components including capacity management, workspace administration, and item lifecycle management.
- Monitor platform health, performance metrics, and resource utilization using Azure Monitor, Prometheus, Grafana, or integrated Fabric monitoring capabilities.
- Implement comprehensive observability and alerting framework covering logs, metrics, and traces across the entire data platform.
- Conduct regular platform updates, patches, and upgrades while minimizing disruption to users and maintaining system stability.
- Manage disaster recovery procedures, backup strategies, and business continuity planning for critical data assets.
- Optimize platform performance through capacity planning, resource allocation, and cost management strategies.
- Implement security controls using Microsoft Purview for data governance, classification, and protection across the Fabric ecosystem.
- Configure and maintain role-based access controls (RBAC), row-level security, column-level security, and OneLake folder/table-level permissions.
- Establish and enforce data sensitivity labeling, information protection policies, and data loss prevention (DLP) measures.
- Integrate Microsoft Entra authentication, manage service principals, and implement managed identities for secure platform access.
- Ensure compliance with global regulatory frameworks including GDPR, HIPAA, and ISO standards through automated controls and auditing.
- Implement network security measures including conditional access, private endpoints, customer-managed encryption keys, and secure data sharing protocols.
- Monitor and respond to security incidents, conducting regular security assessments and vulnerability management.
- Create and maintain comprehensive technical documentation for infrastructure configurations, deployment procedures, and operational processes.
- Develop runbooks, standard operating procedures, and troubleshooting guides for common platform operations.
- Document architecture decisions, security controls, and governance frameworks for audit and compliance purposes.
- Maintain up-to-date inventory of platform components, dependencies, and integration points.