Azure DBX

About the Company

Fractal is a strategic AI partner to Fortune 500 companies with a vision to power every human decision in the enterprise. We are building a world where individual choices, freedom, and diversity are the greatest assets; an ecosystem where human imagination is at the heart of every decision. Fractal has been featured as a Great Place to Work by The Economic Times and recognized as a ‘Cool Vendor’ and a ‘Vendor to Watch’ by Gartner.

About the Role

We are seeking a highly skilled Senior Azure Databricks Engineer to design, develop, and optimize enterprise-scale data platforms on Microsoft Azure. The ideal candidate will have strong hands-on experience with Azure Databricks, Data Engineering, Cloud Architecture, and Data Integration solutions. This role requires close collaboration with business stakeholders, architects, data scientists, and cross-functional teams to deliver scalable and high-performance data solutions.

Please Note: We are not offering sponsorship at this time.

Responsibilities

• Design, develop, and maintain scalable data pipelines using Azure Databricks.
• Build and optimize ETL/ELT workflows for processing large-volume structured and unstructured datasets.
• Develop data solutions using Spark (PySpark/Scala) within Azure Databricks.
• Implement Medallion Architecture (Bronze, Silver, Gold layers) for modern data platforms.
• Integrate data from multiple sources including APIs, databases, files, and streaming platforms.
• Collaborate with solution architects and business teams to understand data requirements.
• Design and implement data models supporting analytics, reporting, and AI/ML initiatives.
• Optimize Spark jobs and cluster configurations for performance and cost efficiency.
• Develop CI/CD pipelines for Databricks deployments using Azure DevOps.
• Implement data governance, security, monitoring, and compliance best practices.
• Troubleshoot production issues and support business-critical data operations.
• Mentor junior engineers and conduct technical reviews.

Requirements

• Bachelor's or Master's degree in Computer Science, Information Technology, Data Engineering, or a related field.

Skills

Azure Technologies

• Azure Databricks (DBX)
• Azure Data Factory (ADF)
• Azure Data Lake Storage Gen2 (ADLS)
• Azure Synapse Analytics
• Azure Key Vault
• Azure DevOps
• Azure Monitor and Log Analytics

Data Engineering

• PySpark
• Spark SQL
• Python
• SQL
• Delta Lake
• Data Modeling
• ETL/ELT Development
• Data Warehousing Concepts

DevOps & Automation

• Git
• CI/CD Pipelines
• Infrastructure as Code (Terraform preferred)
• Release Management

Database Technologies

• SQL Server
• Azure SQL Database
• PostgreSQL
• Snowflake (Preferred)

Preferred Qualifications

• Experience implementing Lakehouse architectures.
• Experience with Streaming solutions using Event Hub or Kafka.
• Knowledge of Machine Learning workflows in Databricks.
• Exposure to Healthcare, Life Sciences, Pharmaceutical, or Financial Services domains.
• Experience working directly with client stakeholders in onsite environments.
• Strong understanding of data security, governance, and data quality frameworks.

Pay

The wage range for this role is $120,000 - $140,000. In addition, you may be eligible for a discretionary bonus for the current performance period.

Benefits

• Health, dental, vision, life insurance, and disability plans (eligible from the first day of employment).
• 401(k) Plan (eligible after 30 days of employment).
• 11 paid holidays.
• 12 weeks of Parental Leave.
• Flexible PTO policy for sick time or vacation.