Data Engineer

SUMMARY

The Data Engineer owns the end-to-end data platform, building high-scale pipelines, optimizing cloud resources, and ensuring that analysts and executives have trusted, timely data. You will drive architecture decisions, mentor junior engineers, and champion Python- and PySpark-based best practices across the organization.

ESSENTIAL DUTIES AND RESPONSIBILITIES

• Design, build, and maintain scalable data pipelines in Databricks (Spark SQL, PySpark, Delta Lake).
• Stand up and manage Azure resources (Data Lake Storage, Azure Key Vault, ADF/Synapse, Databricks workspaces).
• Partner with business and technical leaders to capture analytic requirements and translate them into robust ETL workflows and scalable data infrastructure.
• Use Databricks Workflows or similar orchestration tools to schedule jobs, manage dependencies, and implement data quality checks.
• Optimize data models for analytics, reporting, and machine-learning workloads.
• Implement CI/CD workflows (Git, Azure DevOps) and automated testing for code deployments.
• Monitor pipeline performance, cost, and data quality; drive continuous improvement.
• Document technical designs and mentor analytics team members on SQL, Python, and Spark best practices.
• Experience with implementing automated data delivery solutions using databricks and Azure
• Help define access controls, sensitive data handling, and governance standards using Unity Catalog and Databricks best practices.

EDUCATION, EXPERIENCE, AND SKILLS REQUIRED

• 4+ years in data engineering or related roles.
• Expert-level Python and advanced SQL (PostgreSQL/Spark-SQL).
• Production experience with Databricks, Spark (batch & streaming), and Delta Lake.
• Proven success configuring and securing Azure data services (Storage, Networking).
• Hands-on with REST/Graph APIs and real-time data ingestion pipelines
• Strong communication skills and a track record of owning mission-critical data systems.

PREFERRED SKILLS AND ABILITIES

• Bachelor’s or Master’s in Computer Science, Data Engineering, or related field.
• Azure certifications (DP-203, AZ-305) or Databricks Data Engineer Professional.
• Experience with BI tools (Tableau / Power BI) and excel
• Familiarity with Azure VMs and SSRS

COMPENSATION:

At Sono Bello, we believe that our team members are the keys to our success. The compensation range for this role is $125,000 - $140,000 depending on experience.

BENEFITS:

• Medical, Dental, Vision, Life Insurance
• 401k with match, EAP, PTO, and paid holidays