Sr. Data Engineer

What You'll Do

• Lead the design and development of scalable data pipelines in Databricks
• Build and optimize Lakehouse architecture using Medallion (Bronze/Silver/Gold) design
• Develop data solutions using Python, Pyspark, Spark SQL, and Delta Lake
• Integrate APIs, enterprise systems, SaaS platforms, and external data sources
• Establish data quality, testing, monitoring, and performance standards
• Mentor engineers and promote engineering best practices
• Drive CI/CD, automation, and AI-first development practices
• Partner with analytics engineers, data scientists, and application teams
• Evaluate new technologies through proof-of-concept projects

  Required

  • AI-first development mindset
  • 5+ years of data engineering experience, including senior or lead responsibilities
  • Expert Python and SQL skills
  • Deep experience with Databricks, Apache Spark, and Pyspark
  • Experience building production data pipelines
  • Lakehouse architecture and Medallion modeling experience
  • Data quality, testing, and monitoring expertise
  • Ci/CD and Git experience
  • Experience with Azure Data Factory, Airflow, or similar orchestration tools
  • REST API and enterprise system integrations
  • Bachelor’s degree in computer science, Engineering, Information Systems, or equivalent experience
  • Strong communication and collaboration skills

  PREFERRED

  • Azure Databricks
  • Azure Data Factory
  • Azure Data Lake Storage
  • Delta Lake
  • Apache Airflow
  • Databricks Asset Bundles
  • Databricks Apps
  • MLflow
  • Mosaic AI
  • Unity Catalog
  • Experience supporting AI/ML workloads
  • Databricks Data Engineer Certification