Data Engineer - Databricks (No Sponsorship Available)

Essential Functions

• Design, implement, and maintain scalable data pipelines within a cloud data platform (Azure preferred)
• Build, optimize, and manage Databricks clusters, ensuring performance, cost efficiency, and reliable job execution
• Develop and maintain Delta Lake tables, pipelines, and storage patterns to ensure data quality, versioning, and performance
• Integrate Databricks with Azure services such as Azure Data Factory, ADLS, and Azure DevOps
• Support the implementation of a new cloud-based data warehouse, defining architecture, governance, and standards
• Build and automate CI/CD pipelines for data workflows using Azure DevOps
• Design and implement monitoring solutions using Databricks monitoring tools, Azure Log Analytics, or custom dashboards
• Collaborate with business and technical stakeholders to identify high-value data engineering and analytics opportunities and contribute to data governance initiatives

Qualifications

• Bachelor’s or Master’s degree in Computer Science, Engineering, Data Science, or a related field required
• 3+ years of experience in data engineering or cloud data architecture
• Expertise in Databricks or Snowflake Cloud Data Platforms
• Expertise with programming languages such as Python and/or SQL
• Experience with Python Data Science Libraries (PySpark, Pandas, etc.)
• Experience with Test Drive Development (TDD)
• Automated CI/CD Pipelines
• Linux / Bash / Docker
• Database Schema Design and Optimization
• Experience working in a cloud environment (Azure preferred) with strong understanding of cloud data architecture
• Experience with workflow orchestration (e.g., Databricks Jobs, or Azure Data Factory pipelines)

Skills And Abilities

• Strong analytical and problem-solving skills
• Experience with programming languages such as Python, Java, R, or SQL
• Knowledge of statistical analysis and data visualization tools, such as PowerBI or Tableau
• Proficient in Microsoft Office

About Heritage Construction + Materials

Heritage Construction + Materials (HC+M) is part of The Heritage Group, a privately held, family-owned business headquartered in Indianapolis. HC+M has core capabilities in infrastructure building. Its collection of companies provides innovative road construction and materials services across the Midwest. HC+M companies, including Asphalt Materials, Inc., Evergreen Roadworks, The Hoosier Company, Milestone Contractors and US Aggregates, proudly employ 3,000 people at 68 locations across seven states.