Azure Databricks Engineer
· Charlotte, NC · 2 wk ago
On-siteInformation TechnologyContract
Responsibilities
- Lead and mentor a team of technical professionals, fostering a collaborative and high-performance culture.
- Design and implement data processing solutions using Azure Databricks, ensuring scalability and efficiency.
- Collaborate with cross-functional teams to gather requirements and translate them into technical specifications.
- Oversee the development lifecycle, from planning and design to deployment and maintenance.
- Conduct code reviews and provide constructive feedback to team members to ensure code quality and adherence to best practices.
- Stay up to date with industry trends and emerging technologies related to Azure Databricks and data engineering.
- Facilitate communication between technical and non-technical stakeholders to ensure alignment on project goals.
- Identify and mitigate risks associated with project delivery and team performance.
Skills
- Mandatory:
- Proven expertise in Azure Databricks, including experience with Spark, data pipelines, and data lakes.
- Strong programming skills in languages such as Python, Scala, or SQL.
- Experience with cloud-based data storage solutions, particularly Azure Data Lake Storage and Azure SQL Database.
- Solid understanding of data modeling, ETL processes, and data warehousing concepts.
- Demonstrated ability to lead technical teams and manage multiple projects simultaneously.
- Preferred:
- Familiarity with Azure DevOps for CI/CD processes.
- Experience with machine learning frameworks and libraries.
- Knowledge of data governance and compliance standards.
- Strong analytical and problem-solving skills.
- Excellent communication and interpersonal skills.
Qualifications
- Bachelor's degree in Computer Science, Information Technology, or a related field.
- 7-10 years of experience in data engineering, software development, or a related technical role.
- Proven track record of leading technical teams and delivering successful projects.
- Relevant certifications in Azure or data engineering are a plus.