Python Developer - Databricks and Azure

About the role

The role is for a Python Developer with expertise in Databricks and Azure, requiring 7‑10 years of experience in Python, ETL data handling, and SQL. The position involves designing and implementing scalable data and application solutions using Python and Azure ML, developing and optimizing complex ETL/ELT processes with Spark and Python, enhancing job performance and cost‑efficiency, collaborating with data scientists and stakeholders, implementing security and governance frameworks, championing DevOps and automation, building monitoring and alerting systems, and working in a pod‑based agile team supporting multiple projects. Local candidates within 50 miles of Fort Worth, TX are required, with an in‑person interview and coding assignment mandatory.

Responsibilities

• Design and implement scalable data and application solutions using Python and Azure ML.
• Develop and optimize complex ETL/ELT processes for large‑scale datasets using Spark and Python.
• Enhance Python job performance and cost‑efficiency through advanced optimization techniques.
• Collaborate with data scientists, analysts, and business stakeholders to create technical solutions for business problems.
• Implement data security, compliance, and governance frameworks (e.g., Unity Catalog, access controls, encryption, data lineage).
• Champion DevOps and automation by building CI/CD pipelines using Azure DevOps, GitHub Actions, or Jenkins.
• Develop robust monitoring, logging, and alerting for production pipelines to ensure reliability.
• Design and develop CI/CD pipelines for code deployment, preferably to Azure, using Git‑based tools.
• Work in a pod‑based agile team structure, supporting multiple projects and ensuring consistent agile practices.

Requirements

• Minimum 7‑10 years of experience in Python, ETL data handling, and SQL.
• Strong experience in Databricks, Azure Cloud, Spark, and application development.
• Experience with software development life cycle (SDLC) and agile methodologies.
• At least 5 years of hands‑on experience with Spark, Databricks, and monitoring/alerting systems.
• Local candidates (within 50 miles of Fort Worth, TX) required.
• In‑person interview and coding assignment mandatory.

Skills

• Java
• Spring
• Comprehensive Azure services knowledge
• Excellent communication skills
• Experience using AI tools for enhanced productivity (a plus)