Azure Databricks Engineer

About the role

seeking a Data Engineer with strong hands-on experience in Azure Cloud, Azure Databricks, PySpark, Azure Data Factory (ADF), Delta Lake, and Unity Catalog.

Responsibilities

• designing, developing, and optimizing scalable data pipelines and cloud-based data solutions
• expertise in ETL/ELT processing, data modeling, performance tuning, and data governance
• ownership of end-to-end solution delivery
• collaborating effectively with cross-functional teams and business stakeholders
• building REST or GraphQL APIs
• API deployment
• understanding of API security, contracts, error handling, and performance

Requirements

• proficiency in Python, SQL, GitHub, and CI/CD practices
• experience working with large-scale datasets in enterprise environments
• strong analytical and problem‑solving skills
• ability to work independently
• exposure to AI/LLM or agentic frameworks (Databricks AI/ML, Codex, Claude, etc.)
• experience with Kubernetes (AKS Preferred)
• understanding of data governance, security, and CI/CD practices

Skills

• Azure Cloud
• Azure Databricks
• PySpark
• Azure Data Factory (ADF)
• Delta Lake
• Unity Catalog
• ADLS Gen2
• REST or GraphQL APIs
• Kubernetes (AKS)
• API security, contracts, error handling, and performance
• data governance
• CI/CD
• Python
• SQL
• GitHub
• large‑scale datasets
• ETL/ELT
• data modeling
• performance tuning
• AI/LLM or agentic frameworks

Qualifications

• BACHELOR OF COMPUTER SCIENCE

Benefits

• Discretionary Annual Incentive
• Comprehensive Medical Coverage: Medical & Health, Dental & Vision, Disability Planning & Insurance, Pet Insurance Plans
• Family Support: Maternal & Parental Leaves
• Insurance Options: Auto & Home Insurance, Identity Theft Protection
• Convenience & Professional Growth: Commuter Benefits & Certification & Training Reimbursement
• Time Off: Vacation, Time Off, Sick Leave & Holidays
• Legal & Financial Assistance: Legal Assistance, 401K Plan, Performance Bonus, College Fund, Student Loan Refinancing

Pay

Salary Range: $110,000-$120,000