DataBricks Specialist

About the role

Must have 5 to 10+ years of experience in data engineering, software development, or solution architecture, with hands-on production experience on Databricks.

Technical Stack

• Strong proficiency in Python, SQL, or Scala
• Deep knowledge of Apache Spark runtime internals and Delta Lake
• Working knowledge of major cloud platforms such as Microsoft Azure, AWS, or GCP
• Preferred: Databricks Certified Data Engineer or Solutions Architect credentials

Responsibilities

• Design end-to-end data pipelines, ETL/ELT processes, and lakehouse storage patterns using Apache Spark, Delta Lake, and Python or SQL
• Optimize cluster sizing, query execution, shuffles, partitions, and storage layouts for large-scale data workflows
• Implement MLOps workflows, manage model lifecycles, or deploy generative AI and vector search solutions using MLflow and Unity Catalog
• Partner with enterprise stakeholders, data scientists, and software engineers to translate business requirements into technical solutions
• Oversee security configurations, access controls, workspace administration, and CI/CD deployment pipelines

Qualifications

• Bachelor of Computer Science

Benefits

• Discretionary Annual Incentive
• Comprehensive Medical Coverage (Medical & Health, Dental & Vision)
• Disability Planning & Insurance, Pet Insurance Plans
• Maternal & Parental Leaves
• Auto & Home Insurance, Identity Theft Protection
• Commuter Benefits & Certification & Training Reimbursement
• Vacation, Time Off, Sick Leave & Holidays
• Legal Assistance, 401K Plan, Performance Bonus, College Fund, Student Loan Refinancing

Pay

$130,000 – $150,000 a year