Role: Databricks Data Engineer

Location: New York, NY 10036 (Hybrid) • W2 • $75/hr • U.S. Citizens & Green Card Holders only

Requirements

• 10+ years of Data Engineering experience
• 3+ years of hands-on experience with Databricks
• Expertise in Delta Lake, Delta Live Tables (DLT), Unity Catalog, and Databricks Workflows
• Strong programming skills in Python and/or Scala
• Advanced SQL and ETL/ELT development experience
• Experience with data modeling, pipeline orchestration, and enterprise data architectures
• Hands-on experience integrating Databricks with Azure, AWS, or GCP
• Experience with Azure Data Factory, Kafka, Event Hubs, or similar data integration technologies

Preferred Experience

• Sales Incentive Compensation (SIC) processes including:
  • Quota Management
  • Attainment Tracking
  • Commission Calculations
  • Payout Processing
• Experience with SIC platforms such as Anaplan, Oracle ICM, or Varicent

Responsibilities

• Design, develop, and optimize Databricks-based data pipelines and Delta Lake solutions
• Build scalable ETL/ELT workflows for enterprise analytics and reporting
• Design data models supporting Sales Incentive Compensation processes
• Collaborate with Sales Operations, Finance, and Business stakeholders to translate business requirements into scalable technical solutions
• Implement and optimize Databricks features including Unity Catalog, Delta Live Tables, and Photon
• Perform testing, debugging, and performance tuning of data pipelines
• Document technical designs, pipeline configurations, and development standards