Databricks Lead

About the role

Synechron is a global consulting firm combining creativity and innovative technology to deliver industry-leading digital solutions across Artificial Intelligence, Consulting, Digital, Cloud & DevOps, Data, and Software Engineering. The company serves financial services and technology firms, with 14,500+ employees across 58 offices in 21 countries. This position is based in Warren, NJ.

Responsibilities

• Lead the architecture and implementation of Databricks-based data platforms.
• Design scalable batch and real-time data pipelines using Apache Spark, Delta Lake, and Structured Streaming.
• Develop and optimize ETL/ELT workflows using Python, SQL, and orchestration tools.
• Establish best practices for data modeling, performance tuning, monitoring, and cost optimization.
• Implement data governance, security, access controls, lineage, and cataloging using Unity Catalog and related tools.
• Integrate Databricks with cloud platforms, data warehouses, APIs, and enterprise applications.
• Lead technical design reviews, code reviews, and engineering standards.
• Mentor data engineers and provide guidance on Databricks development practices.
• Collaborate with product owners, analysts, data scientists, and business stakeholders to translate requirements into robust data solutions.
• Support CI/CD, automated testing, deployment, and operational support for data workloads.

Requirements

• Bachelor's degree in Computer Science, Engineering, Information Systems, or a related field.
• 7+ years of experience in data engineering, big data, or cloud data platforms.
• 3+ years of hands-on experience with Databricks and Apache Spark.
• Strong proficiency in Python and SQL.
• Experience with Delta Lake, Databricks Workflows, notebooks, cluster configuration, and performance tuning.
• Experience with at least one major cloud platform: Azure, AWS, or Google Cloud.
• Strong understanding of data warehousing, data lakes, dimensional modeling, and distributed processing.
• Proven experience leading technical teams or complex data engineering initiatives.

Qualifications

• Databricks Certified Data Engineer or related certification.
• Experience with Unity Catalog, Delta Live Tables, MLflow, or Databricks SQL.
• Knowledge of Azure Data Factory, Airflow, dbt, Kafka, Terraform, or equivalent tools.
• Experience implementing CI/CD using GitHub Actions, Azure DevOps, Jenkins, or similar platforms.
• Familiarity with data governance, privacy, security, and regulatory requirements.
• Experience working in Agile delivery environments.

Benefits

• Highly competitive compensation and benefits package.
• Multinational organization with 58 offices in 21 countries and possibility to work abroad.
• 10 days of paid annual leave (plus sick leave and national holidays).
• Maternity & paternity leave plans.
• Comprehensive insurance plan including medical, dental, vision, life insurance, and long-/short-term disability (plans vary by region).
• Retirement savings plans.
• Higher education certification policy.
• Commuter benefits (varies by region).
• Extensive training opportunities focused on skills, substantive knowledge, and personal development.
• On-demand Udemy for Business with free access to 5,000+ curated courses.
• Coaching opportunities with experienced colleagues from FinLabs and Center of Excellence groups.
• Cutting-edge projects at world-leading tier-one banks, financial institutions, and insurance firms.
• Flat and approachable organization with a diverse, fun-loving, global work culture.

Pay

The base salary for this role if filled within New Jersey is $125,000 – $130,000 per year plus benefits. Base salary varies based on geography and other factors.