Databricks Architect - Hybrid

About the role

Provide guidance and support to teams and analysts.

Collaborate on data strategy with business and IT partners.

Identify and address data issues.

Lead architecture, design, and implementation of scalable and efficient data pipelines and analytics solutions on Databricks.

Work closely with data engineering, platform, and analytics teams to integrate Databricks with AWS S3 Data Lake, Redshift, Talend, SAP BW/HANA, Oracle, and other tools.

Architect solutions supporting batch and real-time data processing using Delta Lake, Spark, and ML Flow.

Responsibilities

• Provide guidance and support to teams and analysts.
• Collaborate on data strategy with business and IT partners.
• Identify and address data issues.
• Lead architecture, design, and implementation of scalable and efficient data pipelines and analytics solutions on Databricks.
• Work closely with data engineering, platform, and analytics teams to integrate Databricks with AWS S3 Data Lake, Redshift, Talend, SAP BW/HANA, Oracle, and other tools.
• Architect solutions supporting batch and real-time data processing using Delta Lake, Spark, and ML Flow.
• Collaborate with business stakeholders to understand data requirements, assess current state, and provide strategic direction for future-state architecture.
• Ensure best practices for data quality, governance, and security are implemented.
• Own design, development, and delivery of pipelines and models as per the project plan.
• Ensure best practices are followed in performance, security, and governance.
• Provide project documentation and conduct KT sessions.
• Ensure following acceptance criteria is met, by working along with current development and pool partners.

Qualifications

• Validated and reconciled transformed data within defined thresholds.
• Fully operational Snowflake warehouse with business-validated datasets.
• Documented operational playbooks and KT completed.
• No critical issues post go-live during hyper-care window.

Skills

• Databricks certification is a must.

Benefits

• Successful ingestion and transformation of in-scope objects.

Pay

TBD

Schedule

TBD