Senior Databricks Data Engineer
ADPMN Inc · Atlanta, GA · 17 mo ago
Information TechnologyFull-time
About the role
Responsible for moving source data (primarily batch) into bronze (Databricks Lakehouse).
Responsibilities
- Strong with Unity Catalog, handle complex data isolation scenarios and nuances of Databricks environments.
- Expertise in monitoring data pipelines and troubleshooting.
- Work closely with data scientists for their data needs.
- Familiar with Ingest frameworks, able to replicate a pipeline code across business/environments.
- Experience working with Infrastructure, able to scale the data needs.
- Worked with supporting Edge and Cloud use cases for ML/AI.
Requirements
Has experience working with Infrastructure, be able to scale the data needs.
Qualifications
Strong with Unity Catalog, handle complex data isolation scenarios and nuances of Databricks environments.
Skills
- Expertise in monitoring data pipelines and troubleshooting.
- Familiar with Ingest frameworks, able to replicate a pipeline code across business/environments.
- Experience working with Infrastructure, able to scale the data needs.
- Worked with supporting Edge and Cloud use cases for ML/AI.
Benefits
N/A
Pay
N/A
Schedule
N/A