Databricks Architect (contract)
About the role
Tundra Technical Solutions is seeking a seasoned professional with extensive experience in data and AI-driven projects, cloud platform architecture, and data engineering solutions. The ideal candidate will have 20+ years of experience in delivering such projects, 10+ years in architecture and solution design, and 7+ years in various data acquisition frameworks and ingestion patterns.
Responsibilities
- Design and implement data and AI-driven projects
- Provide solutions especially in cloud platforms
- Design and develop data acquisition frameworks
- Design and implement solutions in various ingestion patterns like CDC, Batch, Micro Batch, Real Time Data Streaming using Spark
- Design and implement solutions in handling structured and unstructured files
- Design and implement solutions in data files in ADLS Gen2, Storage Containers, Design Domain/Sub-Domain/Data Product Storage Containers
- Leverage AI-based code assistance tools to support code development, refactoring, and productivity
- Build data layers w.r.t Medallion (Bronze/Silver/Gold) Architecture
- Develop data engineering solutions in Python, PySpark, Databricks Notebooks
- Manage GitHub, Data Pipelines, and CI/CD processes
- Define data architecture standards, reference architectures, and design patterns
- Design data governance, security, and access control models
- Coordinate and collaborate on onshore/offshore projects
- Maintain confidentiality of client proprietary, confidential, or non-public information
Requirements
The successful candidate must have a strong background in data and AI-driven projects, cloud platform architecture, and data engineering solutions. They should also have excellent communication skills and a proven track record of success in these areas.
Qualifications
The ideal candidate will have a bachelor's degree in Computer Science, Information Technology, or a related field, and at least 20 years of relevant work experience. A master's degree or additional certifications in data science, machine learning, or cloud computing will be a plus.
Skills
- Data and AI-driven project delivery
- Cloud platform architecture
- Data acquisition framework design
- Data ingestion patterns (CDC, Batch, Micro Batch, Real Time Data Streaming)
- Data file handling (structured and unstructured)
- Azure Cloud Platform
- Databricks
- Unity Catalog
- AI-based code assistance tools (GitHub Copilot, Databricks Genie)
- Python, PySpark, Databricks Notebooks
- GitHub, Data Pipelines, CI/CD
- Data architecture standards, reference architectures, and design patterns
- Data governance, security, and access control models
- Onshore/Offshore coordination and collaboration
- Confidentiality of client information
Benefits
The employer in good faith reasonably expects to pay for this position between $62.29/hour and $97.32/hour. Our offered benefits include medical, dental, vision, and retirement benefits.
Pay
$62.29/hour - $97.32/hour
Schedule
N/A
Benefits
Medical, Dental, Vision, Retirement
Application
Applications will be accepted on an ongoing basis.
Equal Opportunity Employer
Tundra Technical Solutions is an equal opportunity employer and does not discriminate on the basis of race, religion, color, national origin, sex, sexual orientation, age, veteran status, disability, genetic information, or other applicable legally protected characteristic.
Criminal History Policy
Qualified applicants with arrest or conviction records will be considered for employment in accordance with applicable law, including the Los Angeles County Fair Chance Ordinance for Employers and the California Fair Chance Act. Unincorporated LA County workers: we reasonably believe that criminal history may have a direct, adverse and negative relationship with the following job duties, potentially resulting in the withdrawal of a conditional offer of employment: client provided property, including hardware (both of which may include data) entrusted to you from theft, loss or damage; return all portable client computer hardware in your possession (including the data contained therein) upon completion of the assignment, and; maintain the confidentiality of client proprietary, confidential, or non-public information. In addition, job duties require access to secure and protected client information technology systems and related data security obligations.