Jobs · Engineering

Solution Architect Data Engineering (Azure Databricks)

Avanciers Inc. · United States · 5 days ago
RemoteRemoteEngineeringFull-time

Solution Architecture

Define and implement end-to-end data architecture (ingestion, transformation, consumption)

Design scalable Lakehouse architectures (Databricks, Delta Lake)

Develop reference architectures, reusable frameworks, and design patterns

Align architecture with performance, scalability, security, and cost optimization goals

Data Modeling & Domain Architecture

Define canonical data models, dimensional schemas, and semantic layers

Architect enterprise data across domains: Claims, Member, Provider, Eligibility

Ensure data consistency, interoperability, and reuse across teams

Azure Databricks & Cloud Enablement

Architect solutions using: Azure Databricks (Mandatory), Azure Data Services (ADF, ADLS, Synapse)

Guide engineering teams on: Spark optimization, Delta Lake design, and data pipeline best practices

Enable multi-cloud integrations when required

Governance, Security & Compliance

Define and enforce: Data governance frameworks (lineage, quality, metadata)

Access control, RBAC, and data security policies

Ensure compliance with: HIPAA, HITRUST, and enterprise regulatory standards

Establish data quality SLAs and auditability mechanisms

Engineering & Platform Alignment

Work closely with Data Engineering teams, Platform Engineering teams, AI/ML Engineering teams

Provide architectural oversight for pipelines, workflows, and platform capabilities

Drive standardization across CI/CD, DataOps, and MLOps practices

Stakeholder & Business Engagement

Collaborate with business, product, and analytics teams to translate requirements into scalable technical solutions

Lead architecture reviews, design approvals, and governance forums (ARB)

Communicate architecture decisions and trade-offs to leadership

Similar jobs