Solutions Architect 4 (Data Architect)
Edgewater Technical Associates, LLC · Los Alamos, NM · 4 wk ago
EngineeringFull-time
About the role
The Data Architect will be using agile methodologies to design, build, and transform business solutions through an ERP Modernization effort and beyond to stabilization. As a member of the Business Applications and Data Services group (ADS-BADS), you will focus on executing an enterprise-wide data strategy to modernize our core operational data store and transition to a cutting-edge, scalable data platform.
Responsibilities
- Advise on the Databricks reference architecture covering Lakeflow, Delta Lake, Unity Catalog Mosaic AI, Databricks SQL, and Databricks Apps
- Provide hands-on guidance on Databricks full-stack solution design
- Advise on design of both data movement (e.g. batch, real-time streaming) and zero-copy patterns
- Guide platform migrations from legacy SQL and document stores onto Databricks and related cloud data platforms
- Recommend security, governance, and compliance-as-code: Unity Catalog ABAC, governed tags, row filters/column masks, key management, networking security and compliance security profiles
- Advise on design of segregated/tiered data pool architectures aligned to the organization's data classification policy and applicable regulatory requirements, including cross-tier data movement
- Recommend FinOps and performance standards, workload and cost management
- Mentor data engineers, analysts, and AI/ML teams participate in architecture reviews and contribute to standards
- Work with information & cyber security, and other teams as needed for compliance to policies and standards
- Evaluate emerging Databricks capabilities and recommend adoption strategies, including endpoint integrations with third parties as they evolve
Requirements
- Masters/15+ years of experience; additional experience may be considered in lieu of experience
- 7+ years designing, building, and operating Databricks workloads with medallion layer architecture
- Certifications: Oracle ERP Cloud and SAP
- Hands-on experience with Delta Lake, Unity Catalog, Spark Structured Streaming, Lakeflow (or DLT/Live Tables), Databricks SQL, MLflow, and Mosaic AI Model Serving
- Strong experience in cloud architecture supporting the platform (VPC/VNet, Security, S3/ADLS, KMS, etc.)
- Proven experience migrating enterprise data workloads from legacy/on prem data warehouse/lake to Databricks
- Production streaming and CDC experience
- Depth in security and governance: Unity Catalog policies (ABAC), classification, encryption, access auditing, compliance-to-control translation
- Hands-on experience designing multi-tier Databricks architectures driven by data classification requirements
- Strong Python and SQL, Spark, Notebooks
- Excellent verbal and written communication skills
Qualifications
- Previous government experience
- Active Databricks certifications
- GenAI and agent systems on Databricks experience
- Delta Sharing and Databricks Clean Rooms for controlled, governed data exchange across organizational/cross-tier/system boundaries
- Familiarity with Oracle EBS and SAP enterprise data
- Experience with SAP BDC/DataSphere and Databricks integration to SAP BDC, with zero-copy patterns
- Lakeflow Designer, Databricks Apps, Genie, Databricks One
- CI/CD, Infrastructure-as-Code (e.g. Terraform) for data platforms
- Experience in designing, building, and supporting BI reporting layers
- Data Quality and Data Governance experience
- Prior experience in regulated industries (e.g. utilities, life sciences, government services) and exposure to related frameworks (e.g. FERC/NERC, HIPAA, GxP, GDPR, FedRAMP, ITAR, etc.)