Databricks Solutions Architect

Job Summary

SMSI LLC is seeking a Databricks Solutions Architect to assist Los Alamos National Laboratory (LANL) in transforming their legacy data environment into a modern, cloud-native architecture. The role will play a critical role in defining the data strategy, standards, and blueprints for migrating and integrating high-volume operational data into a new platform.

Responsibilities

• Advises on the Databricks reference architecture covering Lakeflow, Delta Lake, Unity Catalog Mosaic AI, Databricks SQL, and Databricks Apps
• Provides hands-on guidance on Databricks full-stack solution design
• Guides platform migrations from legacy SQL and document stores onto Databricks and related cloud data platforms
• Recommends security, governance, and compliance-as-code: Unity Catalog ABAC, governed tags, row filters/column masks, key management, networking security and compliance security profiles
• Recommends FinOps and performance standards, workload and cost management
• Mentors data engineers, analysts, and AI/ML teams, participates in architecture reviews, and contributes to standards
• Works with information & cyber security, and other teams as needed for compliance to policies and standards
• Evaluates emerging Databricks capabilities and recommends adoption strategies, including endpoint integrations with third parties as they evolve

Job Requirements

• 5+ years of progressive experience in data architecture, data modernization, and cloud-based data solutions
• Hands-on experience with Delta Lake, Unity Catalog, Spark Structured Streaming, Lakeflow (or DLT/Live Tables), Databricks SQL, MLflow, and Mosaic AI Model Serving
• Strong experience in cloud architecture supporting the platform (VPC/VNet, Security, S3/ADLS, KMS, etc.)
• Proven experience migrating enterprise data workloads from legacy/on prem data warehouse/lake to Databricks Production streaming and CDC experience
• Depth in security and governance: Unity Catalog policies (ABAC), classification, encryption, access auditing, compliance-to-control translation
• Strong Python and SQL, Spark, Notebooks
• Excellent verbal and written communication skills
• The candidate must be able to obtain and maintain a DOE Q clearance
• The candidate must have an active Real ID diver's license for badging and onboarding

Preferred Qualifications

• 7+ years designing, building, and operating Databricks workloads with medallion layer architecture
• Hands-on experience with Delta Lake, Unity Catalog, Spark Structured Streaming, Lakeflow (or DLT/Live Tables), Databricks SQL, MLflow, and Mosaic AI Model Serving
• Strong experience in cloud architecture supporting the platform (VPC/VNet, Security, S3/ADLS, KMS, etc.)
• Proven experience migrating enterprise data workloads from legacy/on prem data warehouse/lake to Databricks Production streaming and CDC experience
• Depth in security and governance: Unity Catalog policies (ABAC), classification, encryption, access auditing, compliance-to-control translation
• Strong Python and SQL, Spark, Notebooks
• Excellent verbal and written communication skills
• Active (or recent) Q clearance is a plus but not required

Nice to Have

• GenAI and agent systems on Databricks experience
• Familiarity with Oracle EBS and SAP enterprise data
• Experience with SAP BDC/DataSphere and Databricks integration to SAP BDC, with zero-copy patterns
• Lakeflow Designer, Databricks Apps, Genie, Databricks OneCI/CD, Infrastructure-as-Code (e.g. Terraform) for data platforms
• Experience in designing, building, supporting BI reporting layers
• Data Quality and Data Governance experience
• Prior experience in regulated industries (e.g. utilities, life sciences, government services) and exposure to related frameworks (e.g. FERC/NERC, HIPAA, GxP, GDPR, FedRAMP, ITAR, etc.)

Education Requirements

Bachelor’s degree, preferably in computer science, engineering, information systems, or related discipline, along with 12 years of experience. Equivalent combination of education and experience will be considered. Certifications are a plus.