Data Platform Engineer

About the role

We're seeking experienced Data Platform Engineers with deep Databricks and Unity Catalog expertise to support a growing portfolio of clients building modern lakehouse platforms. This role focuses on building resilient and scalable data foundations — owning access control, data quality, cataloging, lineage, and business semantics within Unity Catalog. You'll play a key role in ensuring data across the platform is trusted, well-governed, and ready to power analytics and AI use cases.

Responsibilities

• Own data governance within Databricks, primarily through Unity Catalog, across access control, cataloging, auditing, lineage, data quality, business semantics, cost controls, and data sharing.
• Design and implement access control and security models (catalogs, schemas, row/column-level permissions) within Unity Catalog.
• Build and maintain data quality frameworks and validation rules directly in the platform (e.g., Delta Live Tables expectations, constraints).
• Certify tables and identify "gold standard" datasets, establishing what's official and production-ready across the lakehouse.
• Define and maintain business semantics (metadata, glossaries, table/column documentation) that ground AI and natural-language query systems in accurate context — critical for preventing hallucinations in downstream AI use cases.
• Implement lineage tracking and auditing across pipelines and consumption layers.
• Manage cost controls and governance over compute/storage usage within Databricks.
• Partner with data engineers, AI/ML teams, and business stakeholders to ensure governance is embedded across the full platform, not siloed.
• Stay current on Unity Catalog capabilities across data, ML, and AI workloads.

Requirements

• Strong, hands-on experience with Databricks and Unity Catalog — this is a platform-native governance role, not a legacy MDM/DQ tool role.
• Demonstrated experience building governance frameworks: access control, data quality, lineage, cataloging, and metadata/business semantics.
• Comfort working across the full data platform — pipelines, ML, and AI workloads — with enough AI literacy to support semantic layers that power LLM/AI applications.
• Proficiency in SQL, Python, and data pipeline development.
• Experience with Delta Lake architecture preferred.
• Excellent communication skills — able to work cross-functionally as governance touches every part of the project, not as a standalone function.
• Bachelor's or Master's degree in Computer Science, Information Systems, or related field.

Benefits

• Flexible working hours in a remote environment.
• Health insurance (medical and dental) for W2 Employees.
• 401K Contribution.
• A professional development fund to enhance your skills and knowledge.
• 15 days of paid time off annually.
• Access to soft-skill development courses to further your career.

Pay

Salary range: $80,000 - $150,000 annually, with final compensation determined by your qualifications, expertise, experience, and the role's scope.

Schedule

• Full-time position requiring a minimum of 40 hours per week, Monday through Friday.
• Fully remote; candidates must be based in regions that align with the Pacific, Central, or Eastern U.S. time zones.

Why Lumenalta

• Be 100% dedicated to one project at a time so that you can innovate and grow.
• Be part of a team of talented and collaborative senior-level professionals.
• Work on projects that allow you to leverage modern data platforms and industry-leading tools.