Jobs · Engineering

Senior Databricks Platform Engineer, Governance & FinOps

Lumenalta · United States · 2 wk ago
RemoteRemoteEngineering$90k–$132k/yrFull-time

About the role

We partner with global enterprises to design and build large-scale data platforms that power the products and operations at the center of their business. Most of that data is export-controlled, and the platform has to be both secure and affordable from day one. Access cannot be a per-table exercise here. It has to derive from classification. Running costs cannot be a surprise at the end of the month either. It has to be attributed, capped, and visible from the first workload. You will own that operational layer. You will implement the Unity Catalog governance foundation designed by the architect, put compute and cost controls in place, and give the stakeholders clear visibility into who is using what, what it costs, and whether the controls are working.

Responsibilities

  • Configure the Unity Catalog foundation, including catalogs, schemas, and baseline role-based access controls across all environments.
  • Implement the data classification and tagging approach, including governed tags that drive program-level CUI and part-level ITAR handling.
  • Implement row filters and column masks where classification requires them, so access is enforced by policy rather than by hand-built views.
  • Configure lineage capture for ingestion pipelines and make lineage usable for audit and impact analysis.
  • Implement cluster policies, budget policies, and serverless spend controls that keep compute within agreed limits without blocking engineers.
  • Design and implement cost-attribution tagging and a chargeback model by program, team, and workload.
  • Build cost and usage dashboards on Databricks system tables and AWS billing data, and report spend trends and anomalies to stakeholders.
  • Set up data quality monitoring and alerting standards for the pipelines the engineers build.
  • Support the architect in presenting governance and access controls to enterprise security reviewers, with documentation of policies

Similar jobs