Database Engineer
Profiles · Irvine, CA · 1 mo ago
HybridEngineering$150k/yrFull-time
About the role
A leader in the financial services industry is hiring a Database Engineer- Databricks in Irvine, CA for a full time position, onsite 2 days a week.
Requirements
- 3+ years of hands-on data engineering experience in a production environment
- Deep Databricks expertise including notebooks, Jobs, Workflows, Unity Catalog governance, and Databricks Certification
- Strong Python, PySpark, and SQL skills for building and debugging distributed data transformations
- Solid MSSQL/SQL Server experience with focus on query optimization, indexing, and performance diagnostics
- Prior production experience with Apache Airflow — authoring, scheduling, and debugging DAGs
Responsibilities
- Own day-to-day operation and reliability of Databricks jobs, pipelines, compute/cluster configuration, Delta Lake tables, and SQL warehouses
- Develop and optimize Spark transformations across bronze/silver/gold medallion layers including incremental loads via Auto Loader and Structured Streaming
- Administer governance and access through Unity Catalog consistent with PII containment in a regulated lending environment
- Monitor and control DBU consumption and cluster costs through alerting and right-sizing to keep platform spend predictable
- Diagnose and resolve pipeline failures, data quality issues, schema drift, and connectivity problems end-to-end while maintaining runbooks and documentation
Perks
- Competitive salary up to $150,000 annually
- Working for one of the most trusted names in financial services for more than 100 years, a brand known by millions
- Flexibility and work-life balance
- Working for a caring and supportive team that values your input, shares your goals, and celebrates your success