Azure Databricks Data Engineer

Date Posted: 08/03/2026 Hiring Organization: Rose International Position Number: 505118 Job Title: Azure Databricks Data Engineer Job Location: Atlanta, GA, USA, 30301 Work Model: Hybrid Work Model Details: 3 days/week in the office Employment Type: Temporary FT/PT: Full-Time Estimated Duration (In months): 16 Min Hourly Rate($): 50.00 Max Hourly Rate($): 55.00 Must Have Skills/Attributes: Azure, Databricks, ETL, Python, Snowflake, SQL Experience Desired: Designing, Implementing, and Optimizing Azure Databricks Lakehouse Solutions, Including ETL Pipeline (5+ yrs); Azure Data Engineering Using Adls Gen2, Databricks SQL, Python, Event Hub, Key Vault, and CI/CD (5+ yrs); Data Architecture & Data Modeling, Including Dimensional Modeling, ETL Design, Code Reviews (5+ yrs) Required Minimum Education: Bachelor’s Degree Preferred Certifications/Licenses: Databricks and Azure Certifications **C2C is not available** Job Description ***Only qualified Azure Databricks Data Engineer candidates located near Atlanta, GA to be considered due to the position requiring an onsite presence. *** Required Education Bachelor’s degree in computer science, Information Technology, or related field Preferred Certifications Databricks and Azure Certifications Required Skills, Experience, & Abilities Strong hands-on knowledge of Azure Databricks and the Azure platform, with proven experience operating a production Lakehouse at scale Proficiency in Databricks SQL, Python, and other relevant programming languages. Deep Azure knowledge: ADLS Gen2, Key Vault, Networking (VNet/Private Endpoints), Event Hub Deep understanding of advanced data warehouse concepts (dimensional modeling, SCD, surrogate key management) is required Experience with data modeling, dimensional modeling, and temporal data structures in an operational ETL environment Unity Catalog security & lineage. Strong business problem framing and stakeholder communication. Experience establishing engineering standards, performing design/code reviews, and mentoring data engineers Excellent problem-solving and communication skills Ability to work independently and collaboratively in a fast-paced environment. Role Responsible for supporting and evolving the Azure Databricks Lakehouse architecture of an established Data Warehouse team – setting design standards, governing the platform, unlocking full Databricks/Databricks AI capabilities, and optimizing solutions for performance, cost, security, and scalability. Responsibilities You will act as the technical design authority for an existing Databricks ETL team, working alongside customer business, development, Databricks, and DevOps teams. You will support and evolve the production Lakehouse architecture: Delta medallion layers, Databricks SQL Warehouses, Unity Catalog security, and data lineage. You will define and enforce design standards, reusable patterns, and best practices across the existing pipeline estate and all new development You will design new ingestion, streaming, and batch pipelines and review team designs against the medallion (bronze/silver/gold) architecture. You will drive continuous optimization of the running platform: cluster sizing, autoscaling, Photon usage (if decided), query performance, Delta Liquid Clustering/Z-Ordering, VACUUM strategies, and DBU cost governance You will translate business questions into analytical models, KPIs, and reusable semantic layers. You will mature CI/CD (Azure DevOps/GitHub), observability, and security (RBAC, row/column-level policies) across existing pipelines. You will evaluate and drive adoption of new Databricks capabilities (Lakeflow, Delta Live Tables, serverless compute, AI/BI) where they add value. You will conduct architectural reviews, code audits, and mentoring sessions to raise the team’s engineering bar and ensure adherence to standards and scalability. You will guide the team in version control, automated testing, and release discipline for Databricks notebooks, jobs, and workflows.**Only those lawfully authorized to work in the designated country associated with the position will be considered.****Please note that all Position start dates and duration are estimates and may be reduced or lengthened based upon a client’s business needs and requirements.** Benefits For information and details on employment benefits offered with this position, please visit here. Should you have any questions/concerns, please contact our HR Department via our secure website. California Pay Equity For information and details on pay equity laws in California, please visit the State of California Department of Industrial Relations' website here. Rose International is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, age, sex, sexual orientation, gender (expression or identity), national origin, arrest and conviction records, disability, veteran status or any other characteristic protected by law. Positions located in San Francisco and Los Angeles, California will be administered in accordance with their respective Fair Chance Ordinances. If you need assistance in completing this application, or during any phase of the application, interview, hiring, or employment process, whether due to a disability or otherwise, please contact our HR Department. Rose International has an official agreement (ID #132522), effective June 30, 2008, with the U.S. Department of Homeland Security, U.S. Citizenship and Immigration Services, Employment Verification Program (E-Verify). (Posting required by OCGA 13/10-91.).