Systems Analyst 3 – Databricks Data Engineering | Austin, TX Hybrid | 8+ Years Databricks Experience

Key Responsibilities

• Design, develop, and optimize scalable data solutions on Databricks using PySpark or Scala for large-scale data processing
• Build and maintain data ingestion pipelines, Declarative Pipelines (DLT), and Medallion Architecture (Bronze, Silver, Gold) to support enterprise analytics and reporting
• Create robust data models and implement data quality, validation, and governance frameworks
• Create dynamic dashboards, Databricks Apps, and analytical solutions to deliver actionable business insights
• Optimize workloads, monitoring, and operational processes to ensure scalability, security, and cost efficiency
• Analyze user requirements, procedures, and problems to automate processing or improve existing computer systems
• Confer with organizational units to analyze current operational procedures, identify problems, and learn specific input and output requirements
• Write detailed descriptions of user needs, program functions, and steps required to develop or modify computer programs
• Review computer system capabilities, specifications, and scheduling limitations to determine feasibility of requested programs or changes
• Present insights to technical and business stakeholders with excellent verbal and written communication skills

Required Qualifications

• 8+ years of experience in IT, supporting the design, development, deployment, or delivery of technology solutions
• 8+ years of experience with Databricks, including building and optimizing ETL/ELT data pipelines using Apache Spark
• 8+ years of experience in data warehousing and dimensional data modeling (star/snowflake schemas)
• 8+ years of proficiency in SQL and Python (or Scala) for large-scale data processing
• 8+ years of experience designing and developing dashboards and applications natively within Databricks (e.g., Databricks SQL dashboards, Databricks Apps)
• 8+ years of experience implementing data governance, data quality, and data security practices
• 8+ years of experience implementing Lakeflow Declarative Pipelines (formerly Delta Live Tables/DLT) for building and managing production data pipelines
• 8+ years of experience with Delta Lake, medallion architecture (bronze/silver/gold layers), data lakehouse design, and creating and scheduling offline jobs using Lakeflow Jobs (formerly Databricks Workflows) or similar orchestration tools (e.g., Airflow)
• Excellent communication skills, both verbal and written, including presenting insights to technical and business stakeholders

Preferred Qualifications

• Experience working in public sector or state government environments
• Databricks certification (e.g., Databricks Certified Data Engineer Associate/Professional)
• Experience with CI/CD practices for data pipelines (DevOps, Git-based workflows)