Systems Analyst 3

Job Summary

Systems Analyst 3 (Databricks Engineer)

Duration

12 Months

About the Role

Analyze business objectives and user requirements to identify, assess, and recommend technology solutions, including performing cost/benefit studies of alternatives. Collaborate with business and technical teams to understand operational procedures, identify issues, and gather requirements for data input, processing, and reporting. Write detailed functional and technical documentation, including user needs, program functions, and specifications for new or modified systems. Design, develop, and optimize scalable data solutions on Databricks, utilizing PySpark or Scala for large-scale data processing tasks. Build and maintain robust ETL/ELT data pipelines, Declarative Pipelines (Lakeflow/DLT), and Medallion Architecture (Bronze/Silver/Gold layers) to support enterprise analytics and reporting. Implement data warehousing and dimensional data modeling (star/snowflake schemas). Develop and maintain dashboards and applications natively within Databricks (e.g., Databricks SQL dashboards, Databricks Apps) to deliver actionable business insights. Implement and maintain data governance, data quality, and data security frameworks. Optimize workloads, monitoring, and operational processes to ensure system scalability, security, and cost efficiency. Schedule and orchestrate offline jobs using Lakeflow Jobs (Databricks Workflows) or similar tools (e.g., Airflow).

Responsibilities

• Analyze business objectives and user requirements to identify, assess, and recommend technology solutions, including performing cost/benefit studies of alternatives.
• Collaborate with business and technical teams to understand operational procedures, identify issues, and gather requirements for data input, processing, and reporting.
• Write detailed functional and technical documentation, including user needs, program functions, and specifications for new or modified systems.
• Design, develop, and optimize scalable data solutions on Databricks, utilizing PySpark or Scala for large-scale data processing tasks.
• Build and maintain robust ETL/ELT data pipelines, Declarative Pipelines (Lakeflow/DLT), and Medallion Architecture (Bronze/Silver/Gold layers) to support enterprise analytics and reporting.
• Implement data warehousing and dimensional data modeling (star/snowflake schemas).
• Develop and maintain dashboards and applications natively within Databricks (e.g., Databricks SQL dashboards, Databricks Apps) to deliver actionable business insights.
• Implement and maintain data governance, data quality, and data security frameworks.
• Optimize workloads, monitoring, and operational processes to ensure system scalability, security, and cost efficiency.
• Schedule and orchestrate offline jobs using Lakeflow Jobs (Databricks Workflows) or similar tools (e.g., Airflow).

Requirements

• 8+ years of relevant IT experience.
• Deep expertise in Databricks, Apache Spark, Delta Lake, data warehousing, data modeling, SQL, Python/Scala, and data governance/security.
• Strong experience implementing Lakeflow Declarative Pipelines and Medallion Architecture.
• Excellent verbal and written communication skills.

Qualifications

• (Preferred) Experience in government/public sector, Databricks certification, CI/CD for data pipelines.

Skills

• Experience in government/public sector, Databricks certification, CI/CD for data pipelines.

Benefits

N/A

Pay

N/A

Schedule

Hybrid - Austin, TX 78751