Data Engineering Technical Lead - VP

Responsibilities

• Modernize legacy ETL pipelines (SSIS/SSRS) into modular, high-performance pipelines using Databricks, dbt, Fivetran, and Airflow.
• Architect reusable data design patterns for ingestion, transformation, curation, and consumption layers across the Lakehouse.
• Develop and lead POCs/POVs to evaluate new technologies (e.g., Delta Live Tables, Iceberg, streaming ingestion, AI-driven observability).
• Leverage AI-assisted tools for code generation, automated testing, documentation, and pipeline optimization.
• Apply ML for operational intelligence to detect pipeline anomalies, data drift, and optimize compute/scheduling.
• Enforce engineering excellence through CI/CD, version control, peer reviews, and observability practices.
• Collaborate cross-functionally with data architects, platform engineers, analysts, and business product owners.
• Mentor data engineers and foster continuous learning.
• Optimize performance and cost across Azure and GCP environments.

Requirements

• Bachelor’s degree
• 8+ years in data engineering, with 3+ years in a lead or senior role
• Experience designing data design patterns (e.g., CDC, SCD, Medallion, Data Vault, streaming, batch)
• Deep expertise with Databricks, Apache Spark, dbt, Fivetran, Census, Airflow, Kafka
• Experience with Azure and/or GCP (Synapse, Data Factory, BigQuery, Pub/Sub)
• Hands-on experience modernizing legacy ETL (SSIS/SSRS) into cloud-native pipelines
• Ability to build POCs and POVs
• Working knowledge of AI-assisted engineering tools
• Proficiency in SQL and one programming language (Python, Scala, or Java)
• Strong problem-solving, architectural thinking, and collaboration skills
• Excellent communication skills to translate technical topics to business stakeholders

Benefits

• Medical, Dental, Vision, and Life Insurance
• Paid Sick Leave, 3 weeks' Vacation, and Holidays (~11 per year)
• HSA or FSA account and voluntary benefits
• 401(k) with Employer Match and 529 Savings Plan
• Employee Mortgage Loan Program and free Axos Bank Account with Self-Directed Trading