Governance Tools_Data Engineer-Lead
Tata Consultancy Services · Irvine, CA · 6 days ago
Information Technology$110k–$150k/yrFull-time
Key Responsibilities
- Lead and manage the Data Engineering Tower, overseeing multiple teams and delivery pods.
- Own end-to-end data platform delivery, operational excellence, and SLA adherence.
- Drive scalable data pipeline development, data quality, and platform reliability.
- Manage cross-functional dependencies, stakeholder communication, and issue escalations.
- Ensure high availability, monitoring, alerting, and production support readiness.
- Collaborate with business, portfolio management, and technology leadership teams.
- Define and implement best practices for platform governance, operational readiness, and performance optimization.
Qualifications
- Strong experience with Databricks, Apache Spark, and performance tuning.
- Expertise in Apache Airflow/Astronomer for workflow orchestration and DAG design.
- Deep understanding of Data Engineering, ETL/ELT, and large-scale data platforms.
- Experience with CI/CD, DevOps, Infrastructure as Code (IaC), and automation.
- Strong platform management, monitoring, and incident management experience.
- Excellent leadership and stakeholder management skills.
Preferred Domain Experience
- Asset Management
- Investment Management
- Capital Markets
- Portfolio & Market Data Platforms