Databricks Solution Architect
Tata Consultancy Services · Malvern, PA · 3 wk ago
Engineering$152k–$157k/yrFull-time
About the role
We are seeking a Databricks Solution Architect with 15+ years of experience in designing and delivering enterprise-scale data platforms, cloud modernization initiatives, and complex system integrations. The ideal candidate will lead architecture strategy, define scalable Lakehouse solutions, and collaborate with business, engineering, and enterprise stakeholders to enable data-driven transformation.
Responsibilities
- Architect and implement enterprise data platforms using Databricks Lakehouse, Delta Lake, Unity Catalog, and Spark.
- Design scalable batch, streaming, CDC, and real-time data integration solutions across enterprise applications.
- Lead migration of legacy data warehouses, Hadoop ecosystems, and on-prem platforms to modern cloud architectures.
- Define data governance, security, lineage, metadata management, and compliance frameworks.
- Provide technical leadership, architecture governance, solution reviews, and mentoring for engineering teams.
- Partner with business stakeholders to build analytics, AI/ML, and GenAI-ready data ecosystems.
- Ability to collaborate with an onsite-offshore model; influence and guide junior team members.
Skills
- Databricks: Lakehouse, Delta Lake, Unity Catalog, DLT, Databricks SQL, MLflow
- Big Data: Spark, PySpark, Scala, Kafka, Streaming Architectures
- Cloud: Azure Databricks, ADF, ADLS, Synapse, AWS S3, Glue, EMR, Redshift
- Data Warehousing: Snowflake, Data Vault, Star/Snowflake Schema, CDC
- Integration: REST APIs, Event-Driven Architecture, Enterprise SaaS/ERP/CRM integrations
- DevOps: Terraform, Azure DevOps, GitHub Actions, Jenkins, CI/CD
- Governance: Data Quality, Metadata Management, Security & Compliance
Qualifications
- Bachelor of Computer Science
- Preferred: Databricks, Azure, AWS, and TOGAF certifications with experience in BFSI, Capital Markets, Asset Management, or large enterprise environments.
Benefits
- Discretionary Annual Incentive
- Comprehensive Medical Coverage: Medical & Health, Dental & Vision, Disability Planning & Insurance, Pet Insurance Plans
- Family Support: Maternal & Parental Leaves
- Insurance Options: Auto & Home Insurance, Identity Theft Protection
- Convenience & Professional Growth: Commuter Benefits & Certification & Training Reimbursement
- Time Off: Vacation, Time Off, Sick Leave & Holidays
- Legal & Financial Assistance: Legal Assistance, 401K Plan, Performance Bonus, College Fund, Student Loan Refinancing
Pay
Salary Range: $152,000 - $157,000 a year