BI / Data Architect
Tata Consultancy Services · Marlborough, MA · 2 wk ago
Engineering$150k–$160k/yrFull-time
Skills
- Apache Iceberg, Spark, Flink, Kafka, dbt, Trino, Snowflake, Databricks
- AWS, Azure, or Google Cloud
- Python, Scala, SQL, Java
- Kubernetes, Docker, Terraform
- Airflow, Dagster, or Prefect
- Polaris, Unity Catalog, Glue Catalog, Apache Nessie
Responsibilities
- Define enterprise lakehouse architecture, standards, governance, and implementation roadmap
- Design and build Apache Iceberg-based Bronze, Silver, and Gold data layers
- Develop ingestion frameworks for batch, streaming, CDC, APIs, and event-driven integrations
- Build scalable Spark, Flink, Kafka, dbt, SQL, and Python pipelines
- Implement metadata management, cataloging, lineage, RBAC, encryption, and data quality
- Optimize partitioning, compaction, snapshots, metadata, and query performance
- Enable AI-ready semantic layers, feature engineering, RAG, and GenAI workloads
- Implement Infrastructure as Code, CI/CD, monitoring, and observability
Benefits
- Discretionary Annual Incentive
- Comprehensive Medical Coverage: Medical & Health, Dental & Vision, Disability Planning & Insurance, Pet Insurance Plans
- Family Support: Maternal & Parental Leaves
- Insurance Options: Auto & Home Insurance, Identity Theft Protection
- Convenience & Professional Growth: Commuter Benefits & Certification & Training Reimbursement
- Time Off: Vacation, Time Off, Sick Leave & Holidays
- Legal & Financial Assistance: Legal Assistance, 401K Plan, Performance Bonus, College Fund, Student Loan Refinancing
Pay
$150,000–$160,000 a year