Starburst Architect
Tata Consultancy Services · Charlotte, NC · 1 wk ago
Art & Creative$100k–$140k/yrFull-time
Roles & Responsibilities
- Design and implement federated query and open Lakehouse architecture.
- Enable seamless, high-performance SQL access across disparate, distributed data sources (lakes, data warehouses, and relational databases).
- Collaborate with InfoSec and compliance teams to enforce role-based access control, row/column-level security, and data lineage using tools like Apache Ranger.
- Support downstream data consumption for BI (Tableau, Power BI) and act as a foundation for enterprise AI and RAG pipelines.
Data Virtualization Strategy
- Design federated data access solutions utilizing distributed SQL engines and open table formats to abstract away underlying data storage locations.
Platform Architecture
- Architect, deploy, and scale Starburst Enterprise or Starburst Galaxy platforms.
- Configure and manage diverse connectors to object storage (S3, ADLS), NoSQL, and relational databases.
Performance Tuning
- Optimize distributed SQL queries, resolve data processing bottlenecks, and implement workload management and caching strategies.
Governance & Security
- Collaborate with InfoSec and compliance teams to enforce role-based access control, row/column-level security, and data lineage using tools like Apache Ranger.
AI & Analytics Enablement
- Enable downstream data consumption for BI (Tableau, Power BI).
Qualifications
BACHELOR OF COMPUTER SCIENCE