Sr Databricks Architect
Inceptra Solutions LLC · Jersey City, NJ · 3 wk ago
Art & CreativeFull-time
Location: Jersey City, NJ | Onsite (5-Days) | Contract
About the role
We are seeking a Senior Databricks Platform Architect to lead secure, scalable Databricks deployments on AWS. This role requires hands-on infrastructure expertise combined with the ability to independently lead architecture and enablement sessions with large customer teams.
Responsibilities
- Design and deploy Databricks classic and serverless workspaces on AWS, including networking, storage, and identity integration
- Author and maintain Terraform modules to provision and manage AWS and Databricks resources in a repeatable, secure manner
- Define and implement platform security architecture, including workspace isolation, cluster access controls, secrets management, and network security patterns
- Lead architecture enablement sessions and workshops with large, cross-functional customer teams
- Guide customer teams through Databricks security accreditation and compliance processes
- Partner with customer cloud, security, network, and platform teams to validate architecture decisions and troubleshoot deployment issues
- Produce clear architecture documentation, diagrams, and runbooks for platform configurations
Requirements
- 10+ years of experience in cloud infrastructure, data platform engineering, or platform architecture
- 5+ years of hands-on experience designing, deploying, configuring, and securing Databricks on AWS, including classic and serverless workspaces
- Strong experience with Databricks platform administration, workspace architecture, security configuration, and production deployments
- Strong hands-on experience with Terraform and Infrastructure as Code (IaC) for provisioning and managing Databricks and AWS resources
- Experience with CI/CD pipelines, infrastructure automation, deployment administration, and DevOps best practices is highly preferred
- Proven experience designing and implementing Databricks platform security, including workspace isolation, identity/SSO integration, cluster access controls, secret scopes, and secure platform configuration
- Demonstrated ability to independently lead architecture workshops, technical enablement sessions, and design reviews with customers and cross-functional stakeholders
- Experience producing architecture documentation, platform diagrams, implementation guides, and operational runbooks
- Working knowledge of AWS infrastructure and networking, including S3, IAM, VPCs, PrivateLink, load balancing, and networking concepts (hands-on experience preferred)
- Excellent verbal and written communication skills with the ability to partner effectively with cloud, networking, security, and platform engineering teams