AWS Databricks Platform Support Architect
LTM · Raritan, NJ · 3 wk ago
On-siteEngineeringFull-time
About the role
Lead the administration, support, governance, and optimization of enterprise Databricks platforms on AWS. Responsible for platform reliability, security, automation, performance, and production support.
Responsibilities
- Architect and support AWS Databricks environments across Dev, QA, UAT, and Prod
- Manage Databricks workspaces, clusters, jobs, workflows, Unity Catalog, and access controls
- Provide L2/L3 production support, incident management, and root cause analysis
- Implement governance, security, IAM, RBAC, monitoring, and compliance controls
- Optimize platform performance, scalability, and cloud costs
- Automate deployments using Terraform, CI/CD, and Infrastructure as Code
- Collaborate with Data Engineering, Cloud, and Security teams on platform enhancements
Requirements
- 10 years in IT with 4 years of Databricks administration/support
- Hands-on experience with AWS cloud platforms and enterprise production support
- Strong troubleshooting, stakeholder management, and leadership skills
Skills
- Databricks Workspace Administration
- Unity Catalog, Delta Lake, Cluster Management
- Jobs, Workflows
- AWS (S3, IAM, EC2, Lambda, Glue, CloudWatch, VPC, Secrets Manager)
- Data Technologies (Spark, PySpark, SQL)
- Data Lake/Lakehouse Architecture
- DevOps (Terraform, GitHub, Jenkins, Azure DevOps, CI/CD)
- Programming (Python, PySpark, Shell Scripting)
Qualifications
Preferred Certifications:
- AWS Solutions Architect Professional
- AWS Data Engineer Associate
- Databricks Certified Professional Admin
- Terraform Associate
Benefits
- Comprehensive Medical Plan covering Medical, Dental, Vision
- Short-Term and Long-Term Disability Coverage
- 401(k) Plan with Company match
- Life Insurance
- Vacation Time, Sick Leave, Paid Holidays
- Paid Paternity and Maternity Leave
Pay
The range displayed reflects the minimum and maximum salary target for the position across all US locations. Individual pay is determined by work location, job level, and additional factors including job-related skills, experience, and relevant education or training. Other forms of compensation may include an annual performance-based bonus, sales incentive pay, and other forms of bonus or variable compensation.