DataBricks Admin
Tata Consultancy Services · Marlborough, MA · 3 wk ago
Administrative$100k–$130k/yrFull-time
Roles & Responsibilities
- Implement, administer, and maintain the Databricks platform on AWS.
- Provide operational support to data engineering, data science, and application teams.
Requirements
- Technical/Functional Skills: Databricks Administration, Terraform, AWS cloud services, MLflow, Workflows, Databricks Asset Bundles, AWS IAM, VPC, private endpoints, firewalls, S3, SQL + PySpark, dbx CLI
- Experience with Databricks Platform Administration including environment setup, user and group management, Access control configuration, and familiarity with networking and firewall rules.
- Familiarity with Cluster and Resource Management.
- Strong troubleshooting skills, backup and recovery, REST APIs.
- Security and Compliance: IAM, ACL, Unity Catalog.
- Integration with data warehouses, cloud storage, data pipeline orchestration.
- Automation using Terraform, CI/CD pipelines.
Qualifications
- Proven experience in managing and administering Databricks platforms.
- Experience with AWS cloud services and infrastructure.
- Knowledge of MLflow, Workflows, and Databricks Asset Bundles.
- Experience with SQL and PySpark.
- Experience with Databricks Platform Administration including environment setup, user and group management, Access control configuration, and familiarity with networking and firewall rules.
- Familiarity with cluster and resource management.
- Strong troubleshooting skills, backup and recovery, REST APIs.
- Experience with security and compliance practices such as IAM, ACL, Unity Catalog.
- Experience with integration with data warehouses, cloud storage, and data pipeline orchestration.
- Experience with automation tools like Terraform, CI/CD pipelines.
Benefits
- Discretionary Annual Incentive.
- Comprehensive Medical Coverage: Medical & Health, Dental & Vision, Disability Planning & Insurance, Pet Insurance Plans.
- Family Support: Maternal & Parental Leaves.
- Insurance Options: Aut& Home Insurance, Identity Theft Protection.
- Convenience & Professional Growth: Commuter Benefits & Certification & Training Reimbursement.
- Time Off: Vacation, Time Off, Sick Leave & Holidays.
- Legal & Financial Assistance: Legal Assistance, 401K Plan, Performance Bonus, College Fund, Student Loan Refinancing.
Pay
$100,000 - $130,000 per year
Schedule
N/A