Sr. Databricks Consultant

This position is contingent upon additional funding and may be based in our Arlington, VA office or performed remotely.

About the role

We are seeking a skilled individual with deep experience in Databricks to join our team. The primary responsibility of this role is to consult with customers to design, optimize, and fine-tune their Databricks environments for advanced data analytics, machine learning, and AI-driven insights. You will specialize in data pipeline optimization, scalable model training, and advanced analytics on Databricks, supporting ECS’s Professional Services and Managed Cybersecurity Services programs.

Responsibilities

• Design, build, and maintain scalable ETL/ELT pipelines in Databricks.
• Optimize workflows and clusters for performance and cost efficiency.
• Integrate Databricks with cloud platforms (AWS, Azure, or GCP).
• Implement data governance, security, and compliance standards.
• Collaborate with data scientists, analysts, and business stakeholders to deliver high-quality datasets and insights.
• Troubleshoot issues and drive continuous improvement in data infrastructure.

Requirements

• Proven experience working with Databricks in production environments.
• Strong proficiency in Python and/or SQL for data engineering.
• Experience with Apache Spark for distributed data processing.
• Knowledge of data lakehouse architecture and best practices.
• Experience with cloud data platforms (AWS S3, Azure Data Lake, or GCP Storage).
• Hands-on experience building and managing ETL/ELT pipelines.
• Strong understanding of data modeling, data quality, and performance tuning.
• Familiarity with CI/CD pipelines and version control (Git).
• Ability to travel to customer sites as needed.
• Must be a US Citizen per contract.
• Bachelor’s degree; preferably in Computer Science, Information Security, or a related field. Will consider experience in lieu of a degree.

Qualifications

• Master's degree or PhD in Computer Science, Data Science, or a related field.
• Experience with machine learning pipelines in Databricks (MLflow).
• Knowledge of Delta Lake and Unity Catalog for governance.
• Familiarity with streaming technologies (Kafka, Kinesis, or Event Hubs).
• Exposure to data visualization tools (Tableau, Power BI, or Looker).
• Experience with Terraform, ARM, or CloudFormation for infrastructure as code.
• Background in data security and compliance (HIPAA, FedRAMP, SOC2, etc.).
• Strong understanding of DevOps/MLOps practices.
• Prior consulting or customer-facing experience.
• Skills in project management and familiarity with methodologies like Agile.

Pay

Salary Range: $175,000 - $250,000

About ECS

ECS Federal LLC is the federal segment of Everforth, a $4B global organization with over 10,000 employees. Our nearly 3,500 professionals deliver advanced technology solutions in data and AI, cybersecurity, and enterprise transformation, serving defense, intelligence, and federal civilian agencies. We are defined by a commitment to excellence in delivery, a culture of innovation, and an environment where talent can thrive and grow.