Senior Data Engineer

Key Responsibilities

• Data Engineering & Platform Development
• Design, develop, and maintain scalable batch and streaming data pipelines using Databricks and/or cloud-native services.
• Build and optimize ETL/ELT workflows that support operational reporting, analytics, machine learning, and data-sharing initiatives.
• Develop and maintain medallion architecture patterns (Bronze, Silver, Gold) within Databricks Lakehouse environments.
• Implement data integration solutions across multiple structured and unstructured healthcare data sources.
• Create reusable frameworks, templates, and accelerators that improve engineering productivity and consistency.

Data Operations (DataOps)

• Establish and maintain DataOps processes that support reliable, automated, and observable data pipelines.
• Maintain pipeline health, performance, data quality, and operational SLAs.
• Implement automated testing, deployment, version control, and CI/CD practices for data products.
• Develop proactive monitoring, alerting, and incident response procedures.
• Resolve production data issues while minimizing operational impact.

Healthcare & Regulatory Compliance

• Ensure solutions comply with CMS, federal, and healthcare-specific security, privacy, and data governance requirements.
• Support environments containing protected health information (PHI), personally identifiable information (PII), and other sensitive healthcare datasets.
• Implement auditability, lineage, metadata management, and data quality controls.
• Partner with governance and security teams to ensure compliance with applicable standards and policies.

Architecture & Technical Leadership

• Collaborate with solution architects and customer stakeholders to define data platform strategy and implementation roadmaps.
• Lead technical design reviews and contribute to enterprise data architecture decisions.
• Optimize data storage, processing performance, and cost management within cloud environments.
• Mentor junior engineers and promote engineering best practices across teams.

Required Qualifications

• Experience: Bachelor's degree in Computer Science, Information Systems, Engineering, or related technical discipline. 8+ years of data engineering experience, including large-scale enterprise data environments. 3+ years supporting CMS or other federal healthcare programs.
• Technical Skills: Expert-level experience with Databricks Lakehouse Platform. Strong proficiency with Apache Spark, PySpark, SQL, and Python. Experience designing and maintaining operational data pipelines at enterprise scale. Hands-on experience with cloud data platforms in AWS or Azure cloud environments. Experience implementing CI/CD pipelines using Git-based development workflows. Expertise in data quality, observability, lineage, metadata management, and monitoring frameworks. Experience with orchestration and workflow management tools. Strong knowledge of lakehouse, warehouse, and modern data architecture patterns. Regulatory & Healthcare Knowledge: Experience supporting CMS, Medicare, Medicaid, or other federal healthcare data programs. Understanding of healthcare data governance, security, privacy, and compliance requirements. Experience working with healthcare data standards and regulated datasets. Familiarity with Federal Information Security requirements and operational controls.

Preferred Qualifications

• Databricks Certified Data Engineer Professional
• Additional Databricks certifications
• Experience supporting cloud-native analytics platforms for CMS
• Experience implementing Delta Lake, Unity Catalog, and advanced Databricks governance capabilities
• Familiarity with machine learning operations (MLOps) and AI/ML data pipelines
• Experience with Collibra, Informatica, Unity Catalog or comparable data governance platforms
• Experience supporting FedRAMP or FISMA-compliant environments

Desired Competencies

• Deep technical expertise in modern data engineering and DataOps practices
• Strong problem-solving and troubleshooting abilities
• Exceptional written and verbal communication skills
• Ability to translate business requirements into scalable technical solutions
• Prowess in data quality, operational excellence, and continuous improvement

About Analytica

Analytica is a leading consulting and information technology solutions provider to public sector organizations supporting health, civilian, and national security missions. The company is an award-winning SBA certified small business that has been recognized by Inc. Magazine each of the past three years as one of the 250 fastest-growing companies in the U.S. Analytica specializes in providing software and systems engineering, information management, analytics & visualization, agile project management, and management consulting services. The company is appraised by the Software Engineering Institute (SEI) at CMMI® Maturity Level 3 and is an ISO 9001:2008 certified provider.