Specialist - Architecture

About the role

We are seeking a Senior Data Engineer to build and maintain ML training pipelines, feature stores, and multi-source data integrations on the GCP platform. This role involves designing disaster recovery strategies, ensuring HIPAA compliance for PHI data, and optimizing data architectures for analytics and machine learning.

Responsibilities

• Develop, optimize, and maintain data pipelines in GCP using BigQuery, Dataflow, Kafka, and Spark.
• Design and implement ML training pipelines and feature stores (GCP Feature Store preferred).
• Manage the ML lifecycle, including feature engineering, data versioning, and train/eval splits.
• Build disaster recovery zones and failover strategies, including cross-region replication, RTO/RPO definition, and DR testing.
• Implement data archival designs, BigQuery table lifecycle management, and Cloud Storage tiered storage policies for regulated datasets.
• Ensure HIPAA compliance for PHI data, including field-level encryption, masking, de-identification, audit logging, and access controls.
• Optimize BigQuery performance through partitioning, clustering, and cost management.
• Collaborate with downstream consumers like Looker or Vertex AI for analytics and ML applications.

Requirements

• 7+ years of hands-on data engineering or ML data engineering experience in a production GCP environment.
• Strong proficiency in Python, Java, or Node.js for pipeline development, feature engineering, and automation.
• Expertise in BigQuery, including complex SQL, partitioning, clustering, and ML-optimized table design.
• Hands-on experience with Apache Kafka for real-time streaming ingestion.
• Proficiency with Dataflow/Apache Beam for both streaming and batch pipelines.
• Experience with Apache Spark (PySpark or Scala) and familiarity with GCP ecosystem tools (Cloud Storage, Pub/Sub, Dataproc, Cloud Composer/Airflow).
• Experience with Vertex AI Pipelines or similar MLOps tooling.
• Strong SQL and data modeling skills, with experience in layered data lake or lakehouse architectures.
• Experience handling PHI under HIPAA, including encryption, masking, de-identification, and compliance with the HIPAA Security Rule.

Nice to Have

• Experience integrating Adobe Analytics data streams or Adobe Experience Platform.
• Familiarity with Looker or Vertex AI as downstream consumers.
• Knowledge of ClickThru file formats and external table patterns in BigQuery.
• Experience with GCP Customer-Managed Encryption Keys (CMEK) for PHI dataset protection.
• Familiarity with HIPAA BAA requirements in cloud vendor agreements.
• Knowledge of NIST or HITRUST frameworks for ML data pipelines.
• Background in healthcare data (Rx, clinical, or benefits domain).

Benefits

• Comprehensive medical, dental, and vision plan.
• Short-term and long-term disability coverage.
• 401(k) plan with company match.
• Life insurance.
• Vacation time, sick leave, and paid holidays.
• Paid paternity and maternity leave.

Pay

The salary range for this position is $MINIMUM – $MAXIMUM (varies by location and job level). Individual pay is determined by skills, experience, and relevant training. Additional compensation may include annual performance-based bonuses, sales incentives, or other variable compensation.