Senior DataOps Engineer
Voyager Technologies · United States · 1 mo ago
RemoteRemoteEngineering$150k–$180k/yrFull-time
About the role
Voyager is an innovative space, defense, and national security technology company committed to advancing and delivering transformative, mission-critical solutions. We tackle the most complex challenges to unlock new frontiers for human progress, fortify national security, and protect critical assets to lead in the race for technological and operational superiority from ground to space.
Responsibilities
- Cloud Migration & Infrastructure
- End-to-end migration of data workloads from AWS Commercial to AWS GovCloud, including S3, Glue, Redshift, IAM, VPC, Lambda, and CloudWatch.
- Identify and resolve service parity gaps between commercial and GovCloud environments; validate data integrity, encryption posture, and access controls post-migration.
- Set up and administer enterprise Git repositories for the data and analytics team, including branching strategy, access controls, and code review workflows.
- Migrate existing scripts, pipelines, and artifacts into version-controlled repositories and enforce DataOps source control best practices across the team.
- Ensure all migrated and provisioned resources comply with NIST 800-171, DFARS, CUI, and ITAR/EAR handling requirements.
- Administer and optimize cloud data services across AWS GovCloud and Azure Government.
- Manage infrastructure-as-code for all data platform resources using Terraform and CloudFormation (required); Ansible preferred for configuration management.
- Monitor cloud resource utilization, enforce cost governance, and implement right-sizing recommendations for data workloads.
- Maintain backup, disaster recovery, and business continuity procedures for all data platform services.
- Serve as Tier 3 support for complex cloud infrastructure and data incidents; perform root cause analysis and implement preventive measures.
- Data Pipeline Development & Orchestration
- Design, build, and maintain scalable ELT/ETL pipelines using Microsoft Fabric Data Factory, Azure Data Factory, Apache Airflow, and dbt.
- Architect end-to-end data flows from ingestion through transformation to serving layers, ensuring reliability, lineage, and observability.
- Implement real-time and batch data streaming using Apache Kafka, Azure Event Hubs, and Fabric Eventstream.
- Automate pipeline monitoring, alerting, and self-healing mechanisms to minimize manual intervention.
- Microsoft Fabric Platform Ownership
- Design and govern OneLake architecture including workspace topology, shortcut strategy, and medallion (Bronze/Silver/Gold) layer design.
- Integrate Fabric with enterprise systems including Microsoft 365 GCC High, Azure Government, Dynamics 365, and third-party data sources.
- Configure Fabric capacity management, workspace permissions, and security in alignment with NIST 800-171 and DFARS requirements.
- Data Architecture & Modeling
- Lead the design of enterprise data models including star schema, snowflake schema, and Data Vault 2.0 patterns.
- Architect Lakehouse, data warehouse, and data mesh topologies to serve analytical, operational, and reporting workloads.
- Define and enforce naming conventions, semantic layer standards, and reusable data assets using Power BI semantic models and Fabric Direct Lake.
- Collaborate with stakeholders to translate business requirements into scalable data architecture solutions.
- DataOps Practices & CI/CD
- Implement DataOps principles: automated testing, version-controlled pipelines, and continuous delivery for data assets.
- Build and maintain CI/CD pipelines (Azure DevOps, GitHub Actions) for deploying data pipelines, models, and Fabric artifacts.
- Write and maintain automation scripts in Python and/or PowerShell to support migration, provisioning, and operational workflows.
- Containerize and orchestrate workloads using Docker and Kubernetes (AKS) for portable, scalable processing.
- Data Quality & Governance
- Implement data quality frameworks including automated profiling, validation rules, anomaly detection, and SLA monitoring.
- Manage data lineage, metadata cataloging, and access governance using Microsoft Purview.
- Enforce data classification policies for CUI, ITAR-controlled, and export-sensitive data across all pipeline stages.
- Partner with compliance and cybersecurity teams to ensure data governance controls satisfy audit and regulatory requirements.
- Monitoring, Troubleshooting & Support
- Proactively monitor pipeline health, data freshness, and system performance using Fabric monitoring hub, Azure Monitor, and Log Analytics.
- Document incident response procedures, runbooks, and architecture decisions (ADRs).
- Collaboration & Documentation
- Partner with data analysts, data scientists, and business stakeholders to deliver reliable data products that drive decision-making.
- Create and maintain thorough documentation for pipeline design, data dictionaries, security controls, and compliance evidence.
- Participate in architecture reviews, sprint planning, and cross-functional data governance committees.
Requirements
- Extensive experience leading end-to-end migration of data workloads from AWS Commercial to AWS GovCloud, including S3, Glue, Redshift, IAM, VPC, Lambda, and CloudWatch.
- Experience scripting & programming using Python or PowerShell.
- Hands-on experience migrating workloads to or within AWS GovCloud or Azure Government.
- Experience with Microsoft Fabric or Azure Synapse Analytics.
- Demonstrated experience in regulated environments (aerospace, defense, government contracting) with NIST 800-171 and DFARS compliance.
- Proven ability to architect and deliver enterprise-grade data platforms from greenfield to production.
Qualifications
- Bachelor's degree in computer science, Information Technology, Data Engineering, or a related field; or equivalent hands-on experience.
- 8+ years of data engineering, cloud infrastructure, or DataOps experience in a cloud-first environment.
- 2+ years of hands-on experience with Microsoft Fabric or Azure Synapse Analytics.
- Highly desired AWS Certified Solutions Architect - Associate or Professional, AWS Certified Data Analytics - Specialty, HashiCorp Certified: Terraform Associate, Microsoft Certified: Fabric Analytics Engineer Associate (DP-600), Microsoft Certified: Azure Data Engineer Associate (DP-203), Microsoft Certified: Azure Solutions Architect Expert, Databricks Certified Data Engineer Associate / Professional, DBT Certified Developer, CompTIA Security+ or CySA+.