Senior Data Engineer
The Swift Group, LLC · Reston, VA · 3 wk ago
On-siteAnalyst$50k–$290k/yrFull-time
Responsibilities
- Design, build, and maintain scalable, cloud-based data pipelines and supporting infrastructure
- Collaborate with internal teams and external partners to broker and exchange data through APIs, S3, and other secure interfaces
- Operationalize data pipelines leveraging Python-native and AWS-native tools for ingestion, transformation, and delivery
- Provide day-to-day operational support, including Tier 2/3 troubleshooting and incident response for production data pipelines
- Automate deployment and monitoring processes using Infrastructure-as-Code (IaC) tools such as Terraform, CloudFormation, or Ansible
- Implement data security and compliance controls aligned with RMF principles across multiple classification domains
- Participate in Agile development activities and contribute to continuous improvement of data engineering workflows
- Stay informed on emerging data engineering technologies and best practices to drive innovation within the team
Requirements
- US citizenship with an active TS/SCI with CI Polygraph required
- 4+ years of hands-on experience in data engineering, data pipeline development, or cloud data systems
- Proficiency in designing and deploying data pipelines leveraging AWS services across multiple classification domains (e.g., IL5 to IL6+)
- Experience with Infrastructure-as-Code (IaC) tools such as Terraform, CloudFormation, or Ansible
- Understanding of RMF security principles and experience implementing security controls for cloud data systems
- Strong programming and scripting skills in Go, Python, and Bash
- Experience with data pipeline tools and platforms such as NiFi, Hadoop, HDFS, Kafka, or Cloudera Data Platform
- Proficiency with Linux environments and troubleshooting distributed data systems
- Excellent communication skills and ability to collaborate effectively with cross-functional teams
Desired Experience
- Experience working with data lake and big data technologies such as Spark, Accumulo, or Elasticsearch
- Experience automating data delivery workflows and monitoring systems for high availability
- Familiarity with Agile methodologies and collaboration tools like Jira and Confluence
Benefits
Comprehensive benefits including but not limited to: healthcare, wellness, financial, retirement, education, and time off benefits.