Dataflow Engineer

Responsibilities

• Design, develop, and maintain scalable, dependable, and sustainable data pipelines.
• Troubleshoot and resolve complex dataflow issues using data engineering, system administration, and Apache NiFi workflow expertise.
• Improve data processing efficiency and reliability through automation, scripting, and thoughtful architectural decisions.
• Support a secure and controlled environment for intelligence data throughout its lifecycle.

Requirements

• Active TS/SCI with Polygraph
• 7+ years of experience as a software engineer
• Bachelor’s degree in Computer Science or a related field
• In lieu of a bachelor’s degree, an additional 4+ years of experience is required
• Proven experience with Apache NiFi, including data provenance and lineage tracking
• Strong operational and DevOps skills, including experience with the Linux command line
• Experience versioning flows (such as with NiFi Registry) and integrating them into deployment pipelines
• Proficiency in scripting or programming languages such as Python (preferred), Bash, or similar—especially for automation and data manipulation
• Strong domain knowledge, including understanding of dataflow architecture; expert familiarity with RAFT, SOTF, CSDF, and ASDF data formats; and a solid understanding of intelligence data collection and lifecycle

Desired Experience

• Background in deploying, managing, and optimizing systems that deliver AI models to users through APIs or integrated applications
• Familiarity with GPU/TPU utilization, containerized deployments (such as Kubernetes), and hybrid or edge computing environments designed for efficient inference

Qualifications

Required:

• Active TS/SCI with Polygraph
• 7+ years of experience as a software engineer
• Bachelor’s degree in Computer Science or a related field
• In lieu of a bachelor’s degree, an additional 4+ years of experience is required
• Proven experience with Apache NiFi, including data provenance and lineage tracking
• Strong operational and DevOps skills, including experience with the Linux command line
• Experience versioning flows (such as with NiFi Registry) and integrating them into deployment pipelines
• Proficiency in scripting or programming languages such as Python (preferred), Bash, or similar—especially for automation and data manipulation
• Strong domain knowledge, including understanding of dataflow architecture; expert familiarity with RAFT, SOTF, CSDF, and ASDF data formats; and a solid understanding of intelligence data collection and lifecycle

Desired:

• Background in deploying, managing, and optimizing systems that deliver AI models to users through APIs or integrated applications
• Familiarity with GPU/TPU utilization, containerized deployments (such as Kubernetes), and hybrid or edge computing environments designed for efficient inference

Pay

The Proposed Salary Range For This Position Is $113,200 - $237,800