Jobs · Information Technology · Connecticut

Forward Deployed Data Engineer (Groton, CT / Senior) [Secret]

Spear AI · New London County, CT · 1 mo ago
On-siteInformation TechnologyFull-time

About the role

We’re seeking a skilled Forward Deployed Data Engineer to build the next-generation data management and artificial intelligence platform for maritime domain awareness. As a forward-deployed engineer, you’ll work on-site with customers — writing code, integrating systems, and solving hard problems in the field. You’re part engineer, part technical advisor, and wholly accountable for making the mission succeed.

Responsibilities

  • Implement real-time data pipelines with MQTT and Redpanda for stream processing.
  • Implement offline data pipelines using Dagster for batch processing.
  • Parse and process binary message formats from various data sources.
  • Build data warehouses using Postgres, Apache Iceberg, Parquet, and S3.
  • Design data models that allow for high-performance queries.
  • Validate and normalize data sources.
  • Improve local development and CI/CD using modern tooling and GitHub Actions.

Requirements

The position requires a current or active U.S. Secret clearance.

Qualifications

  • Expertise in time-series data processing and analysis (windowing, resampling, interpolation, etc.).
  • Proficiency in Python and Rust for data engineering workflows.
  • Experience with binary message parsing.
  • Experience with row-based & columnar-based data formats.
  • Experience with OLTP & OLAP databases.
  • Knowledge of distributed systems, streaming architectures, and batch processing patterns.
  • Hands-on experience with a batch orchestrator such as Dagster/Airflow.
  • Hands-on experience with a streaming platform such as Redpanda/Kafka.
  • Hands-on experience with binary message formats such as Protobuf.

Skills

  • Expertise in time-series data processing and analysis (windowing, resampling, interpolation, etc.).
  • Proficiency in Python and Rust for data engineering workflows.
  • Experience with binary message parsing.
  • Experience with row-based & columnar-based data formats.
  • Experience with OLTP & OLAP databases.
  • Knowledge of distributed systems, streaming architectures, and batch processing patterns.
  • Hands-on experience with a batch orchestrator such as Dagster/Airflow.
  • Hands-on experience with a streaming platform such as Redpanda/Kafka.
  • Hands-on experience with binary message formats such as Protobuf.

Benefits

  • Unlimited PTO
  • Dedicated sick time
  • Comprehensive health and benefits – Medical, dental, and vision coverage
  • 11 Paid Holidays
  • Professional development – Educational opportunities and resources
  • Collaborative environment – Work directly with leadership in our flat organizational structure
  • Mission-driven work – Contribute to projects that directly support national security and make a real-world impact
  • Growth opportunities – Join us during an exciting expansion phase where you can help shape our future

Pay

Compensation for this position is provided on a salaried basis and is not subject to reduction based on hours worked.

Schedule

This is a full-time, exempt position under the Fair Labor Standards Act (FLSA) and is not eligible for overtime pay.

Similar jobs