Data Engineer I

Job Summary

Flashpoint is seeking a Data Engineer I to own the real-time data infrastructure behind our intelligence platform, including Pub/Sub topics, Dataflow pipelines, and AI enrichment. This role requires hands-on experience with production streaming pipelines and a reliability mindset.

About the Role

The Data Engineer I will be responsible for the operational heartbeat of the real-time data infrastructure, ensuring that petabyte-scale pipelines are running smoothly 24/7/365. They will troubleshoot under pressure, optimize systems, and ensure data integrity.

Responsibilities

• Own end-to-end operations of real-time pipelines that ingest, enrich, filter, and route data through Vertex AI and Gemini for risk assessment.
• Own Pub/Sub infrastructure end-to-end, including message delivery, consumer groups, and production incident response.
• Scale, monitor, and optimize Dataflow streaming and batch jobs processing petabytes of data, diagnosing failures and shipping fixes.
• Build and maintain monitoring, alerting, and incident-response tooling for systems with no tolerance for downtime.
• Safeguard data integrity end to end, ensuring data reaches customers accurately and on time.
• Partner with Product, the broader Data team, and Intelligence Analysts to turn requirements into operational reality.

Requirements

• Hands-on production experience building or operating streaming data pipelines (Pub/Sub, Kafka, or similar).
• Demonstrated ability to debug and optimize GCP Dataflow (or comparable Beam-based stream processing).
• A reliability mindset, fluency with SLAs, observability, on-call, and incident response.
• Proficiency with Python, SQL, and Linux.
• Real experience integrating Vertex AI / Gemini, or strong transferable experience with similar LLM platforms, into data workflows.

What You Will Get To Do

• Onboarded into the GCP environment with full access to pipelines, dashboards, and runbooks; shadowed the on-call rotation.
• Mapped the end-to-end data flow, Pub/Sub through Dataflow through Vertex AI enrichment, and can explain where it's fragile.
• Resolved your first production alert with team support.
• Carried on-call independently and resolved common incidents without escalation.
• Shipped at least one observability or reliability improvement (new alert, dashboard, or runbook) to the existing stack.
• Identified and fixed a recurring pipeline pain point.
• Operating as the primary owner of the streaming infrastructure, trusted to run it autonomously.
• Reduced false-positive alerts and/or measurably improved a key SLA (latency, uptime, or throughput).
• Documented decisions and hardened systems so the next incident is easier for everyone.
• Acting as the go-to person Product and Analysts come to with pipeline questions.

Why Flashpoint Is a Great Place To Work

• Diversity and inclusion: Flashpoint fosters a diverse and inclusive workplace culture.
• Culture and belonging: Opportunities for connection and engagement within the company.
• Perks: Gym reimbursements, expensed lunches, and other wellness benefits.
• Career growth: Regular feedback, learning and development opportunities, and career paths.