AI Data Pipeline Engineer
Bespoke Technologies, Inc. · Reston, VA · 2 wk ago
EngineeringFull-time
About the role
The AI Data Pipeline Engineer will be responsible for designing and implementing data pipelines that integrate geospatial data from various sources. This includes developing flexible readers to extract metadata from diverse data formats and integrating mission data with large language models (LLMs) using Retrieval-Augmented Generation (RAG) and Matching-Preserving Composition (MCP).
Responsibilities
- Designing and implementing readers to extract metadata from data sources, focusing on flexibility and adaptability to new formats.
- Designing and implementing metadata enrichment capabilities such as data provenance, pedigree, lineage, and security attributes.
- Designing and implementing event pipelines that orchestrate data cataloging processes for different data types, including data extraction, normalization, enrichment, and ingestion.
- Leveraging AI to enhance data extraction, enrichment, cataloging, and discovery capabilities.
- Experience with designing and building AI agents.
- Integrating mission data with LLMs using RAG and MCP.
- Designing and building Node.js applications and dashboards connected to Oracle Databases.
- Experience with OpenAI Codex, Oracle Cloud Infrastructure (OCI), Oracle AI Database 26ai, Oracle Exadata, and/or OCI Autonomous AI Database Service on Exadata.
- Designing multi-modal databases that integrate relational, spatial, JSON (including JSON Relational Duality), and graph data types.
Requirements
MUST HAVE A POLY CLEARANCE TO APPLY
Qualifications
Experience working with geospatial data types (rasters and vectors)
Skills
- Experience with designing and building data pipelines to integrate data from multiple sources.
- Experience with designing and implementing metadata enrichment capabilities.
- Experience with designing and implementing event pipelines for data cataloging.
- Experience with leveraging AI to enhance data processing capabilities.
- Experience with designing and building AI agents.
- Experience with integrating mission data with LLMs using RAG and MCP.
- Experience with designing and building Node.js applications and dashboards connected to Oracle Databases.
- Experience with OpenAI Codex, Oracle Cloud Infrastructure (OCI), Oracle AI Database 26ai, Oracle Exadata, and/or OCI Autonomous AI Database Service on Exadata.
- Experience with designing multi-modal databases that integrate multiple data types.
Benefits
N/A
Pay
N/A
Schedule
N/A