Full-Stack Data Engineer

Description

Prescient Edge is seeking a Full-Stack Data Engineer to support a Federal Government client. Benefits include:

• A competitive salary with performance bonus opportunities.
• Comprehensive healthcare benefits, including medical, vision, dental, and orthodontia coverage.
• A substantial retirement plan with no vesting schedule.
• Career development opportunities, including on-the-job training, tuition reimbursement, and networking.
• A positive work environment where employees are respected, supported, and engaged.

Proposed Personnel

Must possess the knowledge and capability to develop, maintain, and optimize an outward-facing data catalog that integrates geospatial and research data layers. Optimize data integration pipelines, API services, and front-end interfaces for accessing and visualizing geospatial and structured data.

• Must be proficient in full-stack development, database architecture, and API integration to enable seamless search, filtering, and rendering of structured research products.
• Must be proficient in Data Lakes splat forms such as Databricks, Kubernetes, ESRI ArcGIS environments, and cloud based data engineering.
• Must be expert in building scalable, secure web applications, implementing metadata-driven search and retrieval features, and integrating APIs for seamless data interoperability.

Metadata & Data Governance

• Establish and maintain metadata governance frameworks, ensuring compliance with DoD data management policies and interoperability with a Data Catalog.
• Develop automated metadata tagging processes to improve data discoverability, classification, and lineage tracking within the Common Intelligence Picture (CIP) platform.
• Implement and manage data governance workflows, ensuring integration with Open Lineage, Unity Catalog, and GIS metadata standards.
• Submit the Metadata & Data Governance Compliance Report, detailing lineage tracking, classification policies, and security enhancements.

Data Pipeline Infrastructure

• Develop and maintain the data pipeline infrastructure, ensuring scalable ingestion, transformation, and integration of structured and unstructured datasets within the cloud-based CIP platform.
• Optimize data storage strategies, implementing efficient query execution, indexing, and retrieval techniques for high-volume mission datasets.

API Integration

• Integrate APIs for secure data sharing across operational environments, ensuring controlled access and compliance with security frameworks.
• Submit the Data Pipeline Optimization Report, detailing improvements in ingestion speed, storage efficiency, and API integrations.

Requirements

• Must have demonstrated experience in developing interactive web-based data portals, implementing API driven data exchange, and integrating geospatial data layers into web applications.
• Must have experience working with Databricks, ESRI ArcGIS Feature Services, Open Lineage, and metadata management solutions.

Certifications

• Desirable but not required certifications include Microsoft Certified: Azure Data Engineer Associate, AWS Certified Data Analytics – Specialty, or ESRI Web GIS Developer Certification.

Education

Bachelor’s degree in computer science, Data Engineering, Geospatial Information Systems (GIS), or a related field, or five (5) years of equivalent experience in data engineering, full-stack development, and metadata-driven data cataloging.

Security Clearance

TS/SCI

Location

Doral, Florida. (USSOUTHCOM Headquarters)