Full-Stack Data Engineer - Mid

About the role

Join the Nalley Consulting team at Southcom HQ.

Responsibilities

• Develop and maintain the data pipeline infrastructure, ensuring scalable ingestion, transformation, and integration of structured and unstructured datasets within the cloud-based CIP platform.
• Optimize data storage strategies, implementing efficient query execution, indexing, and retrieval techniques for high-volume mission datasets.
• Integrate APIs for secure data sharing across operational environments, ensuring controlled access and compliance with security frameworks.
• Submit the Data Pipeline Optimization Report, detailing improvements in ingestion speed, storage efficiency, and API integrations.
• Integrate all ingestion and transformation workflows with the Identity and Access Management (IAM) framework provisioned under IAM Engineers
• Cook with the IAM Engineer team to define required roles, enforce RBAC policies, and maintain compliance with authentication and access standards across IL environments.
• Possess the knowledge and capability to develop, maintain, and optimize data integration pipelines, API services, and front-end interfaces for accessing and visualizing geospatial and structured data.
• Must be proficient in Data Lakes platforms such as Databricks, Kubernetes, ESRI ArcGIS environments, and cloud-based data engineering.
• Expertise in building scalable, secure web applications, implementing metadata-driven search and retrieval features, and integrating APIs for seamless data interoperability is required.
• Must have demonstrated experience in developing and deploying full-stack applications that enable data visualization, dashboarding, and analytics within ESRI-based GIS platforms, Unity Catalog, and cloud-based databases.
• Must have demonstrated experience in implementing RESTful and GraphQL APIs for seamless data retrieval and integration between Data Lake, ESRI ArcGIS, and external sources.
• Must have demonstrated experience in managing CI/CD pipelines, containerized deployments in Kubernetes, and API authentication mechanisms to ensure secure access to research products.
• Must have demonstrated experience in optimizing database queries and indexing strategies for large-scale geospatial and structured datasets.

Qualifications

• Bachelor’s degree in Computer Science, Data Engineering, or a related field, or five (5) years of equivalent experience in full-stack development and data engineering.

Skills

• Knowledge and capability to develop, maintain, and optimize data integration pipelines, API services, and front-end interfaces for accessing and visualizing geospatial and structured data.
• Proficiency in Data Lakes platforms such as Databricks, Kubernetes, ESRI ArcGIS environments, and cloud-based data engineering.
• Experience in building scalable, secure web applications, implementing metadata-driven search and retrieval features, and integrating APIs for seamless data interoperability.
• Experience in managing CI/CD pipelines, containerized deployments in Kubernetes, and API authentication mechanisms to ensure secure access to research products.
• Experience in optimizing database queries and indexing strategies for large-scale geospatial and structured datasets.

Benefits

• Excellent medical, dental, and vision benefits
• PTO
• 11 paid federal holidays
• Tuition assistance
• Paid military-reserve leave
• Paid parental leave for birth or adoption
• 401k matching up to 5 percent of the base salary
• Flex time
• Company-paid short-term disability, long-term disability, and life insurance.