AWS Data Engineer - II
Syms Strategic Group, LLC (SSG) · New Orleans, LA · 1 mo ago
On-siteInformation Technology$85k–$117k/yrFull-time
Location: Remote • Department: Veterans Affairs (VA) • Type: Full Time • Minimum Experience: Experienced
Responsibilities
- Lead the next phase of the healthcare data platform modernization
- Implement the evolution from a Microsoft SQL eXtensible Markup Language (MSSQL XML) object store toward a scalable, cloud‑native AWS data architecture that enables business stakeholders and analysts to run performant, SQL‑based reports and queries against healthcare data seamlessly
- Evaluate and decide the right AWS data strategy for the platform
- Evaluate and recommend the optimal AWS‑native data storage and query architecture for the XML object store data, assessing options such as S3 + Athena, Aurora, DynamoDB, Redshift, and OpenSearch based on query patterns, reporting needs, cost, and scalability
- Design and build the reporting and query layer that allows business stakeholders and non‑technical users to run relational SQL queries against healthcare data using familiar tooling
- Architect the migration path for XML object store data from MSSQL into the target AWS platform, defining storage formats, partitioning strategies, and data organization for optimal query performance
- Build and maintain AWS data catalog, schemas, and metadata management so that object store data is discoverable and queryable by business users
- Optimize query performance and cost across chosen AWS services – partitioning, compression, file formats, and query pattern tuning
- Work directly with business stakeholders and analysts to understand reporting requirements and translate them into durable, performant data models and query patterns
- Collaborate with back‑end C#/.Net engineer to ensure data flows cleanly from Electronic Data Interchange (EDI) processing pipelines into the new data layer
- Implement and maintain CI/CD pipelines for data infrastructure using AWS‑native tooling (CodePipeline, CodeBuild, and CodeDeploy)
- Apply Infrastructure as Code (IaC) practices using AWS Cloud Development Kit (CDK), CloudFormation, or Terraform
- Document architecture decisions, data flows, and data dictionaries clearly for both technical and non‑technical audiences
Requirements
- 8+ years’ experience in software or data engineering with a strong AWS focus
- Proven experience architecting and executing cloud data platform migrations in production enterprise or