Senior Data Engineer

About the role

The Capital Software Project is building a data fabric system. The data fabric system includes a data pipeline that will be moving complex mix of data types and formats to a data lake and a series of databases. Allowing mission engineering analysts to conduct data analysis from authoritative sources of truth.

Responsibilities

• Write or update ETL/ELT code that ingests data from APIs, databases, or files.
• Implement transformations to clean, standardize, or enrich data.
• Optimize pipeline performance and improve reliability.
• Implement methods for data traceability and lineage.
• Monitor pipelines and data quality.
• Collaborate with engineering teams to meet new data requirements.
• Maintain documentation related to data processes, standards, and best practices.
• Design scalable and reliable data architectures, including schemas, workflows, and integration layers.
• Conduct design reviews, validate solution architectures, and ensure alignment with enterprise standards.
• Bring solid understanding of DoD frameworks, security requirements, and best practices for classified and unclassified environments.

Qualifications

• 7+ years of relative working experience as a Senior Data Engineer or in a related field.
• Strong experience with ETL/ELT development and building data pipelines.
• Proficiency with at least one major programming language (e.g., Python, Java, Scala).
• Experience working with SQL and relational databases (e.g., PostgreSQL, SQL Server, MySQL).
• Exposure and familiarity with data services on modern cloud platforms (AWS, Azure, GCP, etc.).
• Familiarity with modern data warehousing technologies (e.g., ADLS, Redshift, BigQuery, Synapse).