Software Engineer

About the role

The Sponsor requires a team to provide operations and maintenance as well as new development work for existing applications. The Sponsor's office is a central data processor and applications developer for applications that utilize travel data. The Sponsor aims to establish support to travel data applications and the associated backend environment while that travel data undergoes a transition period and is ingested into new environments and user applications. As these travel applications analytic capabilities continue to be absorbed, this team will need to provide ongoing support and development to travel data models and travel data ETL pipelines.

Responsibilities

• Demonstrated experience building and managing data pipelines.
• Demonstrated experience with Python.
• Demonstrated experience with cloud computing using AWS services.
• Demonstrated experience processing data using Apache Spark.
• Demonstrated experience with an RDBMS (Relational Database Management System) such as Postgres, Oracle, or MySQL and writing SQL queries.
• Demonstrated experience with Linux and shell scripting.
• Demonstrated experience analyzing data in different file formats such as CSV, XML, JSON, Avro, and Parquet.
• Demonstrated experience writing and validating unit tests.

Requirements

• US Citizenship: This position requires US Citizenship. Verification of US Citizenship to meet federal government security requirements will be confirmed.
• Security Clearance: The successful candidate must have an active U.S. Government Top Secret Security Clearance with a Full Scope Polygraph. Clearance Verification: This position requires successful verification of the stated security clearance to meet federal government customer requirements. You will be asked to provide clearance verification information prior to an offer of employment.
• Travel: This position is expected to be onsite. The position will be located within the Washington Metropolitan Area (WMA). Local travel/POV will be on an as needed basis, within the local place of performance.

Qualifications

• Demonstrated experience building and managing data pipelines.
• Demonstrated experience with Python.
• Demonstrated experience with cloud computing using AWS services.
• Demonstrated experience processing data using Apache Spark.
• Demonstrated experience with an RDBMS (Relational Database Management System) such as Postgres, Oracle, or MySQL and writing SQL queries.
• Demonstrated experience with Linux and shell scripting.
• Demonstrated experience analyzing data in different file formats such as CSV, XML, JSON, Avro, and Parquet.
• Demonstrated experience writing and validating unit tests.

Skills

• Highly Desired Skills and Demonstrated Experience:
• - Demonstrated experience in NiFi, Apache AirFlow, or equivalent orchestration tools for data pipelines.
• - Demonstrated experience with Java or Scala.
• - Demonstrated experience administering an EMR/Spark cluster.
• - Demonstrated experience conducting performance tuning of Spark jobs.
• - Demonstrated experience supporting Hive, Iceberg, or similar SQL access technologies.
• - Demonstrated experience developing cloud-based security solutions.
• - Demonstrated experience following configuration management processes to review and deploy code as part of releases.

Benefits

• Comprehensive benefits package including:
• - 100% employer-paid health coverage
• - a 6% 401(k) match
• - PTO
• - tuition reimbursement
• - bonuses
• - professional development, and more.

Pay

Details about pay are not specified in the job posting.

Schedule

Details about the schedule are not specified in the job posting.