Data Engineer

About the Role

The data engineer works closely with business analysts, product owners, and key stakeholders to create, deploy, and manage data pipelines that provide data scientists with user-ready data from authoritative, transactional data sources. Primary tasks will be creating and sustaining ETL pipelines that supply more than 36k+ users and dozens of production capabilities with clean and accurate data.

Responsibilities

• Get It Done – Successfully deliver end-to-end projects/capabilities working through a wide range of challenges and opportunities across multiple organizations.
• Communicate – Communicate regularly with your customers, teammates and stakeholders on both technical and non-technical topics.
• Create – Utilize analytics platforms with business intelligence tools to create, test, and deploy enterprise capabilities (data models, dashboards, reports, etc.).
• Collaborate – Work closely with individuals across the team to share ideas and ensure accurate and timely product delivery.

Qualifications

• BS / BA degree (or equivalent) required.
• DoD SECRET clearance required.

Required Skills

• 3+ years of experience implementing and optimizing ETL (Extract, Transform, Load) processes to ensure data is cleaned, processed, and loaded into data storage systems (data lakes, warehouses) in an organized manner.
• 3+ years of experience with pipeline maintenance and troubleshooting.
• 3+ years of experience with tools like Databricks.
• Ensure the performance, efficiency, and scalability of deployed products (workflows, models, etc.).
• Proficiency in programming languages such as Python, Java, or Scala.
• Strong SQL scripting capabilities for data query and preparation.
• Experience gathering, analyzing, and translating requirements into functional specifications, prototypes, and working capabilities.
• Requires strong organizational skills and action-oriented personality; experience leading tasks and tracking actions across multiple organizations.
• Excellent analytical and problem-solving abilities backed by solid writing and highly-effective communication skills; must collaborate constructively and effectively with project end-users, customers, advocates and stakeholders.
• Active US Government Secret Clearance required.

Preferred Skills

• Master’s Degree or higher in data science, computer science, information systems, mathematics, or similar discipline.
• Exposure to machine learning pipelines or integration with data science workflows.
• Analytical and problem-solving skills with Business Intelligence tools (e.g. Tableau, Power BI, and SAP Business Objects).
• Data Access and Management experience with tools like DataBricks and iQuery.
• Familiarity with task tracking in JIRA.
• Familiarity with US Air Force logistics data.

Pay and Benefits

Pay range and compensation package Estimated travel is ~5%.