Data Engineer (Skillbridge Intern) - 28499

Essential Job Responsibilities

• Train as a Data Engineer with Enlighten, reporting to a designated Enlighten Supervisor.
• Work closely with a mentor and with senior company leadership.
• Actively train on meaningful projects.
• Develop a good understanding of all critical tasks to successfully conduct data engineer objectives:
• Data acquisition
• Develop data set processes (Extract, transform, load (ETL))
• Use programming language and tools
• Identify ways to improve data reliability, efficiency, and quality
• Prepare data for predictive and prescriptive modeling
• Use data to discover tasks that can be automated

Desired End State (3-4 month target)

• Understand basic data engineer concepts.
• Manage, optimize, oversee, and monitor data retrieval, storage, and distribution throughout the BDP enclaves.

Training Plan

• Phase 1: Basics
• Weeks 1-4: Intro to the Big Data Platform (BDP) technologies, BDP analytics and applications, Army and Air Force Cyber data ETL process.
• Phase 2: Parser Overview
• Weeks 5-8: Data Acquisition, Taxonomy/Schema, Review existing parsers and deployment flows; understand existing transforms available for use in parsers, Establish a development environment for BDP parser development.
• Phase 3: Parser Development, Deployment, and Testing
• Weeks 9-13: Modify Kafka and Nifi workflows; modify existing parser schema and transforms to alter ingest pipeline, Understand how to access logs to identify errors; understand common parser development errors; troubleshoot errors.

Assumptions/Restrictions:

• If candidate is selected and approved, SkillBridge Intern can travel in conjunction with this internship; Enlighten will fund all travel costs.
• SkillBridge Intern will be available during core hours for critical meetings and training.

Additional Goals:

• Project management

Minimum Qualifications

• Active-Duty Military ONLY within final 180 days of active-duty service.
• Minimum of 5 years relevant experience with Bachelors in related field; 3 years relevant experience with Masters in related field; or High School Diploma or equivalent and 9 years relevant experience.
• Additional experience dependent on Program of Instruction.

Physical Requirements

Physical Requirements will vary and is dependent on the Program of Instruction.

Additional Benefits/Perks:

• Find more information on our website at www.eitccorp.com.