Data Engineer II

Job Duties

• Develops and builds ETL/ELT data pipelines for use in data analysis.
• Creates and maintains optimal data pipeline architecture.
• Keeps data separated and secure across multiple cloud environments.
• Assembles large, complex data sets that meet functional and non-functional business requirements.
• Delivers ad-hoc and analytical reports to internal users and teams.
• Maintains ETL/ELT jobs and troubleshoots load issues.
• Manages change requests/ticket queues for analytical reports and ETL/ELT jobs.
• Performs data/technology discovery from new sources and third-party applications for data ingestion.
• Creates complex reports and dashboards in Cognos and Tableau.
• Ingests and transforms structured, semi-structured, and unstructured data from sources including relational databases, NoSQL, external APIs, JSON, XML, delimited files, and more.
• Works and delivers in agile methodology for new development projects.
• Delivers efficient and effective solutions on time.
• Analyzes and understands data sources and designs a data model for data capture and ETL/ELT.
• Identifies bugs, applies fixes, and checks data quality via process/pipeline audits.
• Uses industry best practices for code development, testing, implementation, and documentation.
• Performs other job-related duties as assigned.

Knowledge, Skills, And Abilities

• Excellent verbal and written communication skills, along with technical documentation skills.
• Ability to work with team members, as well as cross-team for product delivery.
• Ability to work in an agile environment with timely delivery of ETL/ELT pipelines and reports.
• Knowledge and experience using tools like Jira, Confluence, and GitHub.
• Knowledge and experience with validation and testing development to analyze and debug issues.
• Experience with relational SQL and NoSQL databases.
• Experience with object-oriented/object function scripting languages, like Python, Java, and Scala.
• Experience with big data tools, like Hadoop, Spark, Kafka, Databricks, etc.
• Exposure to analytical reporting tools, preferably Cognos and Tableau.
• Knowledge and experience with Cloudera or Horton, Impala, Hive, AngularJS, HTML5, and CSS/LESS.

Minimum Qualifications

• Bachelor's Degree in Management Information Systems, Computer Science, or a related field.
• 4 years of experience in Data Engineering, Data Integration, Big Data, Business Intelligence, or Software Engineering.
• Equivalent relevant experience performing the essential functions of this job may substitute for education degree requirements.

Preferred Qualifications

• Higher Education Domain Exposure.

Job Description Disclaimer

The job posting highlights the most critical responsibilities and requirements of the job. It's not all-inclusive. Accommodations: Applicants with disabilities who require assistance or accommodation during the application or interview process should contact our Talent Acquisition team at recruiting@wgu.edu. Equal Employment Opportunity: All qualified applicants will receive consideration for employment without regard to any protected characteristic as required by law.