Data Engineer II

Roles & Responsibilities

• Work with large datasets, ensuring data quality, accuracy, and performance.
• Follow User Story requirements and acceptance criteria to deliver outcomes as defined by senior team members.
• Leverage Databricks SQL to curate and transform data as defined by project plan or user stories.
• Optimize and fine-tune data pipelines for improved speed, reliability, and efficiency.
• Troubleshoot and resolve data-related issues, collaborating with the team to identify root causes.
• Document data processes, data lineage, and technical specifications for future reference.
• Participate in code reviews, ensuring adherence to coding standards and best practices.
• Collaborate with DevOps teams to automate deployment and monitoring of data pipelines.

Job Requirements

• Education & Experience: Bachelor's or Master's degree in Computer Science, Engineering, or a related field. 5+ years of experience in data engineering or a related field, with hands-on experience building and supporting modern data platforms using Databricks, Spark, SQL, and Python.
• Experience: Experience with SAP data collection, extraction, analysis, and ABAP development prefered.
• Technical Qualification: Proven experience in data engineering, including hands-on experience with Databricks and implementing scalable data solutions. Strong proficiency in ANSI SQL, Python, and/or Scala, with experience using Spark and Databricks SQL Warehouse/Lakehouse environments. Experience developing data products, analytical models, and model governance frameworks. Experience with data governance, including data quality, hygiene, anonymization, security, and responsible data management practices. Ability to analyze and modernize legacy ETL solutions, including SSIS packages, stored procedures, and database views. Strong problem-solving skills with the ability to navigate complex Microsoft data environments. Experience working in Agile environments using Azure DevOps (Microsoft DevOps).
• Business & Professional Skills: Excellent communication and collaboration skills, with the ability to partner effectively with both technical and non-technical stakeholders. Strong business acumen with experience supporting manufacturing or industrial organizations preferred. Ability to balance strategic, long-term architecture with near-term business priorities. Passion for leveraging data and analytics to drive business outcomes.

Pay

Annual Salary: USD 103,040.00 - USD 136,013.00