Jobs · Information Technology · Illinois

Data Engineer II

IGT · Chicago, IL · Yesterday
Information Technology$104k/yrFull-time

About The Role

We are seeking a Data Engineer II to join our Global Data Platform & Engineering team. In this role, you will help build and maintain scalable, cloud-native data solutions that power enterprise analytics, reporting, and emerging AI initiatives. You will work with modern data technologies including Databricks, Apache Spark, Delta Lake, Python, SQL, and AWS to develop reliable data pipelines and curated datasets. Working closely with business stakeholders, analytics teams, and fellow engineers, you'll transform business requirements into high-quality, production-ready data solutions. This position is ideal for an engineer who enjoys solving complex data challenges, building scalable solutions, and continuously learning new technologies.

What You'll Do

  • Design, develop, and maintain scalable ELT/ETL pipelines using Databricks, Apache Spark, SQL, and Python.
  • Build and maintain reliable, high-quality datasets that support enterprise analytics, operational reporting, and AI use cases.
  • Develop data transformations using Delta Lake and Lakehouse architecture best practices.
  • Integrate data from enterprise applications, APIs, databases, files, and other internal and external sources.
  • Collaborate with business stakeholders, analysts, and product teams to understand data requirements and deliver scalable solutions.
  • Monitor, troubleshoot, and optimize production data pipelines for reliability, scalability, and performance.
  • Participate in migrating and modernizing legacy data processes to cloud-native architectures.
  • Improve data quality through validation, testing, monitoring, and automation.
  • Contribute to engineering best practices through code reviews, documentation, and knowledge sharing.
  • Support continuous improvement of the enterprise data platform by identifying opportunities for automation, optimization, and simplification.

Required Qualifications

  • Bachelor's degree in Computer Science, Information Systems, Engineering, or a related field, or equivalent practical experience.
  • 3+ years of experience in Data Engineering or a related technical role.
  • Strong SQL development skills.
  • Strong Python programming experience.
  • Experience building data pipelines using Apache Spark and Databricks (or similar distributed data processing platforms).
  • Experience developing modern ETL/ELT pipelines.
  • Understanding of data modeling and data warehousing concepts.
  • Experience working with cloud-based data platforms, preferably AWS.
  • Familiarity with Delta Lake or similar modern data storage technologies.
  • Experience using Git and collaborative software development practices.
  • Strong analytical, troubleshooting, and problem-solving skills.
  • Excellent communication and collaboration skills.

Preferred Qualifications

  • Experience with AWS data services such as Amazon S3, Lambda, or related technologies.
  • Experience working with Databricks on AWS.
  • Experience with Delta Lake and Medallion/Lakehouse architecture.
  • Experience with orchestration tools such as Databricks Workflows, Apache Airflow, or similar workflow orchestration platforms.
  • Experience consuming and developing REST APIs.
  • Experience working with semi-structured data, including JSON and Excel-based data ingestion.
  • Familiarity with CI/CD practices for data engineering.
  • Exposure to AI/ML workflows or data preparation for machine learning and generative AI applications.
  • Experience working in gaming, hospitality, financial services, or other data-intensive industries.

Technical Environment

Technologies include Databricks (AWS), Apache Spark, Delta Lake, Python, SQL, Amazon S3, Git, REST APIs, and CI/CD pipelines.

What Makes You Successful

  • You enjoy solving complex technical problems and continuously improving existing solutions.
  • You can work independently while collaborating effectively with cross-functional teams.
  • You write clean, maintainable, and well-tested code.
  • You take ownership of your work from development through production support.
  • You have a growth mindset and enjoy learning new technologies.
  • You communicate technical concepts clearly with both technical and non-technical audiences.

Pay

The estimated compensation for this role is up to $104,000 USD, based on a good-faith assessment at the time of posting. Actual compensation may vary. Base pay is one component of IGT's total rewards program. Depending on the role, employees may be eligible for bonus or commission opportunities.

Benefits

IGT offers a comprehensive benefits package, which may include a 401(k) savings plan with company contributions, medical, dental, and vision insurance, life and disability coverage, paid time off, tuition reimbursement, and other wellness programs, subject to eligibility requirements.

Similar jobs

Data Engineer II

MetLifeBridgewater, NJ· 1 wk ago
$103k–$133k/yrapply on metlife.avature.net

Data Engineer II

EchoStar CorporationLittleton, CO· 1 wk ago
Information Technology$127k/yrapply on jobs.echostar.com

Data Engineer II

Addison GroupTulsa, OK· 2 wk ago
Information Technology$120/hrapply on addisongroup.gosnaphop.com

Data Engineer II

ChatGPT JobsMiami, FL· 2 mo ago
Information Technologyapply on chatgpt-jobs.com

Data Engineer II

Accord Technologies IncArlington, VA· 3 wk ago
Information Technologyapply on candidateportal.ceipal.com

Data Engineer II

Judi HealthNew York, NY· 4 wk ago
Information Technology$109k–$136k/yrapply on job-boards.greenhouse.io