Senior, Data Engineer

Position Summary

Build and scale data pipelines, design and develop highly scalable data pipelines using Spark (Scala/PySpark), Airflow, and BigQuery. Ensure performance, reliability, and cost efficiency of pipelines across global workloads. Drive platform modernization, develop utilities and frameworks to migrate legacy pipelines to modern architectures using automation and AI, architect for cost and scale, build and optimize data pipelines with a strong focus on cloud cost efficiency, lead initiatives to reduce cloud spend through smart design and optimization strategies, develop AI-driven engineering solutions, build internal tools, utilities, and AI agents to accelerate development and operations, contribute to platform-level AI capabilities and automation frameworks, own platform and system reliability, manage and enhance large-scale data platform architecture supporting enterprise-wide use cases, monitor and continuously improve performance, scalability, and resilience, collaborate globally, partner with data engineers, product teams, architects, and business stakeholders across international markets, translate business requirements into scalable technical solutions, conduct POCs on emerging technologies and evaluate new tools/frameworks, bring forward innovative ideas to improve engineering efficiency and platform capabilities.

What You'll Do

• Build and scale data pipelines
• Design and develop highly scalable data pipelines using Spark (Scala/PySpark), Airflow, and BigQuery
• Ensure performance, reliability, and cost efficiency of pipelines across global workloads
• Drive platform modernization
• Develop utilities and frameworks to migrate legacy pipelines to modern architectures using automation and AI
• Architect for cost and scale
• Build and optimize data pipelines with a strong focus on cloud cost efficiency
• Lead initiatives to reduce cloud spend through smart design and optimization strategies
• Develop AI-driven engineering solutions
• Build internal tools, utilities, and AI agents to accelerate development and operations
• Contribute to platform-level AI capabilities and automation frameworks
• Own platform and system reliability
• Manage and enhance large-scale data platform architecture supporting enterprise-wide use cases
• Maintain and improve performance, scalability, and resilience
• Collaborate globally
• Partner with data engineers, product teams, architects, and business stakeholders across international markets
• Translate business requirements into scalable technical solutions
• Conduct POCs on emerging technologies and evaluate new tools/frameworks
• Bring forward innovative ideas to improve engineering efficiency and platform capabilities

About The Team

The IDM team powers enterprise-scale data platforms across multiple global markets including Canada, Mexico, Chile, and beyond. We act as the single source of truth for enterprise data, enabling critical business functions across domains such as Customer, Supply Chain, Finance, and Digital Platforms.

What You’ll Bring

• Strong Data Engineering Expertise
• Hands-on experience with Spark (Scala/PySpark), Airflow, BigQuery, and GCP ecosystem
• Proven experience building and operating large-scale data pipelines
• Solid understanding of data platforms, frameworks, and their interaction with pipeline ecosystems
• Experience designing scalable and enterprise-grade data architectures
• Cloud & GCP Expertise
• Strong knowledge of GCP services, project structures, IAM policies, and cloud-native design
• Experience working with large, multi-project environments
• Cost Optimization Mindset
• Strong fundamentals in cloud cost optimization and FinOps practices
• Ability to identify savings opportunities and design cost-efficient solutions
• Programming & AI Skills
• Strong proficiency in Python
• Experience building utilities, automation frameworks, or AI/GenAI-driven solutions is a strong plus
• Engineering Discipline
• Experience in code development, testing, deployment, and operational excellence
• Strong debugging, monitoring, and optimization skills
• Collaboration & Communication
• Excellent communication skills with the ability to work across global teams
• Able to translate complex technical concepts for diverse stakeholders
• Culture & Mindset
• Strong team player with a positive, ownership-driven attitude
• Passion for continuous learning, innovation, and impact

Why This Role is Unique

• Work on global-scale data platforms impacting multiple markets
• Part of a team driving platform modernization + AI-first engineering
• Lead cloud cost optimization at enterprise scale
• Gain exposure across end-to-end data ecosystem (Kafka → GCS → Spark → BigQuery)
• Influence strategy, architecture, and execution in a high-impact environment
• Focus areas include: Large-scale distributed data pipelines across GCP Platform modernization (legacy → next-gen architectures) Cloud cost optimization at scale Data governance and compliance AI-driven engineering acceleration (GenAI, automation, agents)

Additional Compensation

• Annual or quarterly performance bonuses
• Stock

Minimum Qualifications

• Option 1: Bachelor’s degree in Computer Science and 3 years' experience in software engineering or related field.
• Option 2: 5 years’ experience in software engineering or related field.
• Option 3: Master's degree in Computer Science and 1 year’s experience in software engineering or related field.
• 2 years' experience in data engineering, database engineering, business intelligence, or business analytics.

Preferred Qualifications

• Data engineering, database engineering, business intelligence, or business analytics, ETL tools and working with large data sets in the cloud
• Master’s degree in Computer Science or related field and 3 years' experience in software engineering

Additional Information

• Live Better U is a Walmart-paid education benefit program for full-time and part-time associates in Walmart and Sam's Club facilities. Programs range from high school completion to bachelor's degrees, including English Language Learning and short-form certificates. Tuition, books, and fees are completely paid for by Walmart.
• Additional compensation includes annual or quarterly performance bonuses. Additional compensation for certain positions may also include : Stock
• For information about PTO, see https://one.walmart.com/notices.
• Walmart and its subsidiaries are committed to maintaining a drug-free workplace and has a no tolerance policy regarding the use of illegal drugs and alcohol on the job. This policy applies to all employees and aims to create a safe and productive work environment.