(USA) Senior, Data Engineer

As a Senior Data Engineer, you will design, develop, and maintain scalable data pipelines and architectures that support critical business insights and decision-making. This role requires expertise in data integration, modeling, and governance within cloud and big data environments. You will collaborate across functions to translate complex business requirements into effective data solutions, ensuring data quality and accessibility. The role involves building systems to handle massive data volumes, ensuring data is consumable by application teams, users, and data scientists, and designing fault-tolerant infrastructure capable of processing millions of operations per minute from millions of devices.

About the team

The Data Lake Platform team at Walmart/VIZIO drives enterprise analytics by delivering reliable datasets that support key business decisions and new monetization opportunities. Operating at the intersection of Data and AI, the team emphasizes innovation to address complex challenges. Members collaborate to design and maintain scalable data architectures, pipelines, and governance frameworks, ensuring data quality and accessibility.

Responsibilities

• Design, develop, and maintain scalable data pipelines and architectures to support business analytics and machine learning initiatives.
• Extract, transform, and integrate data from various internal and external sources ensuring data quality and relevance.
• Collaborate with stakeholders to translate business requirements into effective data solutions aligned with enterprise strategy.
• Develop and optimize data models, including logical and physical designs, to enhance data accessibility and usability.
• Implement data governance practices to ensure compliance with regulatory and organizational standards.
• Utilize programming languages and tools such as SQL, Python, Spark, and Apache Airflow for coding, testing, and deployment.
• Monitor and improve data processes to support continuous innovation and operational excellence.
• Build systems to handle massive data volumes (petabytes) and provide fast insights.
• Work with teams across Walmart/VIZIO to integrate their data into the Big Data ecosystem and monitor data quality.
• Ensure data accuracy through validation tasks, root cause analysis, and data cleanliness solutions.
• Review data at all granular and aggregate levels, and manage versioning.

Requirements

• Extensive experience in data engineering, including data integration, modeling, and pipeline development, as well as designing and implementing ETL processes.
• High proficiency in PySpark, SparkSQL, and/or Scala.
• Proficiency in SQL and programming languages such as Python or Java for code development and testing.
• Extensive knowledge of AWS/GCP Cloud Services.
• 5+ years of experience in Data Engineering and prior experience working with Big Data, Data Lakes, and Delta Lakes.
• Strong knowledge of data governance, data quality standards, and regulatory compliance.
• Expertise in cloud and big data platforms, data lakes, and data architecture.
• Ability to translate business requirements into scalable data solutions aligned with strategic objectives.
• Prior experience with Infrastructure as Code tools like Terraform and automation tools like Apache Airflow.
• Familiarity with AI technologies and prior experience with agents, LLMs is preferred.
• Proven capability to analyze complex data systems and deliver actionable business insights.
• Experience using Databricks and Snowflake is highly desirable.

Qualifications

• Option 1: Bachelor’s degree in Computer Science and 3 years' experience in software engineering or related field.
• Option 2: 5 years’ experience in software engineering or related field.
• Option 3: Master's degree in Computer Science and 1 year’s experience in software engineering or related field.
• 2 years' experience in data engineering, database engineering, business intelligence, or business analytics.

Preferred qualifications include a Master’s degree in Computer Science or related field and 3 years' experience in software engineering, experience with ETL tools and large data sets in the cloud, and a background in creating inclusive digital experiences with knowledge of WCAG 2.2 AA standards and assistive technologies.

Benefits

• Competitive pay with performance-based bonus awards.
• Health benefits including medical, vision, and dental coverage.
• Financial benefits including 401(k), stock purchase, and company-paid life insurance.
• Paid time off including PTO (including sick leave), parental leave, family care leave, bereavement, jury duty, and voting.
• Short-term and long-term disability coverage.
• Company discounts.
• Military Leave Pay.
• Adoption and surrogacy expense reimbursement.
• Live Better U education benefit program covering tuition, books, and fees for high school completion, bachelor’s degrees, English Language Learning, and short-form certificates.

Pay

The annual salary range for this position is $99,000.00 - $198,000.00. Additional compensation includes annual or quarterly performance bonuses and stock for certain positions.