Jobs · Quality Assurance · California

Data / AI QE Lead -- Retail eCommerce

ChatGPT Jobs · Beverly Hills, CA · 1 mo ago
Quality AssuranceFull-time

Data Quality Engineering

  • Define and own the QE strategy for data assets (customer, product, inventory, transaction, and behavioral event data).
  • Design and implement data validation frameworks covering completeness, accuracy, consistency, timeliness, and referential integrity.
  • Lead testing of ETL/ELT pipelines, data lake and warehouse layers, and real-time streaming pipelines.
  • Establish data contract testing practices between producing and consuming systems.
  • Build automated data quality monitors and alerting that operate continuously in production environments.
  • Partner with data governance and data stewardship teams to align QE standards with enterprise data policies.

AI / ML Model Quality & Validation

  • Lead quality validation for ML models powering eCommerce capabilities (product recommendations, personalized search, dynamic pricing, demand forecasting, propensity models, and generative AI).
  • Define model evaluation frameworks including offline metrics and online business metrics (CTR, conversion rate, AOV, revenue lift).
  • Design and execute A/B and shadow testing strategies to validate model performance before and during production rollout.
  • Assess and test for model fairness, bias, and regulatory compliance across customer segments and product categories.
  • Validate model monitoring and drift detection systems to ensure production models remain within acceptable performance thresholds.

eCommerce Platform Integration Testing

  • Drive end-to-end quality of data flows from customer interaction events through to AI feature delivery on site, app, and email channels.
  • Test integrations between the eCommerce platform and downstream data consumers (CDP, CRM, marketing automation, analytics tools).
  • Validate real-time personalization pipelines for homepage, PDP, cart, and post-purchase experiences.
  • Ensure data quality for key eCommerce events (product views, add-to-cart, checkout, order confirmation, returns, and search queries).
  • Test search and browse relevance improvements driven by ML rankers and query understanding models.

Test Automation & Observability

  • Build and scale automated data and AI testing frameworks integrated into CI/CD and model deployment pipelines.
  • Define and enforce data quality SLAs and embed automated gates into pipeline orchestration (Airflow, dbt, Spark, etc.).
  • Implement observability tooling for data pipelines and AI model inputs/outputs in collaboration with data and ML engineering.
  • Drive adoption of synthetic data and data masking strategies to support safe testing.

Similar jobs

Lead Retail Ecommerce

Goodwill Industries of Northwest NCStatesville, NC· 2 wk ago
Business Development$18.5/hrapply on recruiting.ultipro.com

Retail Data Architect

USTIssaquah, WA· 3 wk ago
Engineering$140k–$210k/yrapply on usource.ripplehire.com

Ecommerce Lead

United Supermarkets, LLCAlbuquerque, NM· 1 wk ago
Managementapply on eofd.fa.us6.oraclecloud.com