Manager, Growth Marketing Experimentation

About the role

The Manager, Experimentation leads NBCU’s incrementality testing program for Performance and Device media in partnership with the Sr. Manager of Media Experimentation.

Responsibilities

• Co-own the experimentation roadmap with the Sr. Manager of Media Experimentation; define learning agenda, decision questions, hypotheses, success metrics, guardrails, and power thresholds;
• Review/approve vendor designs and reject under-powered or invalid proposals;
• Lead day-to-day relationship with external measurement vendor—partner with Sr. Manager to prioritize the study backlog, deliver accurate data, align on methods, track SLAs and change logs, escalate blockers;
• Collaborate with Sr. Manager of Media Experimentation on ensuring clear schedules, accurate data inputs, agency and/or vendor alignment, and structured documentation of results;
• Drive calibration with MMM/MTA; propose tiebreakers and thresholds for decisioning; contribute to cross-channel measurement efforts by triangulating learnings;
• Ensure high quality of analysis with speed; Monitor design defects/leakage; run targeted validations (SQL/R/Python spot checks) as needed; improve run-rate without sacrificing validity;
• Mentor a Media Analytics analyst; uplevel partner teams (brief quality, power, common pitfalls); collaborate with data science and other analytics & media teams; contribute to a standardized measurement approach across the NBCU Media Group.

Qualifications

• 4+ years in marketing/media experimentation with direct design/QA ownership and experience partnering with an incrementality testing measurement vendor (e.g., Haus, Measured, or similar).
• Proven command of causal inference in media—appropriate use of RCT, geo, diff-in-diff, and platform holdouts—and the ability to evaluate vendor assumptions/methods.
• Familiarity with power analysis, and failure modes (leakage, seasonality, parallel trends); history of stopping or redesigning under-powered tests.
• Platform experience: Google/Meta/TikTok incrementality and at least one CTV/Device environment (e.g., Roku, Samsung, Vizio).
• Experience reconciling vendor experiment reads with MMM/MTA and informing planning/pacing decisions without surprises.
• Fluent in SQL and Excel.
• Knowledge of big data infrastructure and data science techniques.
• Effective communicator and collaborator with strong project management; ability to work in a highly matrixed environment and influence media buyers/channel leads.

Desired Characteristics

• Strong interpersonal skills with the ability to collaborate, motivate, and influence.
• Ability to thrive in a fast-paced environment and meet tight deadlines.
• Proficient in using R or Python for data analysis.
• Strong interest in the media industry, specifically in television and streaming.
• Strong sense of accountability, curiosity, and an innovative mindset, with the ability to thrive in a fast-paced, evolving environment.

Additional Requirements

• Hybrid: This position has been designated as hybrid, which currently requires contributing from the office a minimum of three days per week. Beginning January 5, 2026, hybrid employees will be required to work from the office a minimum of four days per week. The Company reserves the right to change in-office requirements at any time.

Additional Information

• This position is eligible for company sponsored benefits, including medical, dental and vision insurance, 401(k), paid leave, tuition reimbursement, and a variety of other discounts and perks.
• Learn more about the benefits offered by NBCUniversal by visiting the Benefits page of the Careers website.
• Salary range: $100,000 - $160,000 (bonus & long-term incentive eligible).