Director, AI Experimentation & Measurement

The Director of Experimentation & Measurement will own the portfolio-wide standard for what counts as proof, defined before work begins, not after results land. This includes drafting and socializing pre-registered success criteria for each initiative, maintaining a shared measurement playbook, and prioritizing what the portfolio must prove next.

Success criteria & proof standards

• Draft and socialize pre-registered success criteria for each initiative (primary KPIs, guardrails, minimum detectable effect, read windows).
• Maintain a ranked learning agenda across initiatives and recommend the next proof point per initiative.
• Run power analysis and flag underpowered or ungradeable designs before launch.
• Produce evidence read memos on a fixed cadence: what was tested, what was observed, what it means, what is recommended.
• Synthesize across initiatives into one portfolio story—not a patchwork of disconnected scorecards.
• Guard against failure modes that quietly invalidate results: moving goalposts; letting the people a system is meant to outperform grade it; acting before pre-registered proof exists.
• Escalate when a read is not gradeable.
• Run evidence read sessions at pre-registered dates; own continue / adjust / stop recommendations with rationale; track whether recommendations are acted on.

Portfolio learning agenda

This involves prioritizing what the portfolio must prove next—and in what sequence evidence compounds. This ensures that the right experiments are conducted in the right order to drive meaningful insights and progress.

Experiment design & statistical rigor

• Review experiment designs: control arms, audience matching, read windows, confounders, data leakage risks.
• Run power analysis and flag underpowered or ungradeable designs before launch.

Evidence narrative for senior leaders

Produces evidence read memos on a fixed cadence: what was tested, what was observed, what it means, what is recommended. Synthesizes across initiatives into one portfolio story—not a patchwork of disconnected scorecards.

Measurement integrity & bias controls

• Guard against failure modes that quietly invalidate results: moving goalposts; letting the people a system is meant to outperform grade it; acting before pre-registered proof exists.
• Escalate when a read is not gradeable.

Evidence governance & readout cadence

Runs evidence read sessions at pre-registered dates; owns continue / adjust / stop recommendations with rationale; tracks whether recommendations are acted on.

Key stakeholders & accountability

• Partners with initiative facilitators on criteria, design, and readouts.
• Influences BU Presidents and proxies by helping define their success criteria and reporting back whether evidence meets the bar.
• Reports results and implications to USLT and Chief Commercial Office as portfolio executive sponsors.

Required Qualifications:

• Bachelor's degree required with 8+ years of relevant experience spanning experimentation, measurement science, causal inference, or a quantitatively rigorous discipline — paired with strategy or product-facing work.
• Systems thinking: sees across an entire portfolio, frames the questions that matter most, and designs how proof compounds over time rather than optimizing one test at a time.
• Storytelling and executive presence: turns a rigorous, technical result into a clear, persuasive narrative that shapes senior decisions.
• Experiment design and causal credibility: has designed and defended controlled experiments at enterprise scale: power analysis, matched controls, quasi-experimental methods, pre-registration.
• Independence and spine: able to tell a senior stakeholder that a result does not clear the bar, and make it stick.
• AI fluency: evaluates AI/ML and generative systems credibly: what a real performance signal looks like versus a plausible artifact.

Preferred Qualifications:

• Regulated-industry measurement experience.
• Provenance, auditability, and responsible-AI evaluation frameworks.
• Experience standing up an experimentation or evidence function from scratch.
• Candidate demonstrates a breadth of diverse leadership experiences and capabilities including: the ability to influence and collaborate with peers, develop and coach others, oversee and guide the work of other colleagues to achieve meaningful outcomes and create business impact.

Other Job Details:

• Last Date to Apply for Job: July 26, 2026.
• Ability to travel based on business needs.
• This position is hybrid and requires working onsite 2 to 3 days per week.
• The annual base salary for this position ranges from $162,900.00 to $271,500.00.
• This position is eligible for participation in Pfizer’s Global Performance Plan with a bonus target of 20.0% of the base salary and eligibility to participate in our share based long term incentive program.
• We offer comprehensive and generous benefits and programs to help our colleagues lead healthy lives and to support each of life’s moments.
• Benefits offered include a 401(k) plan with Pfizer Matching Contributions and an additional Pfizer Retirement Savings Contribution, paid vacation, holiday and personal days, paid caregiver/parental and medical leave, and health benefits to include medical, prescription drug, dental and vision coverage.
• Learn more at Pfizer Candidate Site – U.S. Benefits | (uscandidates.mypfizerbenefits.com).
• Pfizer compensation structures and benefit packages are aligned based on the location of hire.
• The United States salary range provided does not apply to Tampa, FL or any location outside of the United States.
• This role is posted in multiple locations.
• If you are applying for the role in an secondary job posting location where pay transparency regulations apply, your Talent Advisor will share the local pay information with you during the first interview.
• Relocation assistance may be available based on business needs and/or eligibility.
• Candidates must be authorized to be employed in the U.S. by any employer.
• U.S. work visa sponsorship (such as TN, O-1, H-1B, etc.) is not available for this role now or in the future.
• Sunshine Act: Pfizer reports payments and other transfers of value to health care providers as required by federal and state transparency laws and implementing regulations.
• EEO & Employment Eligibility: Pfizer is committed to equal opportunity in the terms and conditions of employment for all employees and job applicants without regard to race, color, religion, sex, sexual orientation, age, gender identity or gender expression, national origin, disability or veteran status.
• Pfizer also complies with all applicable national, state and local laws governing nondiscrimination in employment as well as work authorization and employment eligibility verification requirements of the Immigration and Nationality Act and IRCA.
• Pfizer is an E-Verify employer.
• This position requires permanent work authorization in the U.S.
• Pfizer endeavors to make www.pfizer.com/careers accessible to all users.
• If you would like to contact us regarding the accessibility of our website or need assistance completing the application process and/or interviewing, please email disabilityrecruitment@pfizer.com.
• This is to be used solely for accommodation requests with respect to the accessibility of our website, online application process and/or interviewing. Requests for any other reason will not be returned.
• To learn more about acceptable and prohibited uses of AI during the recruitment process, please review our candidate AI-use guidelines available on Pfizer Careers.