Strategy & Analytics Experimentation Director
Ladders · San Francisco, CA · 3 wk ago
On-siteBusiness Development$276k–$380k/yrFull-time
Location: San Francisco, CA – US based candidates only, no visa sponsorship available.
About the role
This role will lead work at the intersection of data, AI-enabled capabilities, and scalable technology delivery. You will partner with business, technical, and operational stakeholders to build reporting, surface trends, and translate analysis into action. The position offers the opportunity to strengthen data-driven execution and help teams focus on the metrics that matter most within a Business Services environment.
Responsibilities
- Own and enhance the company’s experimentation methodology to ensure high accuracy and rigor
- Build and maintain the experimentation operating system, including review processes and visibility tools
- Adapt methodologies to leverage increased experimentation velocity with AI technologies
- Design and measure experiments, serving as the primary design partner for complex or high-stakes experiments
- Act as the expert on causal inference methods when true experiments aren't feasible
- Conduct ad hoc reviews and analyses to interpret anomalous results effectively
- Collaborate with the Analytics Platform team to help shape their experiment platform roadmap
Qualifications
- 10+ years of relevant experience in experimentation, data science, or a closely related analytical role
- Extensive experimentation experience with a history of designing, reviewing, and analyzing hundreds of experiments on a central platform team
- Deep statistical expertise in methods for trustworthy experiments, including sample sizing and variance reduction
- Analytical rigor with the ability to critically assess results and identify subtle issues
- Strong cross-functional influence, capable of improving experimentation practices across diverse teams
- Understanding of data and experimentation platforms, including assignment infrastructure and data models
- Effective communication skills, with a focus on conveying experimental findings and their significance clearly
- Practical approach, balancing rigor with speed and prioritizing impactful outcomes
Pay
$276,000 – $379,500 annually
Benefits
- Opportunity to tackle meaningful problems that impact a global customer base
- Access to the latest enterprise AI tools to boost productivity
- Work with a talented and supportive team that values professional development
- Competitive pay with equity and comprehensive benefits
- An inclusive environment focused on equal access to growth and success opportunities