Director, Marketing Measurement & Testing

About the Company

AmeriSave Mortgage Corp. has set the standard in online mortgage lending, with over $130 billion in funded loan volume. As one of the top-rated, largest privately owned online mortgage lenders in the nation, our mission is to deliver beneficial, responsible home lending solutions with unwavering integrity, dedication, and excellence. We leverage cutting-edge technology and data-driven strategies to provide exceptional service to our customers. Our employees are the driving force behind our success, and we believe in creating an environment where contributions are celebrated and success is shared.

About the Role

AmeriSave is seeking a highly analytical and statistically rigorous Director of Marketing Measurement & Testing to lead test design, execution, analysis, and communication of marketing and conversion optimization initiatives. Reporting to the VP of Marketing Analytics, this role will serve as the organization's subject-matter expert for experimentation, measurement, and statistical analysis. This is a hands-on leadership role requiring both deep technical expertise and the ability to influence business decisions at the executive level.

The ideal candidate will be equally comfortable designing experiments, writing SQL queries, managing a testing database, conducting advanced statistical analyses, and presenting results to C-level executives. The Director will oversee measurement efforts across conversion rate optimization (CRO), marketing incrementality testing, media effectiveness studies, and marketing mix modeling (MMM).

Responsibilities

• Testing Strategy & Experimentation
  • Lead the design, execution, and analysis of conversion rate optimization (CRO) and marketing experimentation programs.
  • Develop statistically sound testing frameworks, methodologies, and best practices across marketing channels and customer touchpoints.
  • Design experiments including A/B tests, multivariate tests, geo-based experiments, holdout tests, lift studies, and incrementality tests.
  • Define hypotheses, success metrics, sample size requirements, statistical significance thresholds, and measurement approaches.
  • Ensure testing programs meet rigorous standards for validity, reliability, and business applicability.
• Measurement & Statistical Analysis
  • Conduct advanced statistical analyses to evaluate test performance and marketing effectiveness.
  • Lead large-scale measurement initiatives including Marketing Mix Modeling (MMM), incrementality analysis, causal inference studies, and attribution validation.
  • Apply statistical methodologies including power analysis, confidence interval estimation, significance testing, and experimental design techniques.
  • Identify drivers of marketing performance and provide data-driven recommendations for investment optimization.
  • Partner with marketing leadership to quantify the impact of strategic initiatives and media investments.
• Database & Analytics Infrastructure
  • Own and manage the marketing testing and measurement database environment.
  • Develop, maintain, and optimize SQL-based datasets, test repositories, and reporting structures.
  • Ensure data quality, consistency, documentation, and governance across testing programs.
  • Collaborate with marketing, engineering, and technology teams to improve measurement capabilities and data accessibility.
  • Establish scalable processes for maintaining historical test results and measurement frameworks.
• Reporting & Executive Communication
  • Develop executive-ready presentations, reports, and dashboards that communicate test results and strategic insights.
  • Present findings and recommendations to senior leadership and executive stakeholders.
  • Translate complex statistical analyses into actionable business recommendations.
  • Establish standardized testing scorecards, readout templates, and measurement frameworks.
  • Provide ongoing guidance to stakeholders on experiment interpretation and decision-making.
• Cross-Functional Leadership
  • Partner with Marketing, Media, Product, Technology, Analytics, and Executive teams to define and prioritize testing roadmaps.
  • Serve as a trusted advisor on measurement strategy and marketing effectiveness.
  • Foster a culture of experimentation, data-driven decision-making, and statistical rigor throughout the organization.
  • Potentially manage and mentor junior analysts or measurement specialists as the team evolves.

Requirements

• Master's degree in Statistics, Mathematics, Data Science, Operations Research, or another highly quantitative field.
• 7+ years of experience in marketing analytics, measurement, experimentation, statistics, or related analytical disciplines.
• Advanced proficiency in SQL, including database management, complex query development, and data validation.
• Experience designing and evaluating controlled experiments and large-scale marketing tests.
• Strong understanding of statistical inference, experimental design, causal measurement methodologies, and hypothesis testing.
• Experience presenting analytical findings to senior leadership and executive stakeholders.
• Exceptional communication, storytelling, and stakeholder management skills.
• Ability to independently lead projects from experimental design through executive readout.

Preferred Skills

• Experience in mortgage lending, financial services, or performance marketing environments.
• Experience with Marketing Mix Modeling (MMM) platforms such as Robyn, Meridian, or similar solutions.
• Proficiency in Python, R, or other statistical programming languages.
• Experience with CRO platforms such as Optimizely or similar experimentation tools.
• Experience with Power BI, Tableau, Snowflake, Azure, Google Cloud Platform, Databricks, and other modern analytics platforms.
• Familiarity with media measurement, attribution methodologies, and incrementality testing frameworks.
• Experience leading measurement programs in high-volume direct-to-consumer marketing environments.

Why Join AmeriSave?

• Lead the evolution of marketing measurement and experimentation for a leading direct-to-consumer mortgage lender.
• Influence strategic decisions through data-driven insights and rigorous statistical analysis.
• Work directly with senior executives and key business stakeholders.
• Build and scale a best-in-class testing and measurement framework.
• Join a collaborative, highly analytical marketing organization focused on continuous improvement and innovation.

Schedule

High-speed internet required for remote work: Cable or Fiber ONLY with the ability to connect via Ethernet. Minimum speeds: 70/30 Mbps (basic), 200-300/35-70 Mbps (shared), 500-1,000/100+ Mbps (heavy use).

Pay

The annual salary for this position generally ranges between $160,000 - $190,000 based on experience and qualifications.

Benefits

• 401(k)
• Dental insurance
• Disability insurance
• Employee discounts
• Health insurance
• Life insurance
• Paid time off
• 12 paid holidays per year
• Paid training
• Referral program
• Vision insurance
• Referral bonuses (supplemental pay)