Director, Experimentation, Decision Science

Raleigh, NC (Hybrid)

$114K/yr – $145K/yrDirector/Executive5+ years expFull time

Posted 6 days ago

Job Summary

Own end-to-end experimentation programs across web, app, and paid/owned media, turning hypotheses into measurable tests, guiding governance, and delivering executive-ready insights through close collaboration with engineering, analytics, UX/UI, and client teams.

  • Lead cross-channel roadmaps, hypotheses, and KPI definitions
  • Translate test results into strategic actions and ROI projections
  • Foster governance and best-practice sharing across client organizations

Job Description

Responsibilities

  • Design comprehensive cross-channel experimentation roadmaps and learning agendas aligned with client business goals across web, app, and paid/owned media channels
  • Formulate data-driven hypotheses, determine experiment feasibility, and define primary/secondary KPIs, target audiences, and statistical parameters (sample size, experiment duration, confidence intervals)
  • Drive audience segmentation and personalization strategies to deliver tailored user experiences across key digital touchpoints
  • Oversee and facilitate the complete experimentation workflow—from ideation, targeting setup, and variant build specs to post-launch quality assurance
  • Collaborate closely with engineering, analytics, UX/UI, and media teams to validate tag implementation, audience integration, and parameter tracking prior to test launches.
  • Monitor live test health, audience distribution, and data integrity to troubleshoot mid-flight anomalies or tracking issues
  • Evaluate multivariate, A/B, and personalization experiment results, translating complex outputs into compelling, executive-ready stories and strategic next steps
  • Work with analysts to quantify conversion lift, financial impact, and projected annual ROI to clearly demonstrate program value to senior executives
  • Act as a strategic consultant to assess client experimentation programs, benchmark maturity against industry standards, and deliver action plans to elevate client capabilities
  • Advise client stakeholders throughout the experimentation lifecycle, establishing governance, standardized documentation, intake processes, and prioritization frameworks

Requirements

  • Bachelor’s degree in Marketing, Business, Statistics, Psychology, Human Factors, or equivalent practical experience
  • 5+ years of web, digital or media experimentation experience
  • Direct experience running A/B, multivariate, and personalization experimentation programs across web, mobile, or digital media platforms
  • Proven track record of managing external client relationships, presenting to key stakeholders, and navigating matrixed organizations
  • Demonstrated history of partnering closely with engineering, UX/UI, analytics, and product teams to execute technical projects
  • Ability to manage multiple client accounts and concurrent test roadmaps independently under tight deadlines
  • Hands-on experience with Adobe Target. Experience with other experimentation and personalization platforms a plus
  • Practical knowledge of end-to-end site optimization, multivariate testing, A/B testing, and user segmentation/personalization
  • Foundational knowledge of statistical concepts relevant to testing
  • Ability to benchmark client testing maturity, build strategic roadmaps, and align testing initiatives with overarching business goals

Preferred

  • Experience with other experimentation and personalization platforms a plus

Benefits

  • MERGE is proud to invest in benefits that include meaningful Medical, Dental, Vision, Life Insurance, 401K, Lifestyle Spending Account, Employer Paid Life & Disability Insurance, Flexible Time off & Holidays plus many other benefits and rewards.
MERGE logo

MERGE

MERGE is a marketing and technology agency built for the intersection of health and wellness. We help brands navigate complex consumer journeys and unlock growth through data-driven storytelling, AI-powered personalization, and bold creativity.Powered by human insight, creativity, and AI, we unite people and brands.Our expertise spans health and consumer brands, with demonstrated experience across industries including: Pharma and Medtech, Health Providers, Insurance, Health, Financial Services, Retail, Connected Living, and Food.We provide deep platform expertise and services in: Strategy, Creative, Public Relations, Experience, Performance Marketing, Media, and Platforms.Our success is best illustrated in our enduring client partnerships with marquee brands such as Abbott, Blue Cross Blue Shield, GE Healthcare, Supernus, American Express, T-Mobile, Coach, and Meta.With teams across offices in Atlanta, Boston, Chicago, Denver, Kansas City, Los Angeles, New York City, and Raleigh. MERGE’s culture embraces agility, ability, and humility to consistently deliver exceptional client results.Recruitment Fraud Alert Notice: Please be aware of potential fraud or scams by individuals, organizations, or websites falsely claiming to represent MERGE in recruitment activities. MERGE follows a well-defined recruitment process for all positions, which includes formal interviews before issuing any offers of employment. Importantly, we do not require any payments or fees from job applicants. Additionally, MERGE does not conduct interviews through texting platforms such as RingCentral. If you receive any suspicious emails claiming to recruit on behalf of MERGE, do not share personal information or make any payments. Qualified candidates should only apply to current openings directly through MERGE’s

Founded in 2018
Chicago, Illinois, USA
852 employees (246 in marketing)

Salaries

Posted range

$114K/yr – $145K/yr

Taken straight from the job posting.

See all MERGE salaries

Traffic Signals

Monthly Visitors
46.8K
Monthly Google Ads Budget
$18.6K
Traffic Source Mix
Search
39.5%
Direct
45.4%
Referral
9.1%
Social
4.5%
Paid
1.3%

Headcount Trend

Current headcount: ~857
MERGE logo

Director, Experimentation, Decision Science

MERGE · Raleigh, NC · Hybrid