Responsibilities

• Testing Roadmap, Prioritization & Program Management
• Own and maintain a rolling testing roadmap and hypothesis backlog across paid media, email/lifecycle, landing pages, onboarding, paywall, and creative.
• Prioritize tests with a clear framework (ICE, PIE, or a Seeking variant) so the highest-impact, highest-confidence experiments run first.
• Keep an always-current view of what is being tested, what has been learned, and what is next, and communicate it weekly to the Director and channel owners.
• Set and hold testing velocity: the right number of concurrent, non-interfering experiments running at all times.
• Test Design & Execution
• Design and launch A/B, multivariate, and (where appropriate) holdout and geo-based experiments with proper control groups, adequate sample sizes, and pre-defined success metrics.
• Set up and QA tests in the experimentation platform (Optimizely, VWO, Statsig, Convert, AB Tasty, or comparable). You build the tests yourself.
• Partner with Data & Analytics and Engineering on tracking, event instrumentation, and attribution before every launch. You know the events you need, not just the ones you have.
• Define primary, secondary, and guardrail metrics for every test in plain, business-relevant terms.

Requirements

• Hands-on experience running A/B or multivariate tests in a marketing or growth context (paid, email, landing page, onboarding, or paywall), preferably at a consumer subscription, marketplace, mobile-first, or dating/social platform.
• In-the-tool fluency with at least one experimentation or A/B testing platform (Optimizely, VWO, Statsig, Convert, AB Tasty, Eppo, LaunchDarkly, or comparable). You set up and QA the tests yourself.
• Working understanding of experimental design: control/treatment setup, sample sizing, statistical significance, and common validity threats (novelty, seasonality, SRM, interaction effects). You know when to call a test and when to wait.
• Strong analytical fluency. Comfortable in GA4, testing-platform dashboards, and Excel/Sheets. Able to pull your own reads and pressure-test what the Data team hands you.
• Ready to run on day one. You can audit an existing testing program, identify what is misdesigned, and ship a better-instrumented experiment in week one.
• Strong written and verbal communication. You can write a crisp test brief and present nuanced results to a non-technical audience with equal confidence.
• AI fluency. You already use ChatGPT, Claude, Cursor, Cowork, or similar in your daily workflow to draft test plans, generate variant copy and creative, analyze results, and replace work you used to do by hand. If someone has to explain to you why AI matters, this role is not for you.
• Operator's discipline. You ship on time, your QA is tight, your naming is clean, and you document every result.

Preferred

• Consumer subscription, marketplace, or dating/social platform experience where activation, retention, and LTV are primary growth levers.
• Familiarity with Bayesian methods, multi-armed bandit, or adaptive experimentation, with a clear view on when to use them.
• Background in behavioral economics or consumer psychology. Understanding why people behave the way they do makes for sharper hypotheses.
• Experience contributing to a company-wide experimentation program (governance, tooling, standards, or team training).
• Experience designing experiments around AI-driven personalization or recommendation systems.
• Bachelor's degree in Marketing, Business, Statistics, Economics, Mathematics, Computer Science, or a related field, or an equivalent track record of shipping rigorous tests.

Benefits

• Health, dental, vision, 401(k), and a standard benefits package.