Responsibilities

• Own statistical rigor across the program: review and approve study designs, evaluate vendor methods and assumptions, enforce power standards, and reject or redesign under-powered or invalid proposals
• Shape the incrementality testing roadmap with Media Analytics leadership: define hypotheses, decision criteria, and power thresholds, and own end-to-end execution of the roadmap
• Run independent validations: monitor for leakage, seasonality confounds, and design defects, and pressure-test vendor deliverables with targeted SQL, R, or Python analysis
• Triangulate experiment results with MMM and MTA: drive calibration across methods, propose tiebreakers where results diverge, and contribute to a unified view of incrementality across the measurement portfolio
• Manage the day-to-day relationship with our experimentation vendor: prioritize the study backlog, align on methodology, maintain testing schedules, and escalate blockers early
• Produce clear, defensible readouts: quantify lift and uncertainty, write concise decision memos, and hand off guidance to the Optimization & Insights team for in-market execution and pacing
• Support the expansion of causal measurement into subscriber engagement, including holdout-based approaches
• Mentor a Media Analytics analyst and uplevel partner teams on test design, statistical power, and common pitfalls, contributing to a standardized measurement approach across NBCU's Media Group

Requirements

• 4+ years in marketing/media experimentation with direct design/QA ownership and experience partnering with an incrementality testing measurement vendor (e.g., Haus, Measured, or similar).
• Proven command of causal inference in media—appropriate use of RCT, geo, diff-in-diff, and platform holdouts—and the ability to evaluate vendor assumptions/methods.
• Familiarity with power analysis, and failure modes (leakage, seasonality, parallel trends); history of stopping or redesigning under-powered tests.
• Platform experience: Google/Meta/TikTok incrementality and at least one CTV/Device environment (e.g., Roku, Samsung, Vizio).
• Experience reconciling vendor experiment reads with MMM/MTA and informing planning/pacing decisions without surprises.
• Fluent in SQL and Excel
• Knowledge of big data infrastructure and data science techniques.
• Effective communicator and collaborator with strong project management; ability to work in a highly matrixed environment and influence media buyers/channel leads.

Preferred

• Strong interpersonal skills with the ability to collaborate, motivate, and influence.
• Ability to thrive in a fast-paced environment and meet tight deadlines.
• Proficient in using R or Python for data analysis
• Strong interest in the media industry, specifically in television and streaming.
• Strong sense of accountability, curiosity, and an innovative mindset, with the ability to thrive in a fast-paced, evolving environment.

Benefits

• This position is eligible for company sponsored benefits, including medical, dental and vision insurance, 401(k), paid leave, tuition reimbursement, and a variety of other discounts and perks.