Responsibilities

• Design task briefs based on actual lifecycle or CRM marketing work. Define the task's true test, including planted issues and strong practitioner decisions.
• Specify necessary documents, dashboards, personas, and tool states for realistic task versions.
• Write or review reference answers and criteria distinguishing strong from plausible-but-wrong responses.
• Review AI agent attempts and evaluate them against your standards.
• Diagnose issues from messy or conflicting data, prioritize, make tradeoffs, plan, execute, QA, reconcile, triage, escalate, research, evaluate, report, and orchestrate multi-step work across several tools.

Requirements

• Hands-on practitioner experience in lifecycle, CRM, or retention marketing.
• Comfortable with an ESP, a CRM like Salesforce, and product analytics like Amplitude.
• Clear written reasoning to explain decision-making.

Preferred

• Experience building AI training environments, RL environments, or simulated case studies.
• Rubric Academy or Rubric Bootcamp certification.