Responsibilities

• Review AI outputs against current marketing specialist operations workflows, playbooks, and firm policy for Marketing Specialist assignments.
• Grade tone, escalation logic, and stakeholder fit on a structured rubric.
• Flag operational risk, missed escalations, and policy-adherence gaps with severity tags.
• Capture the right next step so the modeling team can train on it.
• Adjudicate disputed treatments against published playbooks or firm guidance.
• Maintain reviewer-quality scores in inter-rater calibration cycles.

Requirements

• Direct working experience in marketing specialist operations on real teams for Marketing Specialist work.
• Comfort applying multi-page rubrics consistently across long batches.
• Clear written reasoning that names the policy or workflow being applied.
• Strong attention to detail and the ability to flag when a prompt itself is the problem.
• Reliable async availability for at least 10 hours per week.
• Operational review
• Policy adherence
• Workflow judgment
• Stakeholder communication
• Marketing specialist operations

Preferred

• Prior experience training, calibrating, or QA-ing operations teams.
• Familiarity with AI-assisted workflow tooling and its failure modes.
• Bilingual experience for cross-region operations.