Sr. Applied Scientist, Amazon Ads Marketing Decision Science

New York City, NY (On-site)

$184K/yr – $249K/yrSenior LevelFull time

Posted 3 days ago

Job Summary

Own and advance the end-to-end agentic AI capability across channels, from design to production, shaping modeling, evaluation, and deployment.

  • Lead design of chatbot/agentic AI for WeChat and third-party channels
  • Define evaluation metrics and ensure production-grade performance

Job Description

Responsibilities

  • Lead the design and development of the chatbot/agentic AI capability for WeChat and other third-party channels, from concept through production.
  • Bring strong ML and LLM/NLP fundamentals to bear on system design — grounding architecture and modeling choices in a deep understanding of the underlying methods.
  • Architect and build agentic AI systems — planning, tool use, and multi-step reasoning — grounded in Retrieval-Augmented Generation (RAG) over Amazon Ads knowledge sources.
  • Apply reinforcement learning and model fine-tuning (e.g., instruction tuning, RLHF/RLAIF, preference optimization) to adapt large language models to our domain and channels.
  • Define and operationalize rigorous LLM evaluation: golden sets, faithfulness/groundedness, precision/recall, and human-in-the-loop evaluation mechanisms that reliably measure and improve quality.
  • Own applied engineering quality of the science stack — PyTorch modeling, well-designed APIs, and latency/cost optimization for real-time, production-grade interactions.
  • Collaborate with engineering, product management, and business teams to define requirements and ship measurable customer impact.
  • Drive continuous improvement through experimentation, iterative development, testing, and optimization.
  • Translate complex scientific challenges into clear, impactful solutions for business stakeholders.
  • Mentor and guide junior scientists, fostering a collaborative, high-performing team culture, and engage the broader scientific community through presentations, publications, and patents.

Requirements

  • 3+ years of building machine learning models for business application experience
  • PhD, or Master's degree and 6+ years of applied research experience
  • Experience programming in Java, C++, Python or related language
  • Experience with neural deep learning methods and machine learning

Preferred

  • Experience with modeling tools such as R, scikit-learn, Spark MLLib, MxNet, Tensorflow, numpy, scipy etc.
  • Experience with large scale distributed systems such as Hadoop, Spark etc.

Benefits

  • health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage)
  • 401(k) matching, paid time off, and parental leave.
Amazon logo

Amazon

Reli. is a family-owned business built around strong valuesand a passion to serve our customers. Our drivestemmed from seeing a need for custom-tailored qualityproducts at wholesale prices & quantities. We wanted to beable to put quality first and still be able to providehonest pricing.With our global and domestic operations, we have thefreedom to center each and every decision around ourvalued customers. We approach all our work with the same driveand energy to make sure our customers can always relyon Reli.

Founded in 2018
Cerritos, California, USA
171 employees (30 in marketing)

Salaries

Posted range

$184K/yr – $249K/yr

Taken straight from the job posting.

See all Amazon salaries

Traffic Signals

Monthly Visitors
2.8B
Monthly Google Ads Budget
$77.4M
Traffic Source Mix
Search
25.2%
Direct
65.9%
Referral
6.4%
Social
1.7%
Paid
0.6%

Headcount Trend

Current headcount: ~171

Recent News