AI Content Evaluator (Remote)

USA (Remote)

$25/hr – $35/hrIntern/New GradContract

Posted 8 days ago

Job Summary

The role owns evaluating AI-generated content for accuracy and quality, provides feedback to improve model performance, and collaborates with engineers to refine data and guidelines.

Own evaluation standards and documentation
Coordinate with engineers and linguists to identify errors
Help improve training data and evaluation guidelines

Job Description

Responsibilities

Evaluate AI-generated content for factual accuracy, grammatical correctness, and contextual relevance across multiple languages.
Provide detailed feedback and ratings based on predefined evaluation criteria to improve model performance.
Collaborate with AI engineers and linguists to identify patterns in content errors and suggest improvements to training datasets.
Maintain consistency in evaluation standards by following established guidelines and updating them as needed.
Document findings and recommendations to support continuous improvement of AI content generation systems.

Requirements

Experience in content evaluation, proofreading, or quality assurance with a focus on AI-generated text.
Strong proficiency in multiple languages and familiarity with linguistic nuances in content evaluation.
Ability to follow structured evaluation guidelines and provide constructive feedback.
Attention to detail and commitment to maintaining high standards in content assessment.
Experience working with AI models, natural language processing, or related technologies is a plus.

Hire Feed

HireFeed: A QuikHire product.Earn in dollars. On your hours. From wherever.HireFeed is the AI-curated feed of contract, gig, and AI training jobs that pay in USD, built for the people who actually want to work, not the ones writing job descriptions.Why it exists: the highest-paying contract work in the world - RLHF, AI evaluation, domain-expert training, senior contract engineering, sits scattered across hundreds of ATS feeds and platform job boards. Most of it never makes it to Indeed or LinkedIn, and the roles that do are usually stale by the time you find them. The best opportunities are also the most ephemeral.HireFeed pulls from 500+ verified sources, including Outlier, Mercor, Surge AI, Micro1, Turing, Toloka, Appen, and Remotasks, and refreshes every 60 seconds. The moment a role closes at the source, it falls off the feed.What you'll find here:- AI training, RLHF, and evaluation: $20–$80/hr- Domain experts: medical, legal, finance, math (PhD)- Senior contract engineering, paid weekly- Multilingual annotation, creative writing training, AI researchWhat you won't find: pay-undisclosed listings, expired roles, "still accepting applications" lies, recruiter middlemen, or data resale. Pay is a hard requirement. Apply links 302-redirect to the source ATS. We never see your résumé.Free for candidates, forever. Funded by the partner side.→ hirefeed.co.in

Menlo Park, California, USA

6 employees

www.hirefeed.co.in