Content Evaluator

We are seeking detail-oriented Content Evaluators to test, review, and benchmark AI-generated customer support interactions across major platforms. In this role, you will evaluate AI model outputs against strict evaluation rubrics and authoritative business knowledge bases to help improve the quality, accuracy, and natural tone of next-generation customer support LLMs.

Key Responsibilities

Evaluate AI Outputs: Review and score AI-generated customer support conversations for accuracy, tone, compliance, faithfulness, and correct agent handoff. Fact-Checking & Verification: Verify customer intents and factual responses against business FAQs, product catalogs, SOPs, and official documentation to detect hallucinations or errors. Quality & Alignment: Participate in dual-review sessions and daily calibration audits to maintain high scoring consistency. Timely Delivery: Complete assigned evaluations accurately within the project's required turnaround time (TAT).

Qualifications & Skills Education

Minimum of a Bachelor's Degree in any discipline.

Language Proficiency

Native or Professional Proficiency in Spanish/Portuguese/Arabic, along with excellent written English skills.

Assessment Process

To be considered for onboarding, candidates must complete two pre-onboarding assessments specific to this project to evaluate rubric alignment and attention to detail.