Content Moderator

Job Title:
Content Rater

Location:
Remote in Sao Paulo, Brazil

Duration:
4 months fixed term

Work from office
9am-4pm BRT.

Salary:
BRL 2100/month

Languages required:
Portuguese and English

About the Role

Our project currently seeks a Content Rater. The main goal of this position is to identify and rate various types of content (mostly text, but it can also include audio, video and photos) as per the defined policies and guidelines. The responsibilities include reviewing and rating user/AI-generated content. Ratings should be made within the provided task guidelines and supported by written explanations to enhance rating quality.

Roles and Responsibilities

• Evaluate and rate various content types, including mostly text, but also audio, video and photos.
• Assess AI generated responses for accuracy, factuality, relevance, helpfulness, language usage, and alignment with user intent.
• Conduct research & fact-checking by comparing AI-generated response with other generally available sources (ex: Web search, social media, 3rd party materials) and identify key differences and trends.
• Conduct side-by-side comparisons and identify key differences between responses.
• Rate and stack rank responses& provide clear reasoning while ensuring adherence to guidelines
• Ensure consistency in rating decisions
• Supporting internal training
• Conducting QA/Peer reviews
• Attend customer calls/calibration sessions/calls
• Supporting other projects outside of your core project, as and when required,
• Re-writing prompts or responses

Skills Requirements & Qualifications

• English B1/B2
• Native in Portuguese language to perform the content rating
• University Degree (preferred)
• 1 year of relevant experience (inclusive of journalism, literature, writing or other comparable experience)
• Basic level computer handling skills (along with a typing speed of 25-30 words per minute)
• Comfortable with G suite, especially Google Sheets
• Excellent in verbal & writing skills with the ability to present reasoning in a clear, concise, and logical manner
• Understanding of various AI models and their capabilities.
• Knowledge of established guidelines and best practices for content rating.
• Experience in evaluating and comparing content from different sources.
• Detail oriented, rigorous, analytical skills to assess content factuality, relevance, and alignment with user intent.
• Research skills to evaluate content accuracy and identify trustworthy sources.
• Critical thinking skills to identify biases, inconsistencies, and limitations in AI-generated responses.
• Attention to detail to review content for grammar, style, and adherence to ethical/legal standards.