Multimodal AI Evaluation Analyst

3 semanas atrás

Brasília DF, Brasil iMerit Technology Tempo inteiro

Job Description: Multimodal AI Evaluation Analyst Target Language: English Company: iMerit Scholars Position Type: - Remote; Contract ($5/hour); ~10-40 hours per week Position Overview: iMerit Scholars is rapidly expanding our network of skilled AI Evaluation Analysts to help advance next-generation multimodal AI systems. This opportunity begins with a short paid pilot project (~12 hours total). Successful participants may be invited to continue with ongoing project work (typically 15–40 hours per week), depending on performance and project needs. As a Multimodal AI Evaluation Analyst, you'll perform highly detailed evaluations of AI system outputs across text, image, video, and multimodal prompts. Your feedback will directly influence how leading AI systems understand and interact with the world. Compensation & Work Structure Rate: $5/hour Phase 1: ~12-hour paid pilot project (completed within a few days) Phase 2: Ongoing contract work (typically 15–40 hours/week) for top performers What You'll Do Evaluate and score AI-generated outputs (text, image captions, video descriptions, multimodal prompts) Assess quality, correctness, coherence, style, and cultural alignment Identify subtle issues like hallucinations, logical gaps, or bias Provide detailed written feedback and apply complex evaluation guidelines consistently Collaborate with Quality Leads and Project Managers to ensure reliability and accuracy What You Bring Excellent critical reading and evaluation skills across multiple modalities Strong English comprehension (CEFR B2 or above) Familiarity with LLMs, generative AI, and multimodal systems Exceptional attention to detail and consistency Comfort with iterative feedback, evolving workflows, and nuanced judgments Prior experience in data annotation, AI evaluation, or related work (preferred) Preferred Qualifications BA degree (preferred) or comparable experience Experience working with annotation tools or AI data platforms Understanding of multimodal communication (text-to-image, video narratives, etc.) Comfort with fast-paced projects and evolving quality standards Awareness that incidental exposure to sensitive or NSFW content may occur Why Join iMerit Scholars Help shape how cutting-edge AI systems understand the world Work remotely on projects at the forefront of multimodal AI Gain hands-on experience in applied AI evaluation Collaborate with a global, expert community of AI trainers Next Steps Start by taking Qualified applicants will be invited by email to a paid 12-hour pilot project (includes 2 hours paid training) Strong results in the pilot may lead to ongoing, flexible remote work (15–40 hrs/week) with iMerit Scholars.

  • Multimodal AI Evaluation Analyst

    3 semanas atrás

    Brasília, Brasil iMerit Technology Tempo inteiro

    Job Description: Multimodal AI Evaluation AnalystTarget Language:English Company:iMerit Scholars Position Type:- Remote; Contract ($5/hour); ~10-40 hours per week Position Overview: iMerit Scholars is rapidly expanding our network of skilled AI Evaluation Analysts to help advance next-generation multimodal AI systems. This opportunity begins with a short...

  • Multimodal AI Evaluation Analyst

    3 semanas atrás

    Brasília, Brasil iMerit Technology Tempo inteiro

    Job Description: Multimodal AI Evaluation AnalystTarget Language:English Company:iMerit Scholars Position Type:- Remote; Contract ($5/hour); ~10-40 hours per week Position Overview: iMerit Scholars is rapidly expanding our network of skilled AI Evaluation Analysts to help advance next-generation multimodal AI systems. This opportunity begins with a short...

  • Multimodal ai evaluation analyst

    3 semanas atrás

    Brasília, Brasil IMerit Technology Tempo inteiro

    Job Description: Multimodal AI Evaluation AnalystTarget Language:EnglishCompany:i Merit ScholarsPosition Type:- Remote; Contract ($5/hour); ~10-40 hours per weekPosition Overview:i Merit Scholars is rapidly expanding our network of skilled AI Evaluation Analysts to help advance next-generation multimodal AI systems.This opportunity begins with a short paid...

  • Language Expert Evaluation Specialist

    Há 6 dias

    Brasília, DF, Brasil beBeeEvaluation Tempo inteiro

    Language Expert Evaluation Specialist We seek detail-oriented and analytically minded experts to evaluate AI system outputs across different modalities: text, image, video, and multimodal interactions. Key Responsibilities: Evaluate outputs generated by LLMs across multiple modalities (text, image captions, video descriptions, and multimodal prompts). Assess...

  • Language Expert Evaluation Specialist

    Há 3 dias

    Brasília, Brasil beBeeEvaluation Tempo inteiro

    Language Expert Evaluation Specialist We seek detail-oriented and analytically minded experts to evaluate AI system outputs across different modalities: text, image, video, and multimodal interactions. Key Responsibilities: Evaluate outputs generated by LLMs across multiple modalities (text, image captions, video descriptions, and multimodal prompts). Assess...

  • English Language Specialist

    1 semana atrás

    Brasília, Brasil iMerit Technology Tempo inteiro

    iMerit seeks detail-oriented and analytically minded Multimodal GenAI Evaluation Analysts to perform highly nuanced evaluations of AI system outputs across different modalities: text, image, video, and multimodal interactions. Analysts will assess the accuracy, appropriateness, quality, clarity, and cultural alignment of model outputs against complex...

  • Ai Trainer

    Há 5 dias

    Brasília, Brasil Chemin Ai Tempo inteiro

    About CheminChemin, TDCX's AI-focused subsidiary, is launching a new gigwork opportunity for individuals eager to earn while contributing to cutting-edge AI projects.We partner with leading global companies to power next-generation AI solutions.For this project, we are teaming up with a leading fintech client, and we're inviting individuals native of Brazil...

  • AI Expert

    1 dia atrás

    Brasília, DF, Brasil beBeeAI Tempo inteiro

    Job Title: AI Systems Architect We are seeking a highly skilled AI Systems Architect to join our team. As a key member of our engineering team, you will report directly to the CTO and operate within small, agile teams alongside software engineers, security experts, and product managers. Key Responsibilities: AIArchitecting, fine-tuning, and deploying AI...

  • AI Process Expert

    1 dia atrás

    Brasília, DF, Brasil beBeeai Tempo inteiro

    Enterprise AI Solutions Developer We are seeking a skilled developer to create structured, data-driven tasks that enhance AI reasoning and understanding of enterprise processes. Key Responsibilities: Create decision frameworks for Reinforcement Learning initiatives, including taxonomy design, realistic scenario creation, and evaluation criteria. Design...

  • AI Technology Specialist

    1 dia atrás

    Brasília, DF, Brasil beBeeEngineering Tempo inteiro

    Job Title: AI Engineering Leader We are seeking a highly skilled and experienced AI engineering leader to spearhead our product development efforts in a fast-paced environment. This role focuses on implementing scalable vector store integrations, building retrieval pipelines, and enabling advanced communication protocols between intelligent agents. The...