Multimodal ai evaluation analyst

2 semanas atrás


Brasília, Brasil IMerit Technology Tempo inteiro

Job Description: Multimodal AI Evaluation AnalystTarget Language:EnglishCompany:i Merit ScholarsPosition Type:- Remote; Contract ($5/hour); ~10-40 hours per weekPosition Overview:i Merit Scholars is rapidly expanding our network of skilled AI Evaluation Analysts to help advance next-generation multimodal AI systems.This opportunity begins with a short paid pilot project (~12 hours total). Successful participants may be invited to continue with ongoing project work (typically 15–40 hours per week), depending on performance and project needs.As a Multimodal AI Evaluation Analyst, you’ll perform highly detailed evaluations of AI system outputs across text, image, video, and multimodal prompts. Your feedback will directly influence how leading AI systems understand and interact with the world.Compensation & Work StructureRate:$5/hourPhase 1:~12-hour paid pilot project (completed within a few days)Phase 2:Ongoing contract work (typically 15–40 hours/week) for top performersWhat You’ll DoEvaluate and score AI-generated outputs (text, image captions, video descriptions, multimodal prompts)Assess quality, correctness, coherence, style, and cultural alignmentIdentify subtle issues like hallucinations, logical gaps, or biasProvide detailed written feedback and apply complex evaluation guidelines consistentlyCollaborate with Quality Leads and Project Managers to ensure reliability and accuracyWhat You BringExcellent critical reading and evaluation skills across multiple modalitiesStrong English comprehension (CEFR B2 or above)Familiarity with LLMs, generative AI, and multimodal systemsExceptional attention to detail and consistencyComfort with iterative feedback, evolving workflows, and nuanced judgmentsPrior experience in data annotation, AI evaluation, or related work (preferred)Preferred QualificationsBA degree (preferred) or comparable experienceExperience working with annotation tools or AI data platformsUnderstanding of multimodal communication (text-to-image, video narratives, etc.)Comfort with fast-paced projects and evolving quality standardsAwareness that incidental exposure to sensitive or NSFW content may occurWhy Join i Merit ScholarsHelp shape how cutting-edge AI systems understand the worldWork remotely on projects at the forefront of multimodal AIGain hands-on experience in applied AI evaluationCollaborate with a global, expert community of AI trainersNext StepsStart bytakingQualified applicants will be invited by email to apaid 12-hour pilot project (includes 2 hours paid training)Strong results in the pilot may lead toongoing, flexible remote work (15–40 hrs/week)with i Merit Scholars.



  • Brasília, Brasil iMerit Technology Tempo inteiro

    Job Description: Multimodal AI Evaluation AnalystTarget Language:English Company:iMerit Scholars Position Type:- Remote; Contract ($5/hour); ~10-40 hours per week Position Overview: iMerit Scholars is rapidly expanding our network of skilled AI Evaluation Analysts to help advance next-generation multimodal AI systems. This opportunity begins with a short...


  • Brasília, Brasil iMerit Technology Tempo inteiro

    Job Description: Multimodal AI Evaluation AnalystTarget Language:English Company:iMerit Scholars Position Type:- Remote; Contract ($5/hour); ~10-40 hours per week Position Overview: iMerit Scholars is rapidly expanding our network of skilled AI Evaluation Analysts to help advance next-generation multimodal AI systems. This opportunity begins with a short...


  • Brasília, DF, Brasil iMerit Technology Tempo inteiro

    Job Description: Multimodal AI Evaluation Analyst Target Language: English Company: iMerit Scholars Position Type: - Remote; Contract ($5/hour); ~10-40 hours per week Position Overview: iMerit Scholars is rapidly expanding our network of skilled AI Evaluation Analysts to help advance next-generation multimodal AI systems. This opportunity begins with a short...


  • Brasília, DF, Brasil beBeeEvaluation Tempo inteiro

    Language Expert Evaluation Specialist We seek detail-oriented and analytically minded experts to evaluate AI system outputs across different modalities: text, image, video, and multimodal interactions. Key Responsibilities: Evaluate outputs generated by LLMs across multiple modalities (text, image captions, video descriptions, and multimodal prompts). Assess...


  • Brasília, Brasil iMerit Technology Tempo inteiro

    iMerit seeks detail-oriented and analytically minded Multimodal GenAI Evaluation Analysts to perform highly nuanced evaluations of AI system outputs across different modalities: text, image, video, and multimodal interactions. Analysts will assess the accuracy, appropriateness, quality, clarity, and cultural alignment of model outputs against complex...


  • Brasília, Brasil OperationsArmy Tempo inteiro

    About the job Accounting AI Analyst | Brazil | Remote Job Title: Accounting AI AnalystSchedule: Full-Time, 45 hours/weekWork Days: Monday to FridayWork Hours: Staggered shifts between 8:00 AM to 8:00 PM ESTWork Setup: Fully Remote Were looking for highly detail-oriented Accounting AI Analyst to support our AI operations team. In this role, you will be...


  • Brasília, Brasil beBeeArtificialIntelligence Tempo inteiro

    AI Leadership Role We are seeking highly skilled professionals to lead the development and deployment of scalable AI and machine learning solutions across enterprise systems. Design, develop, and deploy large-scale ML models, Generative AI, and RAG-based solutions. Create end-to-end AI/ML pipelines using GCP tools: Vertex AI, Gemini, Vector Search, and...

  • Project Manager

    3 semanas atrás


    Brasília, Brasil Chemin AI Tempo inteiro

    About Chemin Chemin, TDCX's AI‑focused subsidiary, partners with leading global companies to power next‑generation AI solutions. In collaboration with a leading fintech client, we are launching a new AI project and inviting native Brazilian Portuguese speakers to join us as a Project Lead. This fully remote role offers the chance to guide a team on data...

  • Data Analyst

    Há 3 dias


    Brasília, Brasil North Eastern Services Tempo inteiro

    About Fusemachines Fusemachines is a 10+ year old AI company, dedicated to delivering state-of-the-art AI products and solutions to a diverse range of industries. Founded by Sameer Maskey, Ph.D., an Adjunct Associate Professor at Columbia University, our company is on a steadfast mission to democratize AI and harness the power of global AI talent from...


  • Brasília, Brasil Motorola Solutions Tempo inteiro

    **Motorola Solutions values your privacy** .AI Ops Business Analyst: Automation & Process Optimization page is loaded## AI Ops Business Analyst: Automation & Process Optimizationlocations: Brazil Remote Worktime type: Full timeposted on: Posted 5 Days Agojob requisition id: R58406## **Company Overview**At Motorola Solutions, we believe that everything starts...