Multimodal AI Evaluation Analyst

3 semanas atrás


Brazil iMerit Technology Tempo inteiro

Job Description: Multimodal AI Evaluation AnalystTarget Language: EnglishCompany: iMerit ScholarsPosition Type: - Remote; Contract ($5/hour); ~10-40 hours per weekPosition Overview:iMerit Scholars is rapidly expanding our network of skilled AI Evaluation Analysts to help advance next-generation multimodal AI systems.This opportunity begins with a short paid pilot project (~12 hours total). Successful participants may be invited to continue with ongoing project work (typically 15–40 hours per week), depending on performance and project needs.As a Multimodal AI Evaluation Analyst, you’ll perform highly detailed evaluations of AI system outputs across text, image, video, and multimodal prompts. Your feedback will directly influence how leading AI systems understand and interact with the world.Compensation & Work StructureRate: $5/hourPhase 1: ~12-hour paid pilot project (completed within a few days)Phase 2: Ongoing contract work (typically 15–40 hours/week) for top performersWhat You’ll DoEvaluate and score AI-generated outputs (text, image captions, video descriptions, multimodal prompts)Assess quality, correctness, coherence, style, and cultural alignmentIdentify subtle issues like hallucinations, logical gaps, or biasProvide detailed written feedback and apply complex evaluation guidelines consistentlyCollaborate with Quality Leads and Project Managers to ensure reliability and accuracyWhat You BringExcellent critical reading and evaluation skills across multiple modalitiesStrong English comprehension (CEFR B2 or above)Familiarity with LLMs, generative AI, and multimodal systemsExceptional attention to detail and consistencyComfort with iterative feedback, evolving workflows, and nuanced judgmentsPrior experience in data annotation, AI evaluation, or related work (preferred)Preferred QualificationsBA degree (preferred) or comparable experienceExperience working with annotation tools or AI data platformsUnderstanding of multimodal communication (text-to-image, video narratives, etc.)Comfort with fast-paced projects and evolving quality standardsAwareness that incidental exposure to sensitive or NSFW content may occurWhy Join iMerit ScholarsHelp shape how cutting-edge AI systems understand the worldWork remotely on projects at the forefront of multimodal AIGain hands-on experience in applied AI evaluationCollaborate with a global, expert community of AI trainersNext StepsStart by taking the 30-minute skill assessmentQualified applicants will be invited by email to a paid 12-hour pilot project (includes 2 hours paid training)Strong results in the pilot may lead to ongoing, flexible remote work (15–40 hrs/week) with iMerit Scholars.



  • Brazil iMerit Technology Tempo inteiro

    Job Description: Multimodal AI Evaluation Analyst Target Language: English Company: iMerit Scholars Position Type: - Remote; Contract ($5/hour); ~10-40 hours per week Position Overview: iMerit Scholars is rapidly expanding our network of skilled AI Evaluation Analysts to help advance next-generation multimodal AI systems. This opportunity begins with a short...


  • Brazil beBeeEvaluator Tempo inteiro

    At the forefront of innovation, we seek a highly skilled Multimodal AI Evaluation Expert to join our team. As an integral part of our evaluation process, you will play a crucial role in shaping the standards that ensure AI systems are accurate, safe, and culturally aware across text, vision, and multimodal applications. Job Description Evaluate outputs...


  • Brazil beBeeAI Tempo inteiro

    Remote AI Evaluation Opportunities We're seeking skilled professionals to evaluate and improve the performance of cutting-edge AI systems. As a Multimodal AI Evaluation Analyst, you'll play a crucial role in shaping the future of artificial intelligence. This is a remote opportunity that allows you to work at your own pace while contributing to...


  • Brazil iMerit Technology Tempo inteiro

    iMerit seeks detail-oriented and analytically minded Multimodal GenAI Evaluation Analysts to perform highly nuanced evaluations of AI system outputs across different modalities: text, image, video, and multimodal interactions. Analysts will assess the accuracy, appropriateness, quality, clarity, and cultural alignment of model outputs against complex...

  • Chief AI Visionary

    1 semana atrás


    Brazil beBeeAiLeader Tempo inteiro

    **Job Opportunity:** As a senior AI leader, we are seeking an exceptional engineer to spearhead the design and implementation of cutting-edge artificial intelligence solutions. Role Overview: The ideal candidate will have strong technical expertise in generative AI, RAG architectures, and large language models, as well as hands-on experience with the Google...

  • Lead AI Engineer

    2 semanas atrás


    Brazil GeorgiaTEK Systems Inc. Tempo inteiro

    Lead AI Engineer (3 Positions)Location: Brazil (Remote / Hybrid based on project needs)Role OverviewWe are seeking highly skilled Lead AI Engineers based in Brazil to design, develop, and deploy scalable AI and machine learning solutions across enterprise systems. The ideal candidates will have strong expertise in Generative AI, RAG architectures, LLMs, and...

  • Lead AI Engineer

    1 semana atrás


    Brazil GeorgiaTEK Systems Inc. Tempo inteiro

    Lead AI Engineer (3 Positions) Location: Brazil (Remote / Hybrid based on project needs) Role Overview We are seeking highly skilled Lead AI Engineers based in Brazil to design, develop, and deploy scalable AI and machine learning solutions across enterprise systems. The ideal candidates will have strong expertise in Generative AI, RAG architectures, LLMs,...

  • Lead AI Engineer

    1 semana atrás


    Brazil GeorgiaTEK Systems Inc. Tempo inteiro

    Lead AI Engineer (3 Positions) Location: Brazil (Remote / Hybrid based on project needs) Role Overview We are seeking highly skilled Lead AI Engineers based in Brazil to design, develop, and deploy scalable AI and machine learning solutions across enterprise systems. The ideal candidates will have strong expertise in Generative AI , RAG architectures , LLMs...


  • Brazil Remote Work Motorola Solutions Tempo inteiro R$60.000 - R$120.000 por ano

    Company Overview​At Motorola Solutions, we believe that everything starts with our people. We're a global close-knit community, united by the relentless pursuit to help keep people safer everywhere. Our critical communications, video security and command center technologies support public safety agencies and enterprises alike, enabling the coordination...


  • Brazil Remote Work Motorola Solutions Tempo inteiro R$80.000 - R$200.000 por ano

    Company Overview​At Motorola Solutions, we believe that everything starts with our people. We're a global close-knit community, united by the relentless pursuit to help keep people safer everywhere. Our critical communications, video security and command center technologies support public safety agencies and enterprises alike, enabling the coordination...