Multimodal AI Evaluation Analyst

Há 5 dias

Rio de Janeiro, Brasil iMerit Technology Tempo inteiro

Job Description: Multimodal AI Evaluation Analyst Target Language:English Company:iMerit Scholars Position Type:- Remote; Contract ($5/hour); ~10-40 hours per week Position Overview: iMerit Scholars is rapidly expanding our network of skilled AI Evaluation Analysts to help advance next-generation multimodal AI systems. This opportunity begins with a short paid pilot project (~12 hours total). Successful participants may be invited to continue with ongoing project work (typically 15–40 hours per week), depending on performance and project needs. As a Multimodal AI Evaluation Analyst, you’ll perform highly detailed evaluations of AI system outputs across text, image, video, and multimodal prompts. Your feedback will directly influence how leading AI systems understand and interact with the world. Compensation & Work Structure Rate:$5/hour Phase 1:~12-hour paid pilot project (completed within a few days) Phase 2:Ongoing contract work (typically 15–40 hours/week) for top performers What You’ll Do Evaluate and score AI-generated outputs (text, image captions, video descriptions, multimodal prompts) Assess quality, correctness, coherence, style, and cultural alignment Identify subtle issues like hallucinations, logical gaps, or bias Provide detailed written feedback and apply complex evaluation guidelines consistently Collaborate with Quality Leads and Project Managers to ensure reliability and accuracy What You Bring Excellent critical reading and evaluation skills across multiple modalities Strong English comprehension (CEFR B2 or above) Familiarity with LLMs, generative AI, and multimodal systems Exceptional attention to detail and consistency Comfort with iterative feedback, evolving workflows, and nuanced judgments Prior experience in data annotation, AI evaluation, or related work (preferred) Preferred Qualifications BA degree (preferred) or comparable experience Experience working with annotation tools or AI data platforms Understanding of multimodal communication (text-to-image, video narratives, etc.) Comfort with fast-paced projects and evolving quality standards Awareness that incidental exposure to sensitive or NSFW content may occur Why Join iMerit Scholars Help shape how cutting-edge AI systems understand the world Work remotely on projects at the forefront of multimodal AI Gain hands-on experience in applied AI evaluation Collaborate with a global, expert community of AI trainers Next Steps Start bytaking the 30-minute skill assessment Qualified applicants will be invited by email to apaid 12-hour pilot project (includes 2 hours paid training) Strong results in the pilot may lead toongoing, flexible remote work (15–40 hrs/week)with iMerit Scholars.

  • Multimodal AI Evaluation Analyst

    Há 6 dias

    Patos de Minas, MG, Brasil iMerit Technology Tempo inteiro

    Job Description: Multimodal AI Evaluation Analyst Target Language: English Company: iMerit Scholars Position Type: - Remote; Contract ($5/hour); ~10-40 hours per week Position Overview: iMerit Scholars is rapidly expanding our network of skilled AI Evaluation Analysts to help advance next-generation multimodal AI systems. This opportunity begins with a short...

  • AI Agent Evaluation Analyst

    Há 20 horas

    Rio de Janeiro, Rio de Janeiro, Brasil Mindrift Tempo inteiro R$36.000 - R$72.000 por ano

    At Mindrift, innovation meets opportunity. We believe in using the power of collective human intelligence to ethically shape the future of AI. The Mindrift platform, launched and powered by Toloka, connects domain experts with cutting-edge AI projects from innovative tech clients. Our mission is to unlock the potential of GenAI by tapping into real-world...

  • AI Agent Evaluation Analyst

    4 semanas atrás

    Região Geográfica Imediata de Criciúma, Brasil Mindrift Tempo inteiro

    Overview Mindrift connects domain experts with cutting‑edge AI projects, unlocking the potential of GenAI by tapping real‑world expertise from across the globe. Who we’re looking for We seek curious, intellectually proactive contributors who double‑check assumptions, play devil’s advocate, and thrive amid ambiguity and complexity. About the project...

  • AI Research Engineer

    3 semanas atrás

    Região Geográfica Intermediária de Juiz de Fora, Brasil Tether Operations Limited Tempo inteiro

    Join Tether and Shape the Future of Digital Finance At Tether, we’re pioneering a global financial revolution with innovative blockchain solutions that enable seamless, secure, and transparent digital transactions worldwide. About Tether Our product suite includes the trusted stablecoin USDT , energy-efficient Bitcoin mining solutions, advanced data...

  • AI Red Team Engineer

    4 semanas atrás

    Região Geográfica Intermediária de Sorocaba, Brasil LILT AI Tempo inteiro

    AI Red Team Engineer - Brazilian Portuguese 1 day ago Be among the first 25 applicants About LILT AI is changing how the world communicates — and LILT is leading that transformation. We’re on a mission to make the world’s information accessible to everyone, regardless of the language they speak. We use cutting‑edge AI, machine translation, and...

  • Accounting Business Analyst

    Há 3 dias

    Rio de Janeiro, Brasil FullStack Tempo inteiro

    Accounting Business Analyst - AI Expertise - Remote - Latin America Join to apply for the Accounting Business Analyst - AI Expertise - Remote - Latin America role at FullStack About FullStack FullStack is the most transparent IT talent network, connecting highly skilled individuals with top global companies and Silicon Valley startups for remote, on-demand...

  • AI Ops Business Analyst: Gems Process Automation

    2 semanas atrás

    Rio de Janeiro, Rio de Janeiro, Brasil Motorola Solutions Tempo inteiro R$80.000 - R$120.000 por ano

    Company OverviewAt Motorola Solutions, we believe that everything starts with our people. We're a global close-knit community, united by the relentless pursuit to help keep people safer everywhere. Our critical communications, video security and command center technologies support public safety agencies and enterprises alike, enabling the coordination that's...

  • Business Analyst

    4 semanas atrás

    Rio de Janeiro, Brasil Turing Tempo inteiro

    About the Role:We’re hiring a Lead Analyst / Content Team Lead to manage and mentor a team of analysts creating business-focused content to improve AI models with no AI experience required. You’ll combine leadership, quality oversight, and subject expertise in MBA-relevant domains to ensure outputs are accurate, logically sound, and aligned with project...

  • Operations & Support Analyst (AI Startup – Remote LATAM / Bilingual)

    Há 3 dias

    Rio de Janeiro, Brasil Parikh Financial Tempo inteiro

    Operations & Support Analyst (AI Startup – Remote LATAM / Bilingual) Our client is a small but fast‑growing AI‑powered software startup supporting consulting, finance, and enterprise clients. They build intelligent automation tools that help teams save time and work smarter. As they scale, they’re looking for a reliable and detail‑oriented...

  • AI & Data Insights Analyst Internship In Bali

    2 semanas atrás

    Rio de Janeiro, Rio de Janeiro, Brasil EX Venture Inc. Tempo inteiro R$30.000 - R$90.000 por ano

    AI & Data Insights Analyst – Rio de JaneiroFund Size: €90M USD Location: Bali, Indonesia (with global impact) Focus: Future-builders, meaningful innovation Start: ASAP Important Note: This is an unpaid internship. We don't cover accommodation, food, visa, or flights. What do we offer? The chance to build skills that don't exist in textbooks,...