Multimodal AI Evaluation Analyst

Há 4 horas

Patos de Minas MG, Brasil iMerit Technology Tempo inteiro

Job Description: Multimodal AI Evaluation Analyst Target Language: English Company: iMerit Scholars Position Type: - Remote; Contract ($5/hour); ~10-40 hours per week Position Overview: iMerit Scholars is rapidly expanding our network of skilled AI Evaluation Analysts to help advance next-generation multimodal AI systems. This opportunity begins with a short paid pilot project (~12 hours total). Successful participants may be invited to continue with ongoing project work (typically 15–40 hours per week), depending on performance and project needs. As a Multimodal AI Evaluation Analyst, you'll perform highly detailed evaluations of AI system outputs across text, image, video, and multimodal prompts. Your feedback will directly influence how leading AI systems understand and interact with the world. Compensation & Work Structure Rate: $5/hour Phase 1: ~12-hour paid pilot project (completed within a few days) Phase 2: Ongoing contract work (typically 15–40 hours/week) for top performers What You'll Do Evaluate and score AI-generated outputs (text, image captions, video descriptions, multimodal prompts) Assess quality, correctness, coherence, style, and cultural alignment Identify subtle issues like hallucinations, logical gaps, or bias Provide detailed written feedback and apply complex evaluation guidelines consistently Collaborate with Quality Leads and Project Managers to ensure reliability and accuracy What You Bring Excellent critical reading and evaluation skills across multiple modalities Strong English comprehension (CEFR B2 or above) Familiarity with LLMs, generative AI, and multimodal systems Exceptional attention to detail and consistency Comfort with iterative feedback, evolving workflows, and nuanced judgments Prior experience in data annotation, AI evaluation, or related work (preferred) Preferred Qualifications BA degree (preferred) or comparable experience Experience working with annotation tools or AI data platforms Understanding of multimodal communication (text-to-image, video narratives, etc.) Comfort with fast-paced projects and evolving quality standards Awareness that incidental exposure to sensitive or NSFW content may occur Why Join iMerit Scholars Help shape how cutting-edge AI systems understand the world Work remotely on projects at the forefront of multimodal AI Gain hands-on experience in applied AI evaluation Collaborate with a global, expert community of AI trainers Next Steps Start by taking the 30-minute skill assessment Qualified applicants will be invited by email to a paid 12-hour pilot project (includes 2 hours paid training) Strong results in the pilot may lead to ongoing, flexible remote work (15–40 hrs/week) with iMerit Scholars.

  • AI Agent Evaluation Analyst

    3 semanas atrás

    Região Geográfica Imediata de Criciúma, Brasil Mindrift Tempo inteiro

    Overview Mindrift connects domain experts with cutting‑edge AI projects, unlocking the potential of GenAI by tapping real‑world expertise from across the globe. Who we’re looking for We seek curious, intellectually proactive contributors who double‑check assumptions, play devil’s advocate, and thrive amid ambiguity and complexity. About the project...

  • AI Research Engineer

    2 semanas atrás

    Região Geográfica Intermediária de Juiz de Fora, Brasil Tether Operations Limited Tempo inteiro

    Join Tether and Shape the Future of Digital Finance At Tether, we’re pioneering a global financial revolution with innovative blockchain solutions that enable seamless, secure, and transparent digital transactions worldwide. About Tether Our product suite includes the trusted stablecoin USDT , energy-efficient Bitcoin mining solutions, advanced data...

  • AI Red Team Engineer

    3 semanas atrás

    Região Geográfica Intermediária de Sorocaba, Brasil LILT AI Tempo inteiro

    AI Red Team Engineer - Brazilian Portuguese 1 day ago Be among the first 25 applicants About LILT AI is changing how the world communicates — and LILT is leading that transformation. We’re on a mission to make the world’s information accessible to everyone, regardless of the language they speak. We use cutting‑edge AI, machine translation, and...

  • New Product Evaluation analyst

    Há 4 dias

    Pouso Alegre, MG, Brasil Midea Group Tempo inteiro

    Job Purpose: The New Product Evaluation analyst is responsible for ensuring the quality, functionality, and compliance of new products and product transfer projects. This role plays a key part in planning and executing test protocols, managing quality issues, and converting customer and regulatory requirements into actionable quality standards. Key...

  • New Product Evaluation Analyst

    Há 2 dias

    Pouso Alegre, MG, Brasil Midea Group Tempo inteiro

    Job Purpose: The New Product Evaluation analyst is responsible for ensuring the quality, functionality, and compliance of new products and product transfer projects. This role plays a key part in planning and executing test protocols, managing quality issues, and converting customer and regulatory requirements into actionable quality standards. Key...

  • AI Team Lead

    Há 4 dias

    Extrema, MG, Brasil International Digital Partners Tempo inteiro

    AI Team Lead (Remote) Our client is looking for an experienced AI Team Lead to spearhead the design and implementation of next-generation AI services within a SaaS environment. This professional will guide a multidisciplinary team to architect and deploy intelligent, data-driven solutions that enhance user experience and deliver real business impact. Your...

  • Talent Technical Assessment Analyst

    3 semanas atrás

    Região Geográfica Intermediária de Juiz de Fora, Brasil BairesDev Tempo inteiro

    Talent Technical Assessment Analyst - Remote Work | REF# Join to apply for the Talent Technical Assessment Analyst - Remote Work | REF# role at BairesDev . At BairesDev®, we’ve been leading the way in technology projects for over 15 years, delivering cutting‑edge solutions to giants like Google and the most innovative startups in Silicon Valley. Our...

  • Senior AI/ML Engineer, Agentic AI

    2 semanas atrás

    Rio de Janeiro, Rio de Janeiro, Brasil Motorola Solutions Tempo inteiro R$120.000 - R$240.000 por ano

    Company OverviewAt Motorola Solutions, we believe that everything starts with our people. We're a global close-knit community, united by the relentless pursuit to help keep people safer everywhere. Our critical communications, video security and command center technologies support public safety agencies and enterprises alike, enabling the coordination that's...

  • Venture Analyst

    2 semanas atrás

    Patos de Minas, Brasil Flow Capital Tempo inteiro

    About Flow CapitalFlow Capital Corp. is a publicly listed provider of flexible growth and alternative capital solutions dedicated to supporting market-leading, high-growth companies. Since ****, we've helped businesses in the US, UK, and Canada access financing that drives growth while minimizing dilution and retaining founder control. Our focus is on...

  • AI Ops Business Analyst: Gems Process Automation

    1 semana atrás

    Rio de Janeiro, Rio de Janeiro, Brasil Motorola Solutions Tempo inteiro R$80.000 - R$120.000 por ano

    Company OverviewAt Motorola Solutions, we believe that everything starts with our people. We're a global close-knit community, united by the relentless pursuit to help keep people safer everywhere. Our critical communications, video security and command center technologies support public safety agencies and enterprises alike, enabling the coordination that's...