Multimodal AI Evaluation Analyst

Há 5 dias

Amazonas, Brasil iMerit Technology Tempo inteiro

Job Description: Multimodal AI Evaluation Analyst Target Language: English Company: iMerit Scholars Position Type: - Remote; Contract ($5/hour); ~10-40 hours per week Position Overview: iMerit Scholars is rapidly expanding our network of skilled AI Evaluation Analysts to help advance next-generation multimodal AI systems. This opportunity begins with a short paid pilot project (~12 hours total). Successful participants may be invited to continue with ongoing project work (typically 15–40 hours per week), depending on performance and project needs. As a Multimodal AI Evaluation Analyst, you'll perform highly detailed evaluations of AI system outputs across text, image, video, and multimodal prompts. Your feedback will directly influence how leading AI systems understand and interact with the world. Compensation & Work Structure Rate: $5/hour Phase 1: ~12-hour paid pilot project (completed within a few days) Phase 2: Ongoing contract work (typically 15–40 hours/week) for top performers What You'll Do Evaluate and score AI-generated outputs (text, image captions, video descriptions, multimodal prompts) Assess quality, correctness, coherence, style, and cultural alignment Identify subtle issues like hallucinations, logical gaps, or bias Provide detailed written feedback and apply complex evaluation guidelines consistently Collaborate with Quality Leads and Project Managers to ensure reliability and accuracy What You Bring Excellent critical reading and evaluation skills across multiple modalities Strong English comprehension (CEFR B2 or above) Familiarity with LLMs, generative AI, and multimodal systems Exceptional attention to detail and consistency Comfort with iterative feedback, evolving workflows, and nuanced judgments Prior experience in data annotation, AI evaluation, or related work (preferred) Preferred Qualifications BA degree (preferred) or comparable experience Experience working with annotation tools or AI data platforms Understanding of multimodal communication (text-to-image, video narratives, etc.) Comfort with fast-paced projects and evolving quality standards Awareness that incidental exposure to sensitive or NSFW content may occur Why Join iMerit Scholars Help shape how cutting-edge AI systems understand the world Work remotely on projects at the forefront of multimodal AI Gain hands-on experience in applied AI evaluation Collaborate with a global, expert community of AI trainers Next Steps Start by taking the 30-minute skill assessment Qualified applicants will be invited by email to a paid 12-hour pilot project (includes 2 hours paid training) Strong results in the pilot may lead to ongoing, flexible remote work (15–40 hrs/week) with iMerit Scholars.

  • Business Systems Analyst

    1 semana atrás

    Amazonas, Brasil Onebridge Tempo inteiro

    Onebridge, a Marlabs Company, is a global AI and Data Analytics Consulting Firm that empowers organizations worldwide to drive better outcomes through data and technology. Since 2005, we have partnered with some of the largest healthcare, life sciences, financial services, and government entities across the globe. We have an exciting opportunity for a highly...

  • Business Analyst

    1 semana atrás

    Amazonas, Brasil Turing Tempo inteiro

    Role Overview: We're seeking detail-oriented candidates with strong analytical and English comprehension skills. You'll read, summarize, and analyze complex content, validate claims through online research, and collaborate with Large Language Models (LLMs) to improve their performance. Your work will directly contribute to refining cutting-edge AI systems...

  • Business Analyst

    1 dia atrás

    Amazonas, Brasil Turing Tempo inteiro

    Role Overview: We're seeking detail-oriented candidates with strong analytical and English comprehension skills. You'll read, summarize, and analyze complex content, validate claims through online research, and collaborate with Large Language Models (LLMs) to improve their performance. Your work will directly contribute to refining cutting-edge AI systems...

  • Language Specialist

    2 semanas atrás

    Amazonas, Brasil Innodata Inc. Tempo inteiro

    Innodata (NASDAQ: INOD) is a leading data engineering company. With more than 2,000 customers and operations in 13 cities around the world, we are an AI technology solutions provider-of-choice for 4 out of 5 of the world's biggest technology companies, as well as leading companies across financial services, insurance, technology, law, and medicine. By...

  • Junior+/middle Product Analyst

    2 semanas atrás

    Amazonas, Brasil Xsolla Tempo inteiro

    **ABOUT US** At Xsolla, we believe that great games begin as ideas, driven by the curiosity, dedication, and grit of creators around the world. Our mission is to empower these visionaries by providing the support and resources they need to bring their games to life. We are committed to leveling the playing field, ensuring that every creator has the...

  • Senior Product Analyst

    1 semana atrás

    Amazonas, Brasil Social Discovery Group Tempo inteiro

    **SDG invests in IT startups around the world.** Our investments include Open AI, Patreon, Flo, Clubhouse, Woebot, Flure, Astry, Coursera, Academia.edu, and many others. We bring together a team of like-minded people and IT professionals specializing in the creation and development of globally impactful social discovery products. Our international team of...

  • Linguistics Expert

    1 semana atrás

    Amazonas, Brasil Innodata Inc. Tempo inteiro

    Innodata (NASDAQ: INOD) is a leading data engineering company. With more than 2,000 customers and operations in 13 cities around the world, we are an AI technology solutions provider-of-choice for 4 out of 5 of the world's biggest technology companies, as well as leading companies across financial services, insurance, technology, law, and medicine. By...

  • Marketing Analyst

    2 semanas atrás

    Amazonas, Brasil Social Discovery Group Tempo inteiro

    **SDG invests in IT startups around the world.** Our investments include Open AI, Patreon, Flo, Clubhouse, Woebot, Flure, Astry, Coursera, Academia.edu, and many others. We bring together a team of like-minded people and IT professionals specializing in the creation and development of globally impactful social discovery products. Our international team of...

  • Linguist

    2 semanas atrás

    Amazonas, Brasil Innodata Inc. Tempo inteiro

    Innodata (NASDAQ: INOD) is a leading data engineering company. With more than 2,000 customers and operations in 13 cities around the world, we are an AI technology solutions provider-of-choice for 4 out of 5 of the world's biggest technology companies, as well as leading companies across financial services, insurance, technology, law, and medicine. By...

  • Senior Solution Architect

    1 dia atrás

    Amazonas, Brasil GreatPeople.Tech Tempo inteiro

    GreatPeople.Tech is helping a client to hire a remote Senior Solution Architect (Java and Angular) who must be located in Brazil. About our Client They are a revolutionary insurance technology company (aka InsurTech) committed to enabling agencies & brokers grow in the digital age. They are building scalable, intelligent platforms using modern full stack...