Multimodal Ai Evaluation Analyst

2 semanas atrás

Cuiabá, Brasil iMerit Technology Tempo inteiro

Job Description: Multimodal AI Evaluation Analyst

Target Language: English

Company: iMerit Scholars

Position Type: - Remote;
Contract ($5/hour);
~10-40 hours per week

Position Overview:

iMerit Scholars is rapidly expanding our network of skilled AI Evaluation Analysts to help advance next-generation multimodal AI systems.

This opportunity begins with a short paid pilot project (~12 hours total). Successful participants may be invited to continue with ongoing project work (typically 15–40 hours per week), depending on performance and project needs.

As a Multimodal AI Evaluation Analyst, you'll perform highly detailed evaluations of AI system outputs across text, image, video, and multimodal prompts. Your feedback will directly influence how leading AI systems understand and interact with the world.

Compensation & Work Structure

- Rate: $5/hour
- Phase 1: ~12-hour paid pilot project (completed within a few days)
- Phase 2: Ongoing contract work (typically 15–40 hours/week) for top performers

What You'll Do

- Evaluate and score AI-generated outputs (text, image captions, video descriptions, multimodal prompts)
- Assess quality, correctness, coherence, style, and cultural alignment
- Identify subtle issues like hallucinations, logical gaps, or bias
- Provide detailed written feedback and apply complex evaluation guidelines consistently
- Collaborate with Quality Leads and Project Managers to ensure reliability and accuracy

What You Bring

- Excellent critical reading and evaluation skills across multiple modalities
- Strong English comprehension (CEFR B2 or above)
- Familiarity with LLMs, generative AI, and multimodal systems
- Exceptional attention to detail and consistency
- Comfort with iterative feedback, evolving workflows, and nuanced judgments
- Prior experience in data annotation, AI evaluation, or related work (preferred)

Preferred Qualifications

- BA degree (preferred) or comparable experience
- Experience working with annotation tools or AI data platforms
- Understanding of multimodal communication (text-to-image, video narratives, etc.)
- Comfort with fast-paced projects and evolving quality standards
- Awareness that incidental exposure to sensitive or NSFW content may occur

Why Join iMerit Scholars

- Help shape how cutting-edge AI systems understand the world
- Work remotely on projects at the forefront of multimodal AI
- Gain hands-on experience in applied AI evaluation
- Collaborate with a global, expert community of AI trainers

Next Steps

- Start by taking the 30-minute skill assessment
- Qualified applicants will be invited by email to a paid 12-hour pilot project (includes 2 hours paid training)
- Strong results in the pilot may lead to ongoing, flexible remote work (15–40 hrs/week) with iMerit Scholars.

  • Senior Ai Engineer

    2 semanas atrás

    Cuiabá, Brasil Velozient Tempo inteiro

    We are seeking a remote, full-time Senior AI Engineer with 5+ years of software and AI/ML engineering experience. Candidates must have a strong background in Python and either Golang, Node.Js, or Java expertise, with a strong desire to adopt Golang as the primary back-end technology. In this position, you will be at the heart of the client's product...

  • Business Systems Analyst

    2 semanas atrás

    Cuiabá, Brasil Onebridge Tempo inteiro

    Onebridge, a Marlabs Company, is a global AI and Data Analytics Consulting Firm that empowers organizations worldwide to drive better outcomes through data and technology. Since 2005, we have partnered with some of the largest healthcare, life sciences, financial services, and government entities across the globe. We have an exciting opportunity for a highly...

  • Content Editor/Author/Writer

    4 semanas atrás

    Cuiabá, Brasil Innodata Inc. Tempo inteiro

    Overview Join to apply for the Content Editor/Author/Writer role at Innodata Inc. The ideal candidate is highly analytical and detail-oriented with hands-on experience in Red Teaming, Prompt Evaluation, and AI/LLM Quality Assurance. The role focuses on testing and evaluating AI-generated content to identify vulnerabilities, assess risks, and ensure safety,...

  • Content Writer

    2 semanas atrás

    Cuiabá, Brasil Innodata Inc. Tempo inteiro

    Job Description: We are seeking highly analytical and detail-oriented professionals with hands-on experience in Red Teaming, Prompt Evaluation, and AI/LLM Quality Assurance. The ideal candidate will help us rigorously test and evaluate AI-generated content to identify vulnerabilities, assess risks, and ensure compliance with safety, ethical, and quality...

  • Senior AI/ML Engineer

    4 semanas atrás

    Cuiabá, Brasil Truelogic Software Tempo inteiro

    Senior AI/ML Engineer - Digital creative agency (Brazil) Join to apply for the Senior AI/ML Engineer - Digital creative agency (Brazil) role at Truelogic Software Senior AI/ML Engineer - Digital creative agency (Brazil) 2 days ago Be among the first 25 applicants Join to apply for the Senior AI/ML Engineer - Digital creative agency (Brazil) role at Truelogic...

  • Talent Acquisition Analyst

    1 semana atrás

    Cuiabá, Brasil BairesDev Tempo inteiro

    Talent Acquisition Analyst - Remote Work Join to apply for the Talent Acquisition Analyst - Remote Work role at BairesDev 1 day ago Be among the first 25 applicants Get AI-powered advice on this job and more exclusive features. At BairesDev®, we've been leading the way in technology projects for over 15 years. We deliver cutting‑edge solutions to giants...

  • Senior Financial Analyst

    2 semanas atrás

    Cuiabá, Brasil Vintti Tempo inteiro

    Location /Hours: Remote (Latin America) ET Working hours: Full Time Salary : 2800 -3500usd Role overview We're looking for a Senior Financial Analyst to be the analytical and creative engine for several founder-led, growth-stage clients. You'll own and uplevel financial models and dashboards, then turn raw numbers into clear, compelling stories that...

  • Linguistics Expert

    2 semanas atrás

    Cuiabá, Brasil Innodata Inc. Tempo inteiro

    Innodata (NASDAQ: INOD) is a leading data engineering company. With more than 2,000 customers and operations in 13 cities around the world, we are an AI technology solutions provider-of-choice for 4 out of 5 of the world's biggest technology companies, as well as leading companies across financial services, insurance, technology, law, and medicine. By...

  • Linguistics Expert

    Há 3 dias

    Cuiabá, Brasil Innodata Inc. Tempo inteiro

    Join to apply for the Linguistics Expert role at Innodata Inc. Innodata (NASDAQ: INOD) is a leading data engineering company. With more than 2,000 customers and operations in 13 cities around the world, we are an AI technology solutions provider‑of‑choice for 4 out of 5 of the world's biggest technology companies, as well as leading companies across...

  • Senior Identity and Access Management

    4 semanas atrás

    Cuiabá, Brasil dLocal Tempo inteiro

    Senior Identity and Access Management (IAM) Analyst / Engineer Join to apply for the Senior Identity and Access Management (IAM) Analyst / Engineer role at dLocal Why dLocal? dLocal enables the biggest companies to collect payments in 40 countries. Global brands rely on us to increase conversion and simplify expansion into emerging markets. Join a global...