Multimodal AI Evaluation Analyst
Há 4 horas
Job Description: Multimodal AI Evaluation Analyst Target Language: English Company: iMerit Scholars Position Type: - Remote; Contract ($5/hour); ~10-40 hours per week Position Overview: iMerit Scholars is rapidly expanding our network of skilled AI Evaluation Analysts to help advance next-generation multimodal AI systems. This opportunity begins with a short paid pilot project (~12 hours total). Successful participants may be invited to continue with ongoing project work (typically 15–40 hours per week), depending on performance and project needs. As a Multimodal AI Evaluation Analyst, you’ll perform highly detailed evaluations of AI system outputs across text, image, video, and multimodal prompts. Your feedback will directly influence how leading AI systems understand and interact with the world. Compensation & Work Structure Rate: $5/hour Phase 1: ~12-hour paid pilot project (completed within a few days) Phase 2: Ongoing contract work (typically 15–40 hours/week) for top performers What You’ll Do Evaluate and score AI-generated outputs (text, image captions, video descriptions, multimodal prompts) Assess quality, correctness, coherence, style, and cultural alignment Identify subtle issues like hallucinations, logical gaps, or bias Provide detailed written feedback and apply complex evaluation guidelines consistently Collaborate with Quality Leads and Project Managers to ensure reliability and accuracy What You Bring Excellent critical reading and evaluation skills across multiple modalities Strong English comprehension (CEFR B2 or above) Familiarity with LLMs, generative AI, and multimodal systems Exceptional attention to detail and consistency Comfort with iterative feedback, evolving workflows, and nuanced judgments Prior experience in data annotation, AI evaluation, or related work (preferred) Preferred Qualifications BA degree (preferred) or comparable experience Experience working with annotation tools or AI data platforms Understanding of multimodal communication (text-to-image, video narratives, etc.) Comfort with fast-paced projects and evolving quality standards Awareness that incidental exposure to sensitive or NSFW content may occur Why Join iMerit Scholars Help shape how cutting-edge AI systems understand the world Work remotely on projects at the forefront of multimodal AI Gain hands-on experience in applied AI evaluation Collaborate with a global, expert community of AI trainers Next Steps Start by taking the 30-minute skill assessment Qualified applicants will be invited by email to a paid 12-hour pilot project (includes 2 hours paid training) Strong results in the pilot may lead to ongoing, flexible remote work (15–40 hrs/week) with iMerit Scholars.
-
English Language Specialist
3 semanas atrás
Brazil iMerit Technology Tempo inteiroiMerit seeks detail-oriented and analytically minded Multimodal GenAI Evaluation Analysts to perform highly nuanced evaluations of AI system outputs across different modalities: text, image, video, and multimodal interactions. Analysts will assess the accuracy, appropriateness, quality, clarity, and cultural alignment of model outputs against complex...
-
English Language Specialist
3 semanas atrás
Brazil iMerit Technology Tempo inteiroiMerit seeks detail-oriented and analytically minded Multimodal GenAI Evaluation Analysts to perform highly nuanced evaluations of AI system outputs across different modalities: text, image, video, and multimodal interactions. Analysts will assess the accuracy, appropriateness, quality, clarity, and cultural alignment of model outputs against complex...
-
Machine Learning Engineer
3 semanas atrás
Brazil RealQuant Tempo inteiroAbout RealQuantRealQuant is building the first vertical AI platform for commercial real estate — turning OMs, rent rolls, and financials into structured insights that power underwriting, reporting, and portfolio intelligence.We’re redefining how deals move from OM → LOI in under 30 minutes by combining institutional real estate expertise with modern AI...
-
Machine Learning Engineer
3 semanas atrás
Brazil RealQuant Tempo inteiroAbout RealQuant RealQuant is building the first vertical AI platform for commercial real estate — turning OMs, rent rolls, and financials into structured insights that power underwriting, reporting, and portfolio intelligence. We’re redefining how deals move from OM → LOI in under 30 minutes by combining institutional real estate expertise with modern...
-
AI Ops Business Analyst: Automation
1 dia atrás
Brazil Remote Work Motorola Solutions Tempo inteiro R$80.000 - R$120.000 por anoCompany OverviewAt Motorola Solutions, we believe that everything starts with our people. We're a global close-knit community, united by the relentless pursuit to help keep people safer everywhere. Our critical communications, video security and command center technologies support public safety agencies and enterprises alike, enabling the coordination...
-
AI Ops Business Analyst: Gems
Há 7 dias
Brazil Remote Work Motorola Solutions Tempo inteiro R$60.000 - R$120.000 por anoCompany OverviewAt Motorola Solutions, we believe that everything starts with our people. We're a global close-knit community, united by the relentless pursuit to help keep people safer everywhere. Our critical communications, video security and command center technologies support public safety agencies and enterprises alike, enabling the coordination...
-
Senior AI/ML Engineer, Agentic AI
2 semanas atrás
Brazil Remote Work Motorola Solutions Tempo inteiro R$80.000 - R$200.000 por anoCompany OverviewAt Motorola Solutions, we believe that everything starts with our people. We're a global close-knit community, united by the relentless pursuit to help keep people safer everywhere. Our critical communications, video security and command center technologies support public safety agencies and enterprises alike, enabling the coordination...
-
AI Team Lead
Há 4 dias
Brazil International Digital Partners Tempo inteiroAI Team Lead (Remote) Our client is looking for an experienced AI Team Lead to spearhead the design and implementation of next-generation AI services within a SaaS environment. This professional will guide a multidisciplinary team to architect and deploy intelligent, data-driven solutions that enhance user experience and deliver real business impact. Your...
-
Business Analyst
4 semanas atrás
Brazil Turing Tempo inteiroAbout the Role:We’re hiring a Lead Analyst / Content Team Lead to manage and mentor a team of analysts creating business-focused content to improve AI models with no AI experience required. You’ll combine leadership, quality oversight, and subject expertise in MBA-relevant domains to ensure outputs are accurate, logically sound, and aligned with project...
-
Business Analyst
4 semanas atrás
Brazil Turing Tempo inteiroAbout the Role: We’re hiring a Lead Analyst / Content Team Lead to manage and mentor a team of analysts creating business-focused content to improve AI models with no AI experience required. You’ll combine leadership, quality oversight, and subject expertise in MBA-relevant domains to ensure outputs are accurate, logically sound, and aligned with project...
