Multimodal AI Evaluation Specialist

3 semanas atrás

Porto Alegre RS, Brasil beBeeEvaluator Tempo inteiro

Job Opportunity iMerit seeks highly skilled professionals to perform nuanced evaluations of AI system outputs across text, image, video, and multimodal interactions. Key Responsibilities: Evaluate outputs generated by LLMs across multiple modalities (text, image captions, video descriptions, and multimodal prompts). Assess quality against project-specific criteria such as correctness, coherence, completeness, style, cultural appropriateness, and safety. Identify subtle errors, hallucinations, or biases in AI responses. Apply domain expertise and logical reasoning to resolve ambiguous or unclear outputs. Provide detailed written feedback, tagging, and scoring of outputs to ensure consistency across the evaluation team. Escalate unclear cases and contribute to refining evaluation guidelines. Collaborate with Project Managers and Quality Leads to meet accuracy, reliability, and turnaround benchmarks. Requirements: Bachelor's degree/diploma or equivalent educational qualification. 1+ years of experience in data annotation, LLM evaluation, content moderation, or related AI/ML domains. Demonstrated experience working with data annotation tools and software platforms. Strong understanding of language and multimodal communication (instruction following in image generation, fact-checking, narrative coherence in video, etc.). Ability to adapt quickly to changing project directions and fast-paced work environments. Previous experience creating or annotating complex data specifically for Large Language Model (LLM) training. Prior exposure to generative AI, prompt engineering, or LLM fine-tuning workflows is a plus. The Opportunity You will be part of an innovative and supportive global working environment that offers competitive compensation and flexible remote working arrangements. If you're interested in shaping the evaluation standards for next-generation multimodal AI systems, apply now.

  • Multimodal AI Evaluation Specialist

    3 semanas atrás

    Porto Alegre, Brasil beBeeEvaluator Tempo inteiro

    Job Opportunity iMerit seeks highly skilled professionals to perform nuanced evaluations of AI system outputs across text, image, video, and multimodal interactions. Key Responsibilities: Evaluate outputs generated by LLMs across multiple modalities (text, image captions, video descriptions, and multimodal prompts). Assess quality against project-specific...

  • AI Language Evaluation Specialist

    Há 3 dias

    Porto Alegre, RS, Brasil beBeeLinguistic Tempo inteiro

    Our organization is seeking a skilled Language Quality Specialist to join our team. This role involves evaluating AI system outputs across various modalities, including text, images, videos, and multimodal interactions. The ideal candidate will assess the quality of these outputs against specific project criteria such as correctness, coherence, completeness,...

  • Ai Language Evaluation Specialist

    Há 2 dias

    Porto Alegre, Brasil Bebeelinguistic Tempo inteiro

    Our organization is seeking a skilled Language Quality Specialist to join our team.This role involves evaluating AI system outputs across various modalities, including text, images, videos, and multimodal interactions.The ideal candidate will assess the quality of these outputs against specific project criteria such as correctness, coherence, completeness,...

  • Evaluating AI Content Specialist

    Há 6 dias

    Porto Alegre, RS, Brasil beBeeEvaluator Tempo inteiro

    As a Content Evaluator , you will play a crucial role in ensuring the quality and accuracy of AI system outputs. Evaluate LLM responses across various modalities, including text, image captions, video descriptions, and multimodal prompts. Assess outputs based on project-specific criteria, such as correctness, coherence, completeness, style, cultural...

  • Evaluating Ai Content Specialist

    1 semana atrás

    Porto Alegre, Brasil Bebeeevaluator Tempo inteiro

    As a Content Evaluator, you will play a crucial role in ensuring the quality and accuracy of AI system outputs.Evaluate LLM responses across various modalities, including text, image captions, video descriptions, and multimodal prompts.Assess outputs based on project-specific criteria, such as correctness, coherence, completeness, style, cultural...

  • Evaluating AI Content Specialist

    1 semana atrás

    Porto Alegre, Brasil beBeeEvaluator Tempo inteiro

    As a Content Evaluator , you will play a crucial role in ensuring the quality and accuracy of AI system outputs. Evaluate LLM responses across various modalities, including text, image captions, video descriptions, and multimodal prompts. Assess outputs based on project-specific criteria, such as correctness, coherence, completeness, style, cultural...

  • English Language Specialist

    Há 6 horas

    Porto Alegre, Brasil Imerit Technology Tempo inteiro

    iMerit seeks detail‑oriented and analytically minded Multimodal GenAI Evaluation Analysts to perform highly nuanced evaluations of AI system outputs across different modalities: text, image, video, and multimodal interactions. Analysts will assess the accuracy, appropriateness, quality, clarity, and cultural alignment of model outputs against complex...

  • English Language Specialist

    3 semanas atrás

    Porto Alegre, Brasil iMerit Technology Tempo inteiro

    iMerit seeks detail-oriented and analytically minded Multimodal GenAI Evaluation Analysts to perform highly nuanced evaluations of AI system outputs across different modalities: text, image, video, and multimodal interactions. Analysts will assess the accuracy, appropriateness, quality, clarity, and cultural alignment of model outputs against complex...

  • AI Integration Specialist

    3 semanas atrás

    Porto Alegre, RS, Brasil beBeeOrchestration Tempo inteiro

    Job Title: We are seeking a highly skilled AI Integration Specialist to join our team. About the Role: We are looking for an experienced AI Integration Specialist with expertise in designing and integrating Large Language Model (LLM)-driven agents, building modular toolchains, and ensuring seamless orchestration across enterprise-grade research applications....

  • Transformative AI Leader

    3 semanas atrás

    Porto Alegre, RS, Brasil beBeeArtificial Tempo inteiro

    Job Title: Senior AI Engineer We're seeking a skilled and experienced Senior AI Engineer to join our team. With 5+ years of software and AI/ML engineering experience, you will play a key role in designing, implementing, and operationalizing AI-native services that transform the utility sector. This is a unique opportunity for a highly motivated individual to...