Multimodal Ai Evaluation Specialist

Há 21 horas


Divinópolis, Brasil Bebeeevaluation Tempo inteiro

We are seeking a highly skilled Multimodal AI Evaluation Specialist to join our team.About the Role:This is an exciting opportunity to work with cutting-edge AI technology and contribute to the development of accurate and reliable models.As a Multimodal AI Evaluation Specialist, you will play a crucial role in evaluating the performance of AI systems across various modalities, including text, image, video, and multimodal interactions.Key Responsibilities:Evaluate Large Language Models (LLMs) across multiple modalities: text, image captions, video descriptions, and multimodal prompts.Assess quality against project-specific criteria: correctness, coherence, completeness, style, cultural appropriateness, and safety.Identify subtle errors, hallucinations, or biases in AI responses.Apply domain expertise to resolve ambiguous or unclear outputs.Provide detailed written feedback, tagging, and scoring of outputs for consistency.Escalate unclear cases and contribute to refining evaluation guidelines.Required Skills & Qualifications:Critical reading, observational, and evaluative skills across different modalities.Nuanced judgment articulation with precision and clarity.Excellent English comprehension (CEFR B2 or above); additional languages a plus.Familiarity with LLMs, generative AI, and multimodal systems.Strong attention to detail and ability to apply guidelines consistently.Awareness of cultural and linguistic nuances, including potential bias and harm in AI outputs.What We Offer:Ongoing training and professional development opportunities.A dynamic and collaborative work environment.The chance to work on high-impact projects that make a real difference.



  • Divinópolis, Brasil Bebeelinguistics Tempo inteiro

    In this key role, you will work as a critical member of our content development team to enhance the quality and relevance of AI-generated responses.Key responsibilities include evaluating the accuracy and contextual fit of these responses, ensuring they meet the highest standards of linguistic precision.You will contribute to the creation of high-quality...


  • Divinópolis, Brasil Bebeeleadership Tempo inteiro

    Lead Business Analyst/Content Specialist RoleAbout the Opportunity:Join our team as a Lead Business Analyst / Content Specialist to oversee and mentor a group of analysts responsible for developing business-focused content.No prior AI experience is necessary, but you'll utilize your leadership skills and subject matter expertise in relevant domains to ensure...


  • Divinópolis, Brasil Bebeeartificialintelligence Tempo inteiro

    Senior AI Engineer PositionWe are seeking a seasoned Senior AI Engineer to spearhead the development and deployment of cutting-edge GenAI systems.Design, implement, and scale GenAI infrastructure with a focus on distributed training and inference optimization.Develop high-quality, production-grade code utilizing modern software engineering practices (SOLID,...


  • Divinópolis, Brasil Bebeecompliance Tempo inteiro

    Job Summary:This position is responsible for ensuring the compliance of financial applications with IT policies and evaluating SOC reports to identify potential risks.Key Responsibilities:Compliance Management: Ensure that JDE, Trintech and other financial applications adhere to IT Policy guidelines.SOC Report Evaluation: Evaluate Security Operation Center...


  • Divinópolis, Brasil Bebeecompliance Tempo inteiro

    Job Overview:We are seeking a Compliance Specialist to lead our organization's SOC 2 compliance efforts.This role requires expertise in SaaS environments and proficiency in using compliance management platforms.This position involves streamlining evidence collection, ensuring continuous monitoring, and supporting security and compliance programs to meet...