Ai Model Evaluator

1 dia atrás


Campinas, Brasil Bebeeevaluator Tempo inteiro

Job Description:Immerit-technology seeks detail-oriented professionals to evaluate AI system outputs across various modalities.Analysts will assess the accuracy, appropriateness, quality, clarity, and cultural alignment of model outputs against complex guidelines, ensuring that results align with project standards and real-world use cases.Evaluate outputs generated by large language models (LLMs) across multiple modalities.Assess quality against project-specific criteria such as correctness, coherence, completeness, style, cultural appropriateness, and safety.Identify subtle errors, hallucinations, or biases in AI responses.Apply domain expertise and logical reasoning to resolve ambiguous or unclear outputs.Provide detailed written feedback, tagging, and scoring of outputs to ensure consistency across the evaluation team.Escalate unclear cases and contribute to refining evaluation guidelines.Collaborate with Project Managers and Quality Leads to meet accuracy, reliability, and turnaround benchmarks.Required Skills and Qualifications:Strong critical reading, observational, and evaluative skills across different modalities.Ability to articulate nuanced judgments with precision and clarity.Excellent English comprehension (CEFR B2 or above); additional languages a plus.Familiarity with LLMs, generative AI, and multimodal systems.Strong attention to detail and ability to apply guidelines consistently.Awareness of cultural and linguistic nuances, including potential bias and harm in AI outputs.Comfort with evolving workflows, rapid feedback cycles, and complex quality frameworks.Benefits:Bachelor's degree/ diploma or equivalent educational qualification.1+ years of experience in data annotation, LLM evaluation, content moderation, or related AI/ML domains.Demonstrated experience working with data annotation tools and software platforms.Strong understanding of language and multimodal communication.Ability to adapt quickly to changing project directions and fast-paced work environments.Previous experience creating or annotating complex data specifically for Large Language Model (LLM) training.Prior exposure to generative AI, prompt engineering, or LLM fine-tuning workflows is a plus.


  • Ai Model Trainer

    Há 3 dias


    Campinas, Brasil Bebeelanguage Tempo inteiro

    Language Specialist OpportunityAs a Language Specialist, you will play a vital role in training and enhancing Large Language Models (LLMs).This entails evaluating prompts, rating AI-generated outputs, and creating high-quality content to refine AI performance.Key Responsibilities:Evaluate prompts and responses generated by AI models for linguistic accuracy...

  • Web Scouter

    Há 22 horas


    Campinas, Brasil Forum Model Management Tempo inteiro

    1 day ago Be among the first 25 applicants Responsabilidades Buscar e identificar novos talentos em redes sociais Analisar perfis e contatar potenciais modelos e atores Requisitos Experiência em busca de talentos online Conhecimento de redes sociais Habilidades de comunicação Benefícios Trabalho home office com flexibilidade de horário - contrato...

  • AI Engineer

    4 semanas atrás


    Campinas, Brasil AgileEngine Tempo inteiro

    Join to apply for the AI Engineer (Senior) ID34931 role at AgileEngine AgileEngine is one of the Inc. 5000 fastest-growing companies in the US and a top-3 ranked dev shop according to Clutch. We create award-winning custom software solutions that help companies across 15+ industries change the lives of millions. If you like a challenging environment...

  • Senior AI Software Engineer

    3 semanas atrás


    Campinas, Brasil Workana Tempo inteiro

    Workana is the largest remote work platform for talents in Latin America. Our new segment, Workana Premium , focuses on matching the most exceptional professionals with leading and innovative companies around the globe. Enjoy competitive compensation, dedicated support, and the flexibility of remote work within a dynamic environment that fosters...


  • Campinas, Brasil CI&T Tempo inteiro

    We are **tech transformation** specialists, we are** CI&T.We combine the disruptive power of Artificial Intelligence with human expertise to support large companies in navigating changes in technology and business. With 30 years of experience, 6,000 workers, offices in 10 countries and talents across 5 continents. We operate in the fields of design,...

  • Ai Engineer

    2 semanas atrás


    Campinas, Brasil Agileengine Tempo inteiro

    4 days ago Be among the first 25 applicantsGet AI-powered advice on this job and more exclusive features.AgileEngine is an Inc. 5000 company that creates award-winning software for Fortune 500 brands and trailblazing startups across 17+ industries.We rank among the leaders in areas like application development and AI/ML, and our people-first culture has...

  • Ai Engineer

    2 semanas atrás


    Campinas, Brasil Nearsure Tempo inteiro

    1 day ago Be among the first 25 applicants Join our close-knit LATAM remote team: Connect through fun activities like coffee breaks, tech talks, and games with your team-mates and management.Say goodbye to micromanagement!We champion autonomy, open communication, and respect for diversity as our core values.?Your well-being matters: Our People Care team is...


  • Campinas, Brasil Instituto De Pesquisas Eldorado Tempo inteiro

    Responsabilidades e atribuições:Atuará na sustentação, evolução e integração de soluções baseadas na plataforma Azure AI Foundry, com foco em inteligência artificial, machine learning e automação de processos em nuvem.Responsável por garantir a escalabilidade, segurança e performance das soluções, além de colaborar com times de dados,...


  • Campinas, Brasil Instituto De Pesquisas ELDORADO Tempo inteiro

    Responsabilidades e atribuições:Atuará na sustentação, evolução e integração de soluções baseadas na plataforma Azure AI Foundry, com foco em inteligência artificial, machine learning e automação de processos em nuvem.Responsável por garantir a escalabilidade, segurança e performance das soluções, além de colaborar com times de dados,...

  • Ai Consultant

    2 semanas atrás


    Campinas, Brasil Agileengine Tempo inteiro

    Join to apply for the AI Consultant (Lead) ID35730 role at AgileEngine3 days ago Be among the first 25 applicantsJoin to apply for the AI Consultant (Lead) ID35730 role at AgileEngineAgileEngine is one of the Inc. 5000 fastest-growing companies in the US and a top-3 ranked dev shop according to Clutch.We create award-winning custom software solutions that...