Language Expert Evaluation Specialist

Há 12 horas


Brasília DF, Brasil beBeeEvaluation Tempo inteiro

Language Expert Evaluation Specialist We seek detail-oriented and analytically minded experts to evaluate AI system outputs across different modalities: text, image, video, and multimodal interactions. Key Responsibilities: Evaluate outputs generated by LLMs across multiple modalities (text, image captions, video descriptions, and multimodal prompts). Assess quality against project-specific criteria such as correctness, coherence, completeness, style, cultural appropriateness, and safety. Identify subtle errors, hallucinations, or biases in AI responses. Apply domain expertise and logical reasoning to resolve ambiguous or unclear outputs. Provide detailed written feedback, tagging, and scoring of outputs to ensure consistency across the evaluation team. Escalate unclear cases and contribute to refining evaluation guidelines. Collaborate with Project Managers and Quality Leads to meet accuracy, reliability, and turnaround benchmarks. Benefits and Qualifications: We require strong analytical skills, attention to detail, and experience working with complex AI systems. A degree in a relevant field and excellent communication skills are also necessary for success in this role. About the Role: This is an exciting opportunity to join our team as a Language Expert Evaluation Specialist. You will work closely with our AI development team to ensure that our models produce high-quality results.



  • Brasília, DF, Brasil iMerit Technology Tempo inteiro

    Job Description: Multimodal AI Evaluation Analyst Target Language: English Company: iMerit Scholars Position Type: - Remote; Contract ($5/hour); ~10-40 hours per week Position Overview: iMerit Scholars is rapidly expanding our network of skilled AI Evaluation Analysts to help advance next-generation multimodal AI systems. This opportunity begins with a short...


  • Brasília, Brasil iMerit Technology Tempo inteiro

    iMerit seeks detail-oriented and analytically minded Multimodal GenAI Evaluation Analysts to perform highly nuanced evaluations of AI system outputs across different modalities: text, image, video, and multimodal interactions. Analysts will assess the accuracy, appropriateness, quality, clarity, and cultural alignment of model outputs against complex...

  • Linguistics Expert

    2 semanas atrás


    Brasília, Brasil Innodata Inc. Tempo inteiro

    Innodata (NASDAQ: INOD) is a leading data engineering company. With more than 2,000 customers and operations in 13 cities around the world, we are an AI technology solutions provider-of-choice for 4 out of 5 of the world’s biggest technology companies, as well as leading companies across financial services, insurance, technology, law, and medicine. By...

  • Expert

    1 dia atrás


    Brasília, Distrito Federal, Brasil Executive Language Training - elt Language Solutions Tempo inteiro R$40.000 - R$50.000 por ano

    20 hours per weekPosition: ExpertCompany Overview:Eltlearn is a leading education and training company. Our mission is to provide high-quality and innovative learning solutions to individuals and organizations worldwide. We are committed to helping our clients achieve their learning and development goals through our customized training programs and...

  • Linguistics expert

    3 semanas atrás


    Brasília, Brasil Innodata Inc. Tempo inteiro

    Innodata (NASDAQ: INOD) is a leading data engineering company. With more than 2,000 customers and operations in 13 cities around the world, we are an AI technology solutions provider-of-choice for 4 out of 5 of the world’s biggest technology companies, as well as leading companies across financial services, insurance, technology, law, and medicine.By...

  • Linguistics Expert

    3 semanas atrás


    Brasília, Brasil Innodata Inc. Tempo inteiro

    Innodata (NASDAQ: INOD) is a leading data engineering company. With more than 2,000 customers and operations in 13 cities around the world, we are an AI technology solutions provider-of-choice for 4 out of 5 of the world’s biggest technology companies, as well as leading companies across financial services, insurance, technology, law, and medicine.By...


  • Brasília, Brasil iMerit Technology Tempo inteiro

    Job Description: Multimodal AI Evaluation AnalystTarget Language:English Company:iMerit Scholars Position Type:- Remote; Contract ($5/hour); ~10-40 hours per week Position Overview: iMerit Scholars is rapidly expanding our network of skilled AI Evaluation Analysts to help advance next-generation multimodal AI systems. This opportunity begins with a short...


  • Brasília, Brasil iMerit Technology Tempo inteiro

    Job Description: Multimodal AI Evaluation AnalystTarget Language:English Company:iMerit Scholars Position Type:- Remote; Contract ($5/hour); ~10-40 hours per week Position Overview: iMerit Scholars is rapidly expanding our network of skilled AI Evaluation Analysts to help advance next-generation multimodal AI systems. This opportunity begins with a short...


  • Brasília, DF, Brasil beBeeDevelopment Tempo inteiro

    Software Development Expert A unique opportunity awaits in our technology consulting company. We're looking for a skilled Java Software Engineer to collaborate with cross-functional teams. Main Responsibilities: Design, develop, and deploy high-quality software solutions using Java programming language Implement front-end technologies such as Angular or...


  • Brasília, Brasil beBeeQuality Tempo inteiro

    Language Quality Assurance Specialist This is an entry-level, fully remote position in our international legal translations division. Collaborate with the Project Management team to clarify project objectives and parameters. Perform quality assurance checks on translated documents. Communicate effectively with vendors worldwide to reconcile errors in...