Language Evaluation Expert

Há 2 dias


Manaus, Brasil Bebeeevaluator Tempo inteiro

Job DescriptioniMerit seeks detail-oriented and analytically minded professionals to evaluate AI system outputs across different modalities.Analysts will assess the accuracy, appropriateness, quality, clarity, and cultural alignment of model outputs against complex guidelines, ensuring that results align with project standards and real-world use cases.Evaluate AI outputs across multiple modalities.Assess quality against project-specific criteria such as correctness, coherence, completeness, style, cultural appropriateness, and safety.Identify subtle errors, hallucinations, or biases in AI responses.Apply domain expertise and logical reasoning to resolve ambiguous or unclear outputs.Provide detailed feedback, tagging, and scoring of outputs to ensure consistency.Escalate unclear cases and contribute to refining evaluation guidelines.Required Skills & QualificationsCritical reading, observational, and evaluative skills.Ability to articulate nuanced judgments with precision and clarity.Strong English comprehension (CEFR B2 or above).Familiarity with Large Language Models (LLMs), generative AI, and multimodal systems.Attention to detail and ability to apply guidelines consistently.Awareness of cultural and linguistic nuances.RequirementsBachelor's degree or equivalent qualification.1+ years of experience in data annotation, LLM evaluation, content moderation, or related AI/ML domains.Demonstrated experience working with data annotation tools and software platforms.Understanding of language and multimodal communication.


  • Language Expert

    Há 2 dias


    Manaus, Brasil Bebeelinguistic Tempo inteiro

    As a specialist in linguistic expertise, you will play a vital role in refining the accuracy, fluency, and cultural relevance of large language models used by global leaders.About the Role:We are seeking highly skilled linguists to contribute to the training and enhancement of large language models.You will evaluate prompts, rate AI-generated outputs, and...


  • Manaus, Brasil Innodata Inc. Tempo inteiro

    About the role: We are seeking a highly analytical and detail-oriented Thai linguist to support AI training initiatives and linguistic content creation. This role is ideal for someone with a strong academic background in linguistics (syntax, semantics, pragmatics, morphology, phonology, sociolinguistics, etc.) and a passion for language, technology, and...


  • Manaus, Brasil buscojobs Brasil Tempo inteiro

    Overview Job Title : Engineering & Computer Science Subject Matter Expert – AI Training & Content Development About Innodata : Innodata (NASDAQ: INOD) is a global leader in data engineering and AI-powered solutions, partnering with 4 of the world’s top 5 technology companies and serving over 2,000 enterprise clients worldwide. With a workforce of...


  • Manaus, Brasil Bebeefullstack Tempo inteiro

    Job Overview:We're looking for a highly skilled and innovative Full-Stack Engineer with a strong background in AI to join our team.As an expert in building and maintaining AI applications on top of existing Large Language Model (LLM) APIs, you will play a key role in developing and optimizing our AI solutions.Duties and Responsibilities:Design, develop, and...

  • Linguist

    Há 6 dias


    Manaus, Brasil Innodata Inc. Tempo inteiro

    Innodata (NASDAQ: INOD) is a leading data engineering company. With more than 2,000 customers and operations in 13 cities around the world, we are an AI technology solutions provider-of-choice for 4 out of 5 of the world’s biggest technology companies, as well as leading companies across financial services, insurance, technology, law, and medicine. By...

  • AI Trainer

    2 semanas atrás


    Manaus, Brasil Mindrift Tempo inteiro

    AI Trainer - Python Engineer, Agent Evaluation & Tooling (MCP) At Mindrift, innovation meets opportunity. We believe in using the power of collective human intelligence to ethically shape the future of AI. The Mindrift platform, launched and powered by Toloka, connects domain experts with cutting-edge AI projects from innovative tech clients. Our mission is...


  • Manaus, Brasil Innodata Inc. Tempo inteiro

    2 days ago Be among the first 25 applicants Innodata (NASDAQ: INOD) is a leading data engineering company. With more than 2,000 customers and operations in 13 cities around the world, we are an AI technology solutions provider of choice for 4 out of 5 of the world's biggest technology companies, as well as leading companies across financial services,...


  • Manaus, Brasil Bebeeacademic Tempo inteiro

    Role OverviewWe are seeking highly qualified professionals to join a cutting-edge project focused on AI learning and academic content development.In this role, you'll utilize your expertise in STEM, Social Sciences, or Humanities to design, evaluate, and review educational materials that help train and refine advanced AI language models.Your insights will...


  • Manaus, AM, Brasil Innodata Inc. Tempo inteiro

    Innodata (NASDAQ: INOD) is a leading data engineering company. With more than 2,000 customers and operations in 13 cities around the world, we are an AI technology solutions provider of choice for 4 out of 5 of the world’s biggest technology companies, as well as leading companies across financial services, insurance, technology, law, and medicine. By...

  • Ai Data Analyst

    1 semana atrás


    Manaus, Brasil Bebeeanalytical Tempo inteiro

    Job Title:Statistics SpecialistAbout the Role:Innodata is a leading data engineering company with global operations.Our team combines advanced machine learning and AI technologies with subject matter expertise to deliver high-quality platforms.We are working on the next generation of generative AI and large language models for top tech companies.The ideal...