Ai Model Evaluator

Há 3 dias

Itupeva, Brasil Bebeeevaluator Tempo inteiro

Immerit seeks detail-oriented and analytically minded analysts to perform highly nuanced evaluations of AI system outputs across different modalities: text, image, video, and multimodal interactions.About the Role:Analysts will assess the accuracy, appropriateness, quality, clarity, and cultural alignment of model outputs against complex guidelines, ensuring that results align with project standards and real-world use cases.Key Responsibilities:Evaluate outputs generated by large language models (LLMs) across multiple modalities (text, image captions, video descriptions, and multimodal prompts).Assess quality against project-specific criteria such as correctness, coherence, completeness, style, cultural appropriateness, and safety.Identify subtle errors, hallucinations, or biases in AI responses.Apply domain expertise and logical reasoning to resolve ambiguous or unclear outputs.Provide detailed written feedback, tagging, and scoring of outputs to ensure consistency across the evaluation team.Escalate unclear cases and contribute to refining evaluation guidelines.Required Skills & Qualifications:Strong critical reading, observational, and evaluative skills across different modalities.Ability to articulate nuanced judgments with precision and clarity.Excellent English comprehension (CEFR B2 or above); additional languages a plus.Familiarity with LLMs, generative AI, and multimodal systems.Strong attention to detail and ability to apply guidelines consistently.Awareness of cultural and linguistic nuances, including potential bias and harm in AI outputs.Please note that moderation of high-harm/high-risk material is not part of this role.Candidates should be aware that occasional exposure to NSFW or otherwise sensitive content may occur due to imperfections in client-provided datasets.Applicants should indicate that they are comfortable working in environments where such incidental exposure is a possibility.

  • Ai Application Architect

    Há 5 dias

    Itupeva, Brasil Bebeeartificial Tempo inteiro

    Job SummaryWe are seeking an accomplished AI Full-Stack Developer to design, develop, and maintain cutting-edge AI applications leveraging existing Large Language Model (LLM) APIs.

  • Ai Learning Material Developer

    Há 3 dias

    Itupeva, Brasil Bebeecontent Tempo inteiro

    We are seeking experienced AI Content Developers to join our project.About the Role:The successful candidates will design and evaluate educational content for advanced language models in STEM, Social Sciences, or Humanities.This involves creating graduate-level tasks, problem sets, and prompts, as well as reviewing and evaluating AI-generated content for...

  • Content Creator

    Há 5 dias

    Itupeva, Brasil Bebeelanguage Tempo inteiro

    As a Language Specialist, you play a critical role in enhancing Large Language Models (LLMs), ensuring their accuracy, fluency, and cultural relevance.You will evaluate linguistic accuracy, coherence, and contextual relevance in AI-generated responses, providing structured feedback to refine AI performance.Your expertise will be instrumental in developing...

  • Medical Writer Subject Matter Expert

    2 semanas atrás

    Itupeva, Brasil Innodata Inc. Tempo inteiro

    Innodata (NASDAQ: INOD) is a leading data engineering company.With more than 2,000 customers and operations in 13 cities around the world, we are an AI technology solutions provider of choice for 4 out of 5 of the world's biggest technology companies, as well as leading companies across financial services, insurance, technology, law, and medicine.By...

  • INSPETOR DE RECEBIMENTO I

    3 semanas atrás

    Itupeva, Brasil Bosch Brasil Tempo inteiro

    Descrição da vaga Auditoria de estoque; Inspeção de recebimento; Inspeção de devolução; Inspeção de sobra; Separar/enviar itens do estoque da qualidade; Inspecionar itens de Shelf Life; Jornada em Segundo Turno! Qualificações Técnico Qualidade, Técnico em Processos, Gestão de qualidade, Técnico; Pacotte office Básico/Intermediário;...

  • INSPETOR DE RECEBIMENTO I

    3 semanas atrás

    Itupeva, Brasil Bosch Brasil Tempo inteiro

    Descrição da vagaAuditoria de estoque; Inspeção de recebimento; Inspeção de devolução; Inspeção de sobra; Separar/enviar itens do estoque da qualidade; Inspecionar itens de Shelf Life; Jornada em Segundo Turno! QualificaçõesTécnico Qualidade, Técnico em Processos, Gestão de qualidade, Técnico; Pacotte office Básico/Intermediário;...

  • inspetor de recebimento i

    1 semana atrás

    Itupeva, Brasil Bosch Brasil Tempo inteiro R$60.000 - R$120.000 por ano

    Na Bosch, moldamos o futuro por meio das inovações tecnológicas de alta qualidade e de serviços que despertam entusiasmo e melhoram a vida das pessoas. Temos uma promessa sólida para nossos colaboradores: crescemos juntos, gostamos do nosso trabalho e inspiramos uns aos outros. Junte-se a nós e sinta a diferença.Descrição da vagaAuditoria de...