Qa/Red Teaming Expert

1 semana atrás

Aparecida de Goiânia, Brasil Innodata Inc. Tempo inteiro

Job Description:
We are seeking highly analytical and detail-oriented professionals with hands-on experience inRed Teaming, Prompt Evaluation, andAI/LLM Quality Assurance.
The ideal candidate will help us rigorously test and evaluate AI-generated content to identify vulnerabilities, assess risks, and ensure compliance with safety, ethical, and quality standards.
Job Title :- Red Teaming, Prompt Evaluation, or AI/LLM Quality Assurance Expert
Key Responsibilities:
ConductRed Teaming exercisesto identify adversarial, harmful, or unsafe outputs from large language models (LLMs).
Evaluate and stress-test AI prompts across multiple domains (e.g., finance, healthcare, security) to uncover potential failure modes.
Develop and apply test cases to assessaccuracy, bias, toxicity, hallucinations, and misuse potential in AI-generated responses.
Collaborate with data scientists, safety researchers, and prompt engineers to report risks and suggest mitigations.
Performmanual QAand content validation across model versions, ensuring factual consistency, coherence, and guideline adherence.
Create evaluation frameworks and scoring rubrics for prompt performance and safety compliance.
Document findings, edge cases, and vulnerability reports with high clarity and structure.
Requirements:
Proven experience inAI red teaming, LLM safety testing, or adversarial prompt design.
Familiarity withprompt engineering, NLP tasks, and ethical considerations in generative AI.
Strong background inQuality Assurance, content review, or test case development for AI/ML systems.
Understanding of LLM behaviour's, failure modes, and model evaluation metrics.
Excellent critical thinking, pattern recognition, and analytical writing skills.
Ability to work independently, follow detailed evaluation protocols, and meet tight deadlines.
Preferred Qualifications:
Prior work with teams like Open AI, Anthropic, Google DeepMind, or other LLM safety initiatives.
Experience in risk assessment, red team security testing, or AI policy & governance.
Background in linguistics, psychology, or computational ethics is a plus.
Kindly Attempt the below assessment to proceed further with your application.
?
enc=oUTZVsr/Pnz/0Xygc2EK32MdtinqnjC9vy8RU3Ha4EMfQdYWF8n1oAiUtOZXMcKhhhsYYecqmKWja8eKXV801gezikielezikiel

  • Senior Solution Architect

    3 semanas atrás

    Goiânia, Brasil Red Hat Tempo inteiro

    Join to apply for the Senior Solution Architect role at Red Hat The Red Hat Solutions Architect team is looking for a Senior Solutions Architect to join our LATAM team. In this role, you will become a subject matter expert for Red Hat's solutions, understand our customers' technology, people, and processes, and recommend open source solutions that solve...

  • Designated Support Engineer- Openshift

    Há 2 dias

    Região Geográfica Imediata de Criciúma, Brasil Red Hat Tempo inteiro

    Get AI-powered advice on this job and more exclusive features. Overview The Red Hat Customer Experience and Engagement (CEE) team is looking for an experienced engineer to join our Solutions Support team in Colombia. In this role, you will become an expert in Red Hat’s offerings and technologies, like Red Hat OpenShift, Red Hat Enterprise Linux (RHEL), and...

  • Content Writer

    1 semana atrás

    Rio De Janeiro, Brasil Innodata Inc. Tempo inteiro

    Job Description: We are seeking highly analytical and detail-oriented professionals with hands-on experience in Red Teaming, Prompt Evaluation , and AI/LLM Quality Assurance . The ideal candidate will help us rigorously test and evaluate AI-generated content to identify vulnerabilities, assess risks, and ensure compliance with safety, ethical, and quality...

  • Freelance AI Red Team Engineer

    Há 7 dias

    Rio de Janeiro, Rio de Janeiro, Brasil Mindrift Tempo inteiro R$30.000 - R$60.000 por ano

    This opportunity is only for candidates currently residing in the specified country. Your location may affect eligibility and rates. Please submit your resume in English and indicate your level of English proficiency.At Mindrift, innovation meets opportunity. We believe in using the power of collective intelligence to ethically shape the future of AI.What...

  • Freelance AI Red Team Engineer

    Há 7 dias

    Rio de Janeiro, Rio de Janeiro, Brasil Mindrift Tempo inteiro R$30.000 - R$60.000 por ano

    This opportunity is only for candidates currently residing in the specified country. Your location may affect eligibility and rates. Please submit your resume in English and indicate your level of English proficiency.At Mindrift, innovation meets opportunity. We believe in using the power of collective intelligence to ethically shape the future of AI.What...

  • QA Automation Lead

    3 semanas atrás

    Rio de Janeiro, Brasil Applaudo Tempo inteiro

    6 days ago Be among the first 25 applicants Get AI-powered advice on this job and more exclusive features. We are looking for an experienced QA Automation Lead with a keen eye for detail to design testing procedures and automation strategies for our customer’s software applications. This is a temporary opportunity. You bring to Applaudo the following...

  • Sr Cloud Expert

    2 semanas atrás

    Santana de Parnaíba, Brasil Logicalis Tempo inteiro

    Job DescriptionEstamos em busca de um(a) Especialista em Red Hat e VMware com forte atuação em ambientes de Cloud e DevOps.O profissional será responsável por implementar, suportar e automatizar soluções baseadas em Red Hat e VMware, integrando ambientes on-premises e em nuvem pública (AWS).Atuará em projetos estratégicos de transformação digital,...

  • Programa De Aprendizagem Industrial 2026

    Há 6 dias

    Santo Antônio de Posse, Brasil Expert Consultoria Tempo inteiro

    Expert Consultoria em parceria com empresa JOHN DEERE contrata para o PROGRAMA DE APRENDIZAGEM INDUSTRIAL 2026-QUALIDADE Requisitos:Ensino Médio Completo.Ser maior de 18 anos e na finalização do curso deverá ter no máximo 23 anos e 11 meses.Será obrigatório a realização da prova no SENAI em 26/10/2025 (das 8h às 11h).Atividades:Meio período na...

  • QA Automation

    Há 3 dias

    Rio de Janeiro, Brasil Qualitá RH Tempo inteiro

    **Nível**: Analista **Cursos de**: ADM com enfase em Tecnologia da Informação **Escolaridade**: Graduação - Completo **Tipo de contrato**: PJ **Jornada de trabalho**: Full Remote Work Disponibilidade para home-office **Responsabilidades e Experiências desejáveis**: Description Applied Blockchain is a leading edge web3 software development...

  • QA Automation

    4 semanas atrás

    Rio de Janeiro, Rio de Janeiro, Brasil Qualitá RH Tempo inteiro

    **Nível**: Analista**Cursos de**: ADM com enfase em Tecnologia da Informação**Escolaridade**: Graduação - Completo**Tipo de contrato**: PJ**Jornada de trabalho**: Full Remote WorkDisponibilidade para home-office**Responsabilidades e Experiências desejáveis**: DescriptionApplied Blockchain is a leading edge web3 software development company. Based in...