QA/Red Teaming Expert

2 semanas atrás

Brasília, Brasil Innodata Inc. Tempo inteiro

Job Description: We are seeking highly analytical and detail-oriented professionals with hands-on experience in Red Teaming, Prompt Evaluation , and AI/LLM Quality Assurance . The ideal candidate will help us rigorously test and evaluate AI-generated content to identify vulnerabilities, assess risks, and ensure compliance with safety, ethical, and quality standards.

Job Title :- Red Teaming, Prompt Evaluation, or AI/LLM Quality Assurance Expert

Key Responsibilities:
Conduct Red Teaming exercises to identify adversarial, harmful, or unsafe outputs from large language models (LLMs).
Evaluate and stress-test AI prompts across multiple domains (e.g., finance, healthcare, security) to uncover potential failure modes.
Develop and apply test cases to assess accuracy, bias, toxicity, hallucinations , and misuse potential in AI-generated responses.
Collaborate with data scientists, safety researchers, and prompt engineers to report risks and suggest mitigations.
Perform manual QA and content validation across model versions, ensuring factual consistency, coherence, and guideline adherence.
Create evaluation frameworks and scoring rubrics for prompt performance and safety compliance.
Document findings, edge cases, and vulnerability reports with high clarity and structure.

Requirements:
Proven experience in AI red teaming , LLM safety testing, or adversarial prompt design.
Familiarity with prompt engineering , NLP tasks, and ethical considerations in generative AI.
Strong background in Quality Assurance , content review, or test case development for AI/ML systems.
Understanding of LLM behaviour's, failure modes, and model evaluation metrics.
Excellent critical thinking, pattern recognition, and analytical writing skills.
Ability to work independently, follow detailed evaluation protocols, and meet tight deadlines.

Preferred Qualifications:
Prior work with teams like Open AI, Anthropic, Google DeepMind, or other LLM safety initiatives.
Experience in risk assessment, red team security testing, or AI policy & governance.
Background in linguistics, psychology, or computational ethics is a plus.

Kindly Attempt the below assessment to proceed further with your application.

  • Content Writer

    2 semanas atrás

    Brasília, Brasil Innodata Inc. Tempo inteiro

    Job Description: We are seeking highly analytical and detail-oriented professionals with hands-on experience in Red Teaming, Prompt Evaluation , and AI/LLM Quality Assurance . The ideal candidate will help us rigorously test and evaluate AI-generated content to identify vulnerabilities, assess risks, and ensure compliance with safety, ethical, and...

  • Cloud Consultant

    3 semanas atrás

    Brasília, Brasil Red Hat Tempo inteiro

    You'll help explain the benefits of Red Hat's cloud solutions and gain a deep understanding of our customers' infrastructures and business needs.As a consultant, you will work closely with customers on a variety of specific initiatives, including the architecture, deployment, troubleshooting, and performance tuning of Red Hat-related cloud and container...

  • Cloud Consultant

    2 semanas atrás

    Brasília, Brasil Red Hat Tempo inteiro

    You'll help explain the benefits of Red Hat's cloud solutions and gain a deep understanding of our customers' infrastructures and business needs.As a consultant, you will work closely with customers on a variety of specific initiatives, including the architecture, deployment, troubleshooting, and performance tuning of Red Hat-related cloud and container...

  • Cloud Consultant

    Há 2 dias

    Brasília, Brasil Red Hat Tempo inteiro

    You'll help explain the benefits of Red Hat's cloud solutions and gain a deep understanding of our customers' infrastructures and business needs.As a consultant, you will work closely with customers on a variety of specific initiatives, including the architecture, deployment, troubleshooting, and performance tuning of Red Hat-related cloud and container...

  • Cloud Consultant

    2 semanas atrás

    Brasília, Brasil Red Hat Tempo inteiro

    You'll help explain the benefits of Red Hat's cloud solutions and gain a deep understanding of our customers' infrastructures and business needs.As a consultant, you will work closely with customers on a variety of specific initiatives, including the architecture, deployment, troubleshooting, and performance tuning of Red Hat-related cloud and...

  • Content Writer

    1 semana atrás

    Brasília, Brasil Innodata Inc. Tempo inteiro

    Job Description:We are seeking highly analytical and detail-oriented professionals with hands-on experience inRed Teaming, Prompt Evaluation, andAI/LLM Quality Assurance. The ideal candidate will help us rigorously test and evaluate AI-generated content to identify vulnerabilities, assess risks, and ensure compliance with safety, ethical, and quality...

  • Content Writer

    1 semana atrás

    Brasília, Brasil Innodata Inc. Tempo inteiro

    Job Description:We are seeking highly analytical and detail-oriented professionals with hands-on experience inRed Teaming, Prompt Evaluation, andAI/LLM Quality Assurance. The ideal candidate will help us rigorously test and evaluate AI-generated content to identify vulnerabilities, assess risks, and ensure compliance with safety, ethical, and quality...

  • Linux Admin Expert

    1 semana atrás

    Brasília, Brasil T-Systems do Brasil Tempo inteiro

    Se você busca uma oportunidade na área de Tecnologia da Informação, tem organização, boa comunicação e vontade de crescer, essa vaga pode ser para você.Responsabilidades & Requisitos Must Have:Sólido conhecimento em Linux Admin (Rocky Linux / Red Hat OS)Kerberos, PAM, Logs, Bash Scripting (SE Linux), rsyslog, LVM, XFSConfigurações de rede...

  • Senior Backend Engineer

    Há 7 dias

    Brasília, Brasil Yuna.Io Tempo inteiro

    Company Description Yuna's mission is to radically transform the way mental health support is accessed and delivered.By providing 24/7 instant and private support at the push of a button, we aim to address the significant gaps in mental health care accessibility.In a system where waiting times for therapists can reach up to 48 days and many people can't even...

  • Linux Admin Expert

    1 semana atrás

    Brasília, Brasil T-Systems Do Brasil Tempo inteiro

    Se você busca uma oportunidade na área de Tecnologia da Informação, tem organização, boa comunicação e vontade de crescer, essa vaga pode ser para você.Responsabilidades & Requisitos Must Have:Sólido conhecimento em Linux Admin (Rocky Linux / Red Hat OS)Kerberos, PAM, Logs, Bash Scripting (SE Linux), rsyslog, LVM, XFSConfigurações de rede...