QA/Red Teaming Expert

1 semana atrás

Recife, Brasil Innodata Inc. Tempo inteiro

Job Description:

We are seeking highly analytical and detail-oriented professionals with hands-on experience in Red Teaming, Prompt Evaluation, and AI/LLM Quality Assurance. The ideal candidate will help us rigorously test and evaluate AI-generated content to identify vulnerabilities, assess risks, and ensure compliance with safety, ethical, and quality standards.

Job Title :- Red Teaming, Prompt Evaluation, or AI/LLM Quality Assurance Expert

Key Responsibilities:

- Conduct Red Teaming exercises to identify adversarial, harmful, or unsafe outputs from large language models (LLMs).
- Evaluate and stress-test AI prompts across multiple domains (e.g., finance, healthcare, security) to uncover potential failure modes.
- Develop and apply test cases to assess accuracy, bias, toxicity, hallucinations, and misuse potential in AI-generated responses.
- Collaborate with data scientists, safety researchers, and prompt engineers to report risks and suggest mitigations.
- Perform manual QA and content validation across model versions, ensuring factual consistency, coherence, and guideline adherence.
- Create evaluation frameworks and scoring rubrics for prompt performance and safety compliance.
- Document findings, edge cases, and vulnerability reports with high clarity and structure.

Requirements:

- Proven experience in AI red teaming, LLM safety testing, or adversarial prompt design.
- Familiarity with prompt engineering, NLP tasks, and ethical considerations in generative AI.
- Strong background in Quality Assurance, content review, or test case development for AI/ML systems.
- Understanding of LLM behaviour's, failure modes, and model evaluation metrics.
- Excellent critical thinking, pattern recognition, and analytical writing skills.
- Ability to work independently, follow detailed evaluation protocols, and meet tight deadlines.

Preferred Qualifications:

- Prior work with teams like Open AI, Anthropic, Google DeepMind, or other LLM safety initiatives.
- Experience in risk assessment, red team security testing, or AI policy & governance.

Background in linguistics, psychology, or computational ethics is a plus.

Kindly Attempt the below assessment to proceed further with your application.

- https://icap.innodata.com/registerfreelancer?enc=oUTZVsr/Pnz/0Xygc2EK32MdtinqnjC9vy8RU3Ha4EMfQdYWF8n1oAiUtOZXMcKhhhsYYecqmKWja8eKXV801gezikielezikiel

  • Ai Security Specialist

    Há 4 dias

    Recife, Brasil Bebeeredteamer Tempo inteiro

    Job Title: Expert in AI Safety and Quality AssuranceAbout the RoleWe are seeking highly analytical and detail-oriented professionals with hands-on experience in Red Teaming, Prompt Evaluation, and AI/LLM Quality Assurance.The ideal candidate will help us rigorously test and evaluate AI-generated content to identify vulnerabilities, assess risks, and ensure...

  • QA/qc Manager

    2 semanas atrás

    Recife, Brasil Kokku Tempo inteiro

    The QA/QC Manager will work closely with the QA/QC, development, and production teams to achieve the highest quality in our games. Being a part of Kokku means being able to work with comittment to excelence. As a result, we put our talents and efforts on making games better. In addition, only at Kokku you will have the opportunity to work with great IPs and...

  • QA/qc Manager

    2 semanas atrás

    Recife, Brasil Kokku Tempo inteiro

    The QA/QC Manager will work closely with the QA/QC, development, and production teams to achieve the highest quality in our games.Being a part of Kokku means being able to work with comittment to excelence. As a result, we put our talents and efforts on making games better. In addition, only at Kokku you will have the opportunity to work with great IPs and...

  • QA Tester

    4 semanas atrás

    Recife, Pernambuco, Brasil Kokku Games Tempo inteiro

    We are seeking passionate people to join our team as QA Tester. In this role, you'll play a vital part in evaluating project quality through manual or automated testing, while also contributing to plans for preventing future failures during production. Join us in uncovering bugs, defining criteria, and elevating quality levels across Art, Gameplay, and...

  • Technical Expert for Scalable Software Solutions

    3 semanas atrás

    Recife, Brasil beBeeSoftwareExpert Tempo inteiro

    We are seeking a skilled technical expert to join our team. Job Overview: The ideal candidate will have a strong background in software development, with experience in Java and React Native. This role involves designing, developing, and maintaining scalable full stack applications using the latest technologies. Key Responsibilities: Develop and maintain...

  • QA Tester

    1 dia atrás

    Recife, Brasil Kokku Games Tempo inteiro

    We are seeking passionate people to join our team as QA Tester. In this role, you'll play a vital part in evaluating project quality through manual or automated testing, while also contributing to plans for preventing future failures during production. Join us in uncovering bugs, defining criteria, and elevating quality levels across Art, Gameplay, and...

  • Functionality QA Analyst

    2 semanas atrás

    Recife, Brasil Kokku Games Tempo inteiro

    We are seeking passionate people to join our team as Functionality Quality Assurance Analysts. In this role, you'll play a vital part in evaluating project quality through manual or automated testing, while also contributing to plans for preventing future failures during production. Join us in uncovering bugs, defining criteria, and elevating quality levels...

  • Linux Admin Expert

    Há 4 dias

    Recife, Brasil T-Systems do Brasil Tempo inteiro

    Se você busca uma oportunidade na área de Tecnologia da Informação, tem organização, boa comunicação e vontade de crescer, essa vaga pode ser para você. Responsabilidades & Requisitos Must Have: - Sólido conhecimento em Linux Admin (Rocky Linux / Red Hat OS) - Kerberos, PAM, Logs, Bash Scripting (SE Linux), rsyslog, LVM, XFS - Configurações de...

  • AI-Driven Linguistic Content Expert

    3 semanas atrás

    Recife, Brasil beBeeLinguist Tempo inteiro

    Linguistic Content Specialist – AI Training & Development As a Linguistic Content Specialist, you will play a crucial role in shaping the capabilities of large language models and NLP-based systems. Create or edit linguistically-rich content, including grammar guides, syntactic analyses, usage explanations, or examples for NLP pipelines. Identify and...

  • Functionality Quality Assurance Analyst

    1 semana atrás

    Recife, Brasil Kokku Games Tempo inteiro

    We are seeking passionate people to join our team as Functionality Quality Assurance Analysts. In this role, you'll play a vital part in evaluating project quality through manual or automated testing, while also contributing to plans for preventing future failures during production. Join us in uncovering bugs, defining criteria, and elevating quality levels...