QA/Red Teaming Expert

Há 6 dias

Brasil Innodata Inc. Tempo inteiro

Job Description:

We are seeking highly analytical and detail-oriented professionals with hands-on experience in Red Teaming, Prompt Evaluation , and AI/LLM Quality Assurance . The ideal candidate will help us rigorously test and evaluate AI-generated content to identify vulnerabilities, assess risks, and ensure compliance with safety, ethical, and quality standards.

Job Title :- Red Teaming, Prompt Evaluation, or AI/LLM Quality Assurance Expert

Key Responsibilities:

- Conduct Red Teaming exercises to identify adversarial, harmful, or unsafe outputs from large language models (LLMs).
- Evaluate and stress-test AI prompts across multiple domains (e.g., finance, healthcare, security) to uncover potential failure modes.
- Develop and apply test cases to assess accuracy, bias, toxicity, hallucinations , and misuse potential in AI-generated responses.
- Collaborate with data scientists, safety researchers, and prompt engineers to report risks and suggest mitigations.
- Perform manual QA and content validation across model versions, ensuring factual consistency, coherence, and guideline adherence.
- Create evaluation frameworks and scoring rubrics for prompt performance and safety compliance.
- Document findings, edge cases, and vulnerability reports with high clarity and structure.

Requirements:

- Proven experience in AI red teaming , LLM safety testing, or adversarial prompt design.
- Familiarity with prompt engineering , NLP tasks, and ethical considerations in generative AI.
- Strong background in Quality Assurance , content review, or test case development for AI/ML systems.
- Understanding of LLM behaviour's, failure modes, and model evaluation metrics.
- Excellent critical thinking, pattern recognition, and analytical writing skills.
- Ability to work independently, follow detailed evaluation protocols, and meet tight deadlines.

Preferred Qualifications:

- Prior work with teams like Open AI, Anthropic, Google DeepMind, or other LLM safety initiatives.
- Experience in risk assessment, red team security testing, or AI policy & governance.

Background in linguistics, psychology, or computational ethics is a plus.

Kindly Attempt the below assessment to proceed further with your application.

  • Qa/red teaming expert

    Há 6 dias

    Brasil Innodata Inc. Tempo inteiro

    Job Description: We are seeking highly analytical and detail-oriented professionals with hands-on experience in Red Teaming, Prompt Evaluation , and AI/LLM Quality Assurance . The ideal candidate will help us rigorously test and evaluate AI-generated content to identify vulnerabilities, assess risks, and ensure compliance with safety, ethical, and...

  • QA/Red Teaming Expert

    Há 6 dias

    Brasil Innodata Inc. Tempo inteiro

    Job Description: We are seeking highly analytical and detail-oriented professionals with hands-on experience in Red Teaming, Prompt Evaluation , and AI/LLM Quality Assurance . The ideal candidate will help us rigorously test and evaluate AI-generated content to identify vulnerabilities, assess risks, and ensure compliance with safety, ethical, and...

  • QA/Red Teaming Expert

    Há 5 dias

    Brasil Innodata Inc. Tempo inteiro

    Job Description: We are seeking highly analytical and detail-oriented professionals with hands-on experience in Red Teaming, Prompt Evaluation , and AI/LLM Quality Assurance . The ideal candidate will help us rigorously test and evaluate AI-generated content to identify vulnerabilities, assess risks, and ensure compliance with safety, ethical, and...

  • Content Writer

    Há 6 dias

    Brasil Innodata Inc. Tempo inteiro

    Job Description: We are seeking highly analytical and detail-oriented professionals with hands-on experience in Red Teaming, Prompt Evaluation , and AI/LLM Quality Assurance . The ideal candidate will help us rigorously test and evaluate AI-generated content to identify vulnerabilities, assess risks, and ensure compliance with safety, ethical, and quality...

  • Content writer

    Há 6 dias

    Brasil Innodata Inc. Tempo inteiro

    Job Description: We are seeking highly analytical and detail-oriented professionals with hands-on experience in Red Teaming, Prompt Evaluation , and AI/LLM Quality Assurance . The ideal candidate will help us rigorously test and evaluate AI-generated content to identify vulnerabilities, assess risks, and ensure compliance with safety, ethical, and...

  • Designated Support Engineer- RHEL

    4 semanas atrás

    Brasil Red Hat Tempo inteiro

    Join to apply for the Designated Support Engineer- RHEL role at Red Hat2 weeks ago Be among the first 25 applicantsJoin to apply for the Designated Support Engineer- RHEL role at Red HatThe Red Hat Customer Experience and Engagement (CEE) team is looking for an experienced engineer to join our Solutions Support team in Brazil or Colombia. In this role, you...

  • Content Writer

    Há 5 dias

    Brasil Innodata Inc. Tempo inteiro

    Job Description: We are seeking highly analytical and detail-oriented professionals with hands-on experience in Red Teaming, Prompt Evaluation , and AI/LLM Quality Assurance . The ideal candidate will help us rigorously test and evaluate AI-generated content to identify vulnerabilities, assess risks, and ensure compliance with safety, ethical, and...

  • Analista de QA SR

    4 semanas atrás

    Brasil Objective Tempo inteiro

    Join to apply for the Analista de QA SR role at Objective2 days ago Be among the first 25 applicantsJoin to apply for the Analista de QA SR role at ObjectiveGet AI-powered advice on this job and more exclusive features.Somos ávidos por tecnologia, criatividade e desafios.Se você gosta de desafios, aprendizado constante e valoriza as conexões pessoais,...

  • Senior QA

    3 semanas atrás

    Brasil CI&T Tempo inteiro

    Get AI-powered advice on this job and more exclusive features. We are tech transformation specialists, uniting human expertise with AI to create scalable tech solutions. With over 6,500 CI&Ters around the world, we've built partnerships with more than 1,000 clients during our 30 years of history. Artificial Intelligence is our reality. We are seeking...

  • Equity Trading QA

    3 semanas atrás

    Brasil Exadel open positions Tempo inteiro

    We are currently seeking an Equity trading QA & Support Analyst to join our team Why Join ExadelWe're an AI-first global tech company with 25+ years of engineering leadership, 2,000+ team members, and 500+ active projects powering Fortune 500 clients, including HBO, Microsoft, Google, and Starbucks.From AI platforms to digital transformation, we partner with...