Qa/Red Teaming Expert

Há 4 dias

Belo Horizonte, Brasil Innodata Inc. Tempo inteiro

Job Description:
We are seeking highly analytical and detail-oriented professionals with hands-on experience in
Red Teaming, Prompt Evaluation , and
AI/LLM Quality Assurance . The ideal candidate will help us rigorously test and evaluate AI-generated content to identify vulnerabilities, assess risks, and ensure compliance with safety, ethical, and quality standards.
Job Title :- Red Teaming, Prompt Evaluation, or AI/LLM Quality Assurance Expert
Key Responsibilities:
Conduct
Red Teaming exercises
to identify adversarial, harmful, or unsafe outputs from large language models (LLMs).
Evaluate and stress-test AI prompts across multiple domains (e.g., finance, healthcare, security) to uncover potential failure modes.
Develop and apply test cases to assess
accuracy, bias, toxicity, hallucinations , and misuse potential in AI-generated responses.
Collaborate with data scientists, safety researchers, and prompt engineers to report risks and suggest mitigations.
Perform
manual QA
and content validation across model versions, ensuring factual consistency, coherence, and guideline adherence.
Create evaluation frameworks and scoring rubrics for prompt performance and safety compliance.
Document findings, edge cases, and vulnerability reports with high clarity and structure.
Requirements:
Proven experience in
AI red teaming , LLM safety testing, or adversarial prompt design.
Familiarity with
prompt engineering , NLP tasks, and ethical considerations in generative AI.
Strong background in
Quality Assurance , content review, or test case development for AI/ML systems.
Understanding of LLM behaviour's, failure modes, and model evaluation metrics.
Excellent critical thinking, pattern recognition, and analytical writing skills.
Ability to work independently, follow detailed evaluation protocols, and meet tight deadlines.
Preferred Qualifications:
Prior work with teams like Open AI, Anthropic, Google DeepMind, or other LLM safety initiatives.
Experience in risk assessment, red team security testing, or AI policy & governance.
Background in linguistics, psychology, or computational ethics is a plus.
Kindly Attempt the below assessment to proceed further with your application.

  • Qa/Red Teaming Expert

    Há 2 dias

    Belo Horizonte, Brasil Caderno Nacional Tempo inteiro

    Qa/Red Teaming Expert - Detalhes da Vaga. ? The ideal candidate will help us rigorously test and evaluate AI-generated content to identify vulnerabilities, assess risks, and ensure compliance with safety, ethical, and quality standards. ?Job Title :- Red Teaming, Prompt Evaluation, or AI/LLM Quality Assurance Expert Key Responsibilities:Conduct Red Teaming...

  • Qa/Red Teaming Expert

    Há 4 dias

    Belo Horizonte, Brasil Innodata Inc. Tempo inteiro

    Job Description:We are seeking highly analytical and detail-oriented professionals with hands-on experience in Red Teaming, Prompt Evaluation, and AI/LLM Quality Assurance. The ideal candidate will help us rigorously test and evaluate AI-generated content to identify vulnerabilities, assess risks, and ensure compliance with safety, ethical, and quality...

  • Red Teaming Specialist

    Há 2 dias

    Belo Horizonte, Brasil Bebeeexpert Tempo inteiro

    Job Title: Expert Red Teaming SpecialistUndertake Red Teaming exercises to identify adversarial outputs from large language models, ensuring AI-generated content is safe and effective.Evaluate AI prompts across domains to uncover potential failure modes, including bias, toxicity, hallucinations, and misuse.Our organization seeks detail-oriented professionals...

  • Qa/Red Teaming Expert

    Há 5 dias

    Belo Horizonte, Brasil Innodata Inc. Tempo inteiro

    Job Description:We are seeking highly analytical and detail-oriented professionals with hands-on experience in Red Teaming, Prompt Evaluation, and AI/LLM Quality Assurance. The ideal candidate will help us rigorously test and evaluate AI-generated content to identify vulnerabilities, assess risks, and ensure compliance with safety, ethical, and quality...

  • QA Lead

    2 semanas atrás

    Belo Horizonte, Brasil Red Pill RH Tempo inteiro

    Nós da **Red Pill RH** junto ao nosso cliente VipCommerce, estamos em busca de um QA Lead!A VIP Commerce através de uma plataforma white-label e um modelo logístico criados exclusivamente para o varejo alimentar, permite aos varejistas integrarem um novo canal online à operação já existente com rapidez e eficiência.Nosso cliente cresceu mais de 500%...

  • Content Writer

    Há 6 dias

    Belo Horizonte, Brasil Innodata Inc. Tempo inteiro

    Job Description: We are seeking highly analytical and detail-oriented professionals with hands-on experience in Red Teaming, Prompt Evaluation, and AI/LLM Quality Assurance. The ideal candidate will help us rigorously test and evaluate AI-generated content to identify vulnerabilities, assess risks, and ensure compliance with safety, ethical, and quality...

  • Content Writer

    Há 5 dias

    Belo Horizonte, Brasil Innodata Inc. Tempo inteiro

    Job Description:We are seeking highly analytical and detail-oriented professionals with hands-on experience in Red Teaming, Prompt Evaluation, and AI/LLM Quality Assurance. The ideal candidate will help us rigorously test and evaluate AI-generated content to identify vulnerabilities, assess risks, and ensure compliance with safety, ethical, and quality...

  • Chief Technical Solutions Expert

    2 semanas atrás

    Belo Horizonte, Brasil AgileEngine Tempo inteiro

    Job Description We are looking for a highly skilled Senior Technical Support Engineer to join our team. As a key member of our support team, you will be responsible for providing expert technical guidance and support to customers, partners, and internal teams. You will be the primary point of contact for complex technical issues, working closely with our...

  • Desenvolvedor Qa

    2 semanas atrás

    Belo Horizonte, Brasil Abgi Brasil Tempo inteiro

    Join to apply for the Desenvolvedor QA role at ABGi Brasil1 day ago Be among the first 25 applicantsJoin to apply for the Desenvolvedor QA role at ABGi BrasilGet AI-powered advice on this job and more exclusive features.A Abgi, consultoria multinacional do grupo Visiativ, recruta profissionais que tenham interesse em inovação e estejam em busca de uma...

  • Desenvolvedor QA

    4 semanas atrás

    Belo Horizonte, Minas Gerais, Brasil ABGi Brasil Tempo inteiro

    Join to apply for the Desenvolvedor QA role at ABGi Brasil 1 day ago Be among the first 25 applicants Join to apply for the Desenvolvedor QA role at ABGi Brasil Get AI-powered advice on this job and more exclusive features. A Abgi, consultoria multinacional do grupo Visiativ, recruta profissionais que tenham interesse em inovação e estejam em busca de...