QA/Red Teaming Expert

2 semanas atrás

São Paulo, Brasil Innodata Inc. Tempo inteiro

Job Description:
We are seeking highly analytical and detail-oriented professionals with hands-on experience in Red Teaming, Prompt Evaluation , and AI/LLM Quality Assurance . The ideal candidate will help us rigorously test and evaluate AI-generated content to identify vulnerabilities, assess risks, and ensure compliance with safety, ethical, and quality standards.

Job Title :- Red Teaming, Prompt Evaluation, or AI/LLM Quality Assurance Expert

Key Responsibilities:
Conduct Red Teaming exercises to identify adversarial, harmful, or unsafe outputs from large language models (LLMs).
Evaluate and stress-test AI prompts across multiple domains (e.g., finance, healthcare, security) to uncover potential failure modes.
Develop and apply test cases to assess accuracy, bias, toxicity, hallucinations , and misuse potential in AI-generated responses.
Collaborate with data scientists, safety researchers, and prompt engineers to report risks and suggest mitigations.
Perform manual QA and content validation across model versions, ensuring factual consistency, coherence, and guideline adherence.
Create evaluation frameworks and scoring rubrics for prompt performance and safety compliance.
Document findings, edge cases, and vulnerability reports with high clarity and structure.

Requirements:
Proven experience in AI red teaming , LLM safety testing, or adversarial prompt design.
Familiarity with prompt engineering , NLP tasks, and ethical considerations in generative AI.
Strong background in Quality Assurance , content review, or test case development for AI/ML systems.
Understanding of LLM behaviour's, failure modes, and model evaluation metrics.
Excellent critical thinking, pattern recognition, and analytical writing skills.
Ability to work independently, follow detailed evaluation protocols, and meet tight deadlines.

Preferred Qualifications:
Prior work with teams like Open AI, Anthropic, Google DeepMind, or other LLM safety initiatives.
Experience in risk assessment, red team security testing, or AI policy & governance.
Background in linguistics, psychology, or computational ethics is a plus.

Kindly Attempt the below assessment to proceed further with your application.

https://icap.innodata.com/registerfreelancer?enc=oUTZVsr/Pnz/0Xygc2EK32MdtinqnjC9vy8RU3Ha4EMfQdYWF8n1oAiUtOZXMcKhhhsYYecqmKWja8eKXV801gezikielezikiel

  • Red Bull Student Marketeer

    4 semanas atrás

    São Paulo, Brasil Red Bull Tempo inteiro

    Red Bull Student Marketeer - USJT Guarulhos Join to apply for the Red Bull Student Marketeer - USJT Guarulhos role at Red Bull Red Bull Student Marketeer - USJT Guarulhos 1 day ago Be among the first 25 applicants Join to apply for the Red Bull Student Marketeer - USJT Guarulhos role at Red Bull Get AI-powered advice on this job and more exclusive...

  • QA Híbrido

    4 semanas atrás

    São Paulo, São Paulo, Brasil Red pill recursos humanos especializados ltda Tempo inteiro

    Estamos em busca de um(a) QA com perfil híbrido (QA/BA) para atuar junto ao time de Produto, garantindo que as entregas tenham qualidade, valor de negócio e experiência do usuário. Responsabilidades Apoiar Produto na definição de critérios de aceite e cenários de uso. Elaborar e executar testes funcionais, exploratórios e de performance. Validar...

  • Analista de QA Sênior

    3 semanas atrás

    Sao Paulo, Brasil Red Pill RH Tempo inteiro

    #VemSerRCHLOVER #Remoto #Java #SêniorA Red Pill, junto com a Riachuelo, está a procura de Analista de Qa Sênior para a Tribo de Logística.**Sobre a Riachuelo**:A empresa acredita que a moda é um espaço onde todo mundo pode se transformar na sua melhor versão. E este olhar para as pessoas é o que leva a Riachuelo para o futuro. É o que faz os 40 mil...

  • Pessoa Especialista em Red Team

    2 semanas atrás

    Sao Paulo, Brasil Página de carreiras Tempo inteiro

    **Quem somos**:// Nascemos em 1998, fruto da paixão pela tecnologia e do impulso empreendedor de nossos fundadores. Com a sabedoria que só quem é a página inicial da internet no Brasil pode ter, acreditamos que todos podem se desenvolver. Por isso, oferecemos um portfólio completo de serviços de internet, atendimento especializado e muito...

  • Content Writer

    2 semanas atrás

    São Paulo, Brasil Innodata Inc. Tempo inteiro

    Job Description: We are seeking highly analytical and detail-oriented professionals with hands-on experience in Red Teaming, Prompt Evaluation , and AI/LLM Quality Assurance . The ideal candidate will help us rigorously test and evaluate AI-generated content to identify vulnerabilities, assess risks, and ensure compliance with safety, ethical, and quality...

  • Content Writer

    Há 4 dias

    São Paulo, Brasil Innodata Inc. Tempo inteiro

    Job Description: We are seeking highly analytical and detail-oriented professionals with hands-on experience in Red Teaming, Prompt Evaluation , and AI/LLM Quality Assurance . The ideal candidate will help us rigorously test and evaluate AI-generated content to identify vulnerabilities, assess risks, and ensure compliance with safety, ethical, and quality...

  • Openshift Technical Account Manager

    3 semanas atrás

    Sao Paulo, Brasil Red Hat Software Tempo inteiro

    About the job:Work closely with customers to gain an understanding of their IT infrastructure, internal processes, and business needs, and help identify relevant trends throughout the industry.The Red Hat Global Customer Success team is looking for an experienced, enterprise-level engineer to join us as an OpenShift Technical Account Manager in Brazil. In...

  • QA Expert Tutor

    2 semanas atrás

    São Paulo, Brasil TripleTen Tempo inteiro

    About TripleTen TripleTen is a service that empowers individuals, regardless of their prior experience, to embark on the exciting and challenging journey of mastering tech professions. Our bootcamps focus on training students in software engineering, data science, business intelligence analytics, and QA engineering in a feasible and accessible way,...

  • QA Expert Tutor

    2 semanas atrás

    São Paulo, Brasil TripleTen Tempo inteiro

    About TripleTenTripleTen is a service that empowers individuals, regardless of their prior experience, to embark on the exciting and challenging journey of mastering tech professions.Our bootcamps focus on training students in software engineering, data science, business intelligence analytics, and QA engineering in a feasible and accessible way, ultimately...

  • Qa Híbrido

    3 semanas atrás

    São Paulo, Brasil buscojobs Brasil Tempo inteiro

    Resumo Estamos em busca de um(a) QA com perfil híbrido (QA / BA) para atuar junto ao time de Produto, garantindo que as entregas tenham qualidade, valor de negócio e experiência do usuário. Responsabilidades Apoiar Produto na definição de critérios de aceite e cenários de uso. Elaborar e executar testes funcionais, exploratórios e de...