Qa/Red Teaming Expert

2 semanas atrás

Curitiba, Brasil Innodata Inc. Tempo inteiro

Job Description:We are seeking highly analytical and detail-oriented professionals with hands-on experience in Red Teaming, Prompt Evaluation, and AI/LLM Quality Assurance.
The ideal candidate will help us rigorously test and evaluate AI-generated content to identify vulnerabilities, assess risks, and ensure compliance with safety, ethical, and quality standards.Job Title :- Red Teaming, Prompt Evaluation, or AI/LLM Quality Assurance Expert Key Responsibilities:Conduct Red Teaming exercises to identify adversarial, harmful, or unsafe outputs from large language models (LLMs).
Evaluate and stress-test AI prompts across multiple domains (e.g., finance, healthcare, security) to uncover potential failure modes.Develop and apply test cases to assess accuracy, bias, toxicity, hallucinations, and misuse potential in AI-generated responses.Collaborate with data scientists, safety researchers, and prompt engineers to report risks and suggest mitigations.Perform manual QA and content validation across model versions, ensuring factual consistency, coherence, and guideline adherence.Create evaluation frameworks and scoring rubrics for prompt performance and safety compliance.Document findings, edge cases, and vulnerability reports with high clarity and structure.Requirements:Proven experience in AI red teaming, LLM safety testing, or adversarial prompt design.Familiarity with prompt engineering, NLP tasks, and ethical considerations in generative AI.Strong background in Quality Assurance, content review, or test case development for AI/ML systems.Understanding of LLM behaviour's, failure modes, and model evaluation metrics.Excellent critical thinking, pattern recognition, and analytical writing skills.Ability to work independently, follow detailed evaluation protocols, and meet tight deadlines.Preferred Qualifications:Prior work with teams like Open AI, Anthropic, Google DeepMind, or other LLM safety initiatives.Experience in risk assessment, red team security testing, or AI policy & governance.Background in linguistics, psychology, or computational ethics is a plus.Kindly Attempt the below assessment to proceed further with your application.?
enc=oUTZVsr/Pnz/0Xygc2EK32MdtinqnjC9vy8RU3Ha4EMfQdYWF8n1oAiUtOZXMcKhhhsYYecqmKWja8eKXV801gezikielezikiel

  • Ai Expert

    Há 7 dias

    Curitiba, Brasil Bebeeredteaming Tempo inteiro

    Job OpportunityWe are seeking highly analytical and detail-oriented professionals to join our team as AI Red Teaming Experts.The ideal candidate will help us rigorously test and evaluate AI-generated content, identify vulnerabilities, assess risks, and ensure compliance with safety, ethical, and quality standards.Conduct adversarial testing exercises to...

  • Ai Safety Specialist

    1 semana atrás

    Curitiba, Brasil Bebeeadversarial Tempo inteiro

    AI Safety ExpertAs a pioneering figure in the field of AI safety, you will play a pivotal role in identifying and mitigating potential risks associated with large language models.Key Responsibilities:Conduct rigorous Red Teaming exercises to expose vulnerabilities in AI systems.Evaluate and stress-test AI prompts across various domains, uncovering potential...

  • Student Marketeer

    4 semanas atrás

    Curitiba, Paraná, Brasil Red Bull Tempo inteiro

    Our Red Bull Student Marketeers are part of the most dynamic and empowered brand and product ambassador program in the world. They understand Red Bull's target group and are responsible for driving the brand image and product understanding on their campus and in their region. The goal of the Student Markteeer program is to reach new consumers, excite...

  • Analista de QA Jr.

    Há 5 dias

    Curitiba, Brasil Signo Tech Tempo inteiro

    Join to apply for the Analista de QA Jr. role at Signo Tech 2 days ago Be among the first 25 applicants Join to apply for the Analista de QA Jr. role at Signo Tech Get AI-powered advice on this job and more exclusive features. This range is provided by Signo Tech. Your actual pay will be based on your skills and experience — talk with your recruiter to...

  • QA Engineer Lead

    Há 2 dias

    Curitiba, Brasil Beecrowd Tempo inteiro

    We are a leader in fraud prevention and AML compliance. Our platform uses device intelligence, behavior biometrics, machine learning, and AI to stop fraud before it happens. Today, over 300 banks, retailers, and fintechs worldwide use Sardine to stop identity fraud, payment fraud, account takeovers, and social engineering scams. We have raised $145M from...

  • Especialista QA

    Há 23 horas

    Curitiba, Paraná, Brasil prime control Tempo inteiro R$60.000 - R$120.000 por ano

    Curitiba - PR1 posiçãoNão informadoElegível para PCDIntegralCLTRemotoVaga Afirmativa Para MulheresVaga Afirmativa Para Pessoas PretasVaga Afirmativa Para IndígenasVaga Afirmativa Para Pessoas Com +40 AnosVaga Afirmativa Para Pessoas LGBTQIAP+TecnologiaVocê já conhece a #PrimeControl?A Prime Control é uma consultoria de tecnologia engajada em proteger...

  • User Acceptance Testing/QA Senior Engineer

    4 semanas atrás

    Curitiba, Brasil Powdevs Tempo inteiro

    User Acceptance Testing/QA Senior Engineer User Acceptance Testing/QA Senior Engineer Get AI-powered advice on this job and more exclusive features. The website is essential to our business operations. It serves as the initial point of contact for customers who are interested in learning more about our services or scheduling an estimate with their local...

  • Linux Experto

    4 semanas atrás

    Curitiba, Paraná, Brasil beBeeDesenvolvimento Tempo inteiro

    Desenvolver habilidades em tecnologia da informação, a boa organização e comunicação são fundamentais para o sucesso em nosso ambiente. Descrição do Cargo O candidato ideal terá conhecimento sólido em Linux Admin (Rocky Linux/Red Hat OS), além de habilidades em configurações de rede (Network Manager, resolve.conf). Requisitos Básicos Kerberos,...

  • User Acceptance Testing/QA Senior Engineer

    4 semanas atrás

    Curitiba, Brasil Powdevs Tempo inteiro

    User Acceptance Testing/QA Senior EngineerUser Acceptance Testing/QA Senior EngineerGet AI-powered advice on this job and more exclusive features. The website is essential to our business operations. It serves as the initial point of contact for customers who are interested in learning more about our services or scheduling an estimate with their local...

  • Marketing Expert

    Há 6 dias

    Curitiba, Brasil Wipro Limited Tempo inteiro

    Curitiba, Brazil - DOP - 3071810 **Role Purpose** - The purpose of the role is to provide effective technical support to the process and actively resolve client issues directly or through timely escalation to meet process SLAs._ **Do** - **Support process by managing transactions as per required quality standards** - _Document all pertinent end user...