
QA/Red Teaming Expert
Há 5 dias
Job Description:
We are seeking highly analytical and detail-oriented professionals with hands-on experience in Red Teaming, Prompt Evaluation , and AI/LLM Quality Assurance . The ideal candidate will help us rigorously test and evaluate AI-generated content to identify vulnerabilities, assess risks, and ensure compliance with safety, ethical, and quality standards.
Job Title :- Red Teaming, Prompt Evaluation, or AI/LLM Quality Assurance Expert
Key Responsibilities:
- Conduct Red Teaming exercises to identify adversarial, harmful, or unsafe outputs from large language models (LLMs).
- Evaluate and stress-test AI prompts across multiple domains (e.g., finance, healthcare, security) to uncover potential failure modes.
- Develop and apply test cases to assess accuracy, bias, toxicity, hallucinations , and misuse potential in AI-generated responses.
- Collaborate with data scientists, safety researchers, and prompt engineers to report risks and suggest mitigations.
- Perform manual QA and content validation across model versions, ensuring factual consistency, coherence, and guideline adherence.
- Create evaluation frameworks and scoring rubrics for prompt performance and safety compliance.
- Document findings, edge cases, and vulnerability reports with high clarity and structure.
Requirements:
- Proven experience in AI red teaming , LLM safety testing, or adversarial prompt design.
- Familiarity with prompt engineering , NLP tasks, and ethical considerations in generative AI.
- Strong background in Quality Assurance , content review, or test case development for AI/ML systems.
- Understanding of LLM behaviour's, failure modes, and model evaluation metrics.
- Excellent critical thinking, pattern recognition, and analytical writing skills.
- Ability to work independently, follow detailed evaluation protocols, and meet tight deadlines.
Preferred Qualifications:
- Prior work with teams like Open AI, Anthropic, Google DeepMind, or other LLM safety initiatives.
- Experience in risk assessment, red team security testing, or AI policy & governance.
Background in linguistics, psychology, or computational ethics is a plus.
Kindly Attempt the below assessment to proceed further with your application.
-
QA/Red Teaming Expert
Há 6 dias
Brasil Innodata Inc. Tempo inteiroJob Description: We are seeking highly analytical and detail-oriented professionals with hands-on experience in Red Teaming, Prompt Evaluation , and AI/LLM Quality Assurance . The ideal candidate will help us rigorously test and evaluate AI-generated content to identify vulnerabilities, assess risks, and ensure compliance with safety, ethical, and quality...
-
Qa/red teaming expert
Há 6 dias
Brasil Innodata Inc. Tempo inteiroJob Description: We are seeking highly analytical and detail-oriented professionals with hands-on experience in Red Teaming, Prompt Evaluation , and AI/LLM Quality Assurance . The ideal candidate will help us rigorously test and evaluate AI-generated content to identify vulnerabilities, assess risks, and ensure compliance with safety, ethical, and...
-
QA/Red Teaming Expert
Há 6 dias
Brasil Innodata Inc. Tempo inteiroJob Description: We are seeking highly analytical and detail-oriented professionals with hands-on experience in Red Teaming, Prompt Evaluation , and AI/LLM Quality Assurance . The ideal candidate will help us rigorously test and evaluate AI-generated content to identify vulnerabilities, assess risks, and ensure compliance with safety, ethical, and...
-
Content Writer
Há 6 dias
Brasil Innodata Inc. Tempo inteiroJob Description: We are seeking highly analytical and detail-oriented professionals with hands-on experience in Red Teaming, Prompt Evaluation , and AI/LLM Quality Assurance . The ideal candidate will help us rigorously test and evaluate AI-generated content to identify vulnerabilities, assess risks, and ensure compliance with safety, ethical, and quality...
-
Content writer
Há 6 dias
Brasil Innodata Inc. Tempo inteiroJob Description: We are seeking highly analytical and detail-oriented professionals with hands-on experience in Red Teaming, Prompt Evaluation , and AI/LLM Quality Assurance . The ideal candidate will help us rigorously test and evaluate AI-generated content to identify vulnerabilities, assess risks, and ensure compliance with safety, ethical, and...
-
Content Writer
Há 5 dias
Brasil Innodata Inc. Tempo inteiroJob Description: We are seeking highly analytical and detail-oriented professionals with hands-on experience in Red Teaming, Prompt Evaluation , and AI/LLM Quality Assurance . The ideal candidate will help us rigorously test and evaluate AI-generated content to identify vulnerabilities, assess risks, and ensure compliance with safety, ethical, and...
-
Senior QA
3 semanas atrás
Brasil CI&T Tempo inteiroGet AI-powered advice on this job and more exclusive features. We are tech transformation specialists, uniting human expertise with AI to create scalable tech solutions. With over 6,500 CI&Ters around the world, we've built partnerships with more than 1,000 clients during our 30 years of history. Artificial Intelligence is our reality. We are seeking...
-
Equity Trading QA
3 semanas atrás
Brasil Exadel open positions Tempo inteiroWe are currently seeking an Equity trading QA & Support Analyst to join our team Why Join ExadelWe're an AI-first global tech company with 25+ years of engineering leadership, 2,000+ team members, and 500+ active projects powering Fortune 500 clients, including HBO, Microsoft, Google, and Starbucks.From AI platforms to digital transformation, we partner with...
-
Senior Linux System Administrator Position
3 semanas atrás
Brasil beBeeLinux Tempo inteiroHigh-Level Linux Systems Expert We are seeking a highly skilled and experienced professional to provide expert-level support for Red Hat Enterprise Linux system administration. Key Responsibilities: Provide technical expertise in automation with Ansible, scripting, and patching. Ensure the security, stability, and scalability of our Linux-based...
-
Linux Admin Expert
3 semanas atrás
Brasil T-Systems do Brasil Tempo inteiroSe você busca uma oportunidade na área de Tecnologia da Informação, tem organização, boa comunicação e vontade de crescer, essa vaga pode ser para você. Responsabilidades & Requisitos Must Have:Sólido conhecimento em Linux Admin (Rocky Linux / Red Hat OS) Kerberos, PAM, Logs, Bash Scripting (SE Linux), rsyslog, LVM, XFS Configurações de rede...