Ai Red Team Expert

Há 7 horas

Salvador, Brasil Bebeeredteam Tempo inteiro

**Job Opportunity:** We are seeking a highly analytical and detail-oriented professional with hands-on experience in AI/LLM Quality Assurance, Red Teaming, and Prompt Evaluation.We need someone who can help us rigorously test and evaluate AI-generated content to identify vulnerabilities, assess risks, and ensure compliance with safety, ethical, and quality standards.This includes conducting Red Teaming exercises to identify adversarial, harmful, or unsafe outputs from large language models (LLMs).
The ideal candidate will also evaluate and stress-test AI prompts across multiple domains (e.g., finance, healthcare, security) to uncover potential failure modes.In addition, they will develop and apply test cases to assess accuracy, bias, toxicity, hallucinations, and misuse potential in AI-generated responses.Collaboration with data scientists, safety researchers, and prompt engineers is crucial for reporting risks and suggesting mitigations.The selected individual will perform manual QA and content validation across model versions, ensuring factual consistency, coherence, and guideline adherence.Furthermore, they will create evaluation frameworks and scoring rubrics for prompt performance and safety compliance.Last but not least, they will document findings, edge cases, and vulnerability reports with high clarity and structure.
**Required Skills and Qualifications:**Prior experience in AI red teaming, LLM safety testing, or adversarial prompt design is mandatory.Familiarity with prompt engineering, NLP tasks, and ethical considerations in generative AI is essential.A strong background in Quality Assurance, content review, or test case development for AI/ML systems is also necessary.Understanding of LLM behavior's, failure modes, and model evaluation metrics is critical.Excellent critical thinking, pattern recognition, and analytical writing skills are required.Ability to work independently, follow detailed evaluation protocols, and meet tight deadlines is essential.
**Preferred Qualifications:**Prior work with teams like Open AI, Anthropic, Google DeepMind, or other LLM safety initiatives is desirable.Experience in risk assessment, red team security testing, or AI policy & governance is also beneficial.
**Key Responsibilities Include:Conducting thorough evaluations of AI-generated content.Developing and applying test cases to assess AI response quality.Collaborating with cross-functional teams to report risks and suggest mitigations.
**What We Offer:** A dynamic work environment, opportunities for growth and development, and the chance to make a meaningful impact on the future of AI.

  • AI Innovation Expert

    2 semanas atrás

    Salvador, Brasil beBeeLanguage Tempo inteiro

    Are you looking for a role that combines your passion for language with the excitement of working at the forefront of AI innovation? We are seeking smart, detail-oriented, and curious Language Specialists to join our team as we build the next generation of generative AI and large language models (LLMs). As a Language Specialist, you will play a key role in...

  • Ai Innovation Expert

    2 semanas atrás

    Salvador, Brasil Bebeelanguage Tempo inteiro

    Are you looking for a role that combines your passion for language with the excitement of working at the forefront of AI innovation?We are seeking smart, detail-oriented, and curious Language Specialists to join our team as we build the next generation of generative AI and large language models (LLMs).As a Language Specialist, you will play a key role in...

  • Physics Expert

    1 semana atrás

    Salvador, Brasil Bebeephysics Tempo inteiro

    Physics Expert - Collaborative AI ProjectWe are seeking a highly skilled Physics Expert to collaborate on an innovative AI project.As a key member of our team, you will utilize your expertise in physics to design and develop advanced problems for AI testing, ensuring accurate and reliable results.This role offers the opportunity to work with researchers and...

  • Freelance Mathematics Expert

    1 hora atrás

    Salvador, Brasil Mindrift Tempo inteiro

    Freelance Mathematics Expert - Quality Assurance (AI Trainer) 2 days ago Be among the first 25 applicants This opportunity is only for candidates currently residing in the specified country. Your location may affect eligibility and rates. At Mindrift, innovation meets opportunity. We believe in using the power of collective intelligence to ethically...

  • Ai Project Team Lead And Content Specialist

    1 semana atrás

    Salvador, Brasil Bebeebusinessanalyst Tempo inteiro

    About the Role:We're seeking a Team Lead and Business Analyst to oversee and mentor a team of analysts creating business-focused content.This role combines leadership, quality oversight, and subject expertise in relevant domains to ensure outputs are accurate, logically sound, and aligned with project goals.The ideal candidate will have people management...

  • Psychology Subject Matter Expert

    3 semanas atrás

    Salvador, Bahia, Brasil Innodata Inc. Tempo inteiro

    Job Title:Psychology Subject Matter Expert – AI Training & Content DevelopmentAbout Innodata:Innodata (NASDAQ: INOD) is a global leader in data engineering and AI-powered solutions, partnering with 4 of the top 5 global technology companies and serving over 2,000 enterprise clients worldwide. With operations in 13 global locations and a workforce of 5,000+...

  • Senior Ai Strategy Consultant

    Há 7 horas

    Salvador, Brasil Bebeestrategy Tempo inteiro

    About our AI strategy projects: a global opportunity at the frontier of advanced AI systems.Role Overview:We seek exceptional strategy professionals to help shape initiatives.This is an opportunity to work directly on high-impact AI strategy projects, bringing structured thinking and consulting-level frameworks to exciting challenges in frontier...

  • Ai Saas Design Strategist

    1 semana atrás

    Salvador, Brasil Bebeedesigner Tempo inteiro

    Design Visionary for Emerging AI SaaS MarketWe're seeking a highly skilled design expert to spearhead our visual identity and drive innovative marketing initiatives in the competitive AI/SaaS landscape.

  • Ai Systems Engineer

    Há 7 horas

    Salvador, Brasil Bebeebackend Tempo inteiro

    Join a forward-thinking company revolutionizing AI-driven interactions.We're building the future of business growth by harnessing AI to deliver personalized experiences at scale.Our team is passionate about creating systems that power real-world AI interactions, and we're looking for talented engineers to join our mission.About the RoleKey...

  • Ai Solutions Architect

    1 semana atrás

    Salvador, Brasil Bebeeagentic Tempo inteiro

    **Innovative AI Solutions Architect**: We're seeking a visionary Software Engineer to contribute to the development of cutting-edge AI-driven solutions.Responsibilities include leading the design and architecture of autonomous AI Agents, leveraging large language models and advanced techniques such as Retrieval-Augmented Generation (RAG).You will work with...