QA Engineer – RAG-Enabled Test Automation

1 dia atrás

São Paulo, Brasil Perform Tempo inteiro
Overview

We’re looking for a hands-on QA Engineer to own functional quality as we integrate a Retrieval-Augmented Generation (RAG) assistant into our existing Java/Selenium/RestAssured automation stack. You will create high-value manual test cases, validate and refine autoscripted outputs, and help improve the feedback loop that makes our RAG engine smarter over time.

Responsibilities
  • Author and curate requirement tickets and manual test cases using structured formats (GIVEN/WHEN/THEN + data, edge cases, and links).
  • Validate autoscripted tests generated by the RAG pipeline: compile, run, triage, and refactor them following Screenplay best practices; log precision/recall metrics into LangChain evaluators with guidance from the Automation Agent Engineer.
  • Collaborate with SDETs to refactor duplicated Java/Cucumber steps, increase API-layer test coverage, and adopt code snippets surfaced by the retriever.
  • Perform exploratory and regression testing on the new onboarding UI MVP; file defects, verify fixes, and maintain traceable acceptance criteria in Qtest.
Qualifications
  • 3+ years hands-on QA automation experience with Java, Cucumber (BDD), Selenium/WebDriver, and RestAssured.
  • Comfortable writing structured requirement tickets and decomposing stories into atomic acceptance criteria.
  • Intermediate SQL skills for multi-database validation.
  • Familiarity with Jenkins pipelines and artifact triage processes.
  • Clear and precise communication skills, with the ability to translate fuzzy requirements into crisp GIVEN/WHEN/THEN steps.
Nice to have
  • Exposure to the Screenplay pattern (Serenity BDD) and Serenity reporting.
  • Experience reviewing or prompting AI-generated code (e.g., GitHub Copilot, Cursor).
  • Knowledge of LangChain evaluators or RAGAS for retrieval-quality scoring.
Job details
  • Seniority level: Not Applicable
  • Employment type: Other
  • Job function: Engineering and Information Technology
#J-18808-Ljbffr

  • QA Engineer – RAG-Enabled Test Automation

    2 semanas atrás

    São Paulo, São Paulo, Brasil Perform Tempo inteiro

    Overview We're looking for a hands-on QA Engineer to own functional quality as we integrate a Retrieval-Augmented Generation (RAG) assistant into our existing Java/Selenium/RestAssured automation stack. You will create high-value manual test cases, validate and refine autoscripted outputs, and help improve the feedback loop that makes our RAG engine...

  • QA Engineer – RAG-Enabled Test Automation

    Há 2 dias

    São Paulo, Brasil Perform Tempo inteiro

    Overview We’re looking for a hands-on QA Engineer to own functional quality as we integrate a Retrieval-Augmented Generation (RAG) assistant into our existing Java/Selenium/RestAssured automation stack. You will create high-value manual test cases, validate and refine autoscripted outputs, and help improve the feedback loop that makes our RAG engine...

  • Test Automation Specialist

    2 semanas atrás

    São Paulo, São Paulo, Brasil beBeeQuality Tempo inteiro R$60.000 - R$80.000

    Software Quality Assurance ProfessionalWe're seeking a skilled QA Engineer to integrate our Retrieval-Augmented Generation (RAG) assistant into our existing automation stack. As a key team member, you will create high-value manual test cases, validate and refine autoscripted outputs, and improve the feedback loop that enhances our RAG engine.

  • Senior Automation Tester

    2 semanas atrás

    São Paulo, São Paulo, Brasil beBeeAutomation Tempo inteiro US$90.000 - US$135.000

    Functional Quality Lead for RAG-Enabled AutomationWe're seeking an experienced QA Engineer to lead functional quality as we integrate Retrieval-Augmented Generation (RAG) into our existing automation stack.Key responsibilities include:Authoring and curating requirement tickets and manual test cases using structured formats.Validating autoscripted tests...

  • Senior Test Automation Engineer

    2 semanas atrás

    São Paulo, São Paulo, Brasil QA Brains Tempo inteiro

    Job Description Side is hiring Senior Test Automation Engineer (Remote) This is a remote role. We are seeking an experienced Senior Test Automation Engineer to join our team. This role focuses on crafting high-quality automated tests, with an emphasis on API testing, to enhance software quality and user experience. The ideal candidate will have deep...

  • QA Automation Engineer

    2 semanas atrás

    São Paulo, São Paulo, Brasil Trading Technologies Tempo inteiro

    Join to apply for the QA Automation Engineer role at Trading Technologies 8 months ago Be among the first 25 applicants Join to apply for the QA Automation Engineer role at Trading Technologies We are currently seeking a self-motivated, creative and talented Automation Engineer – Contractor who will thrive on exposing issues and improving the quality...

  • Sr. Automation Qa Engineer

    2 semanas atrás

    São Paulo, São Paulo, Brasil Elios Talent Tempo inteiro

    Sr. Automation QA Engineer - São Paulo, Brazil - ContractWorking Hours:8:00 a.M. CST – 5:00 p.M. CSTKey Highlights Build and own test automation frameworks (UI + API) Integrate suites into CI/CD pipelines Drive quality metrics and reliability across teams Portuguese + strong English (verbal & written)About the RoleWe're looking for a Sr. Automation QA...

  • Lead QA Automation Engineer

    4 semanas atrás

    São Paulo, São Paulo, Brasil Braintrust Tempo inteiro

    Join to apply for the Lead QA Automation Engineer role at Braintrust 3 days ago Be among the first 25 applicants Join to apply for the Lead QA Automation Engineer role at Braintrust About Pyyne Job Description About Pyyne Pyyne is a modern technology consultancy engineering the next generation of digital products and services.At Pyyne, we believe in...

  • Sr. Automation QA Engineer

    2 semanas atrás

    São Paulo, São Paulo, Brasil Elios Talent Tempo inteiro R$90.000 - R$120.000 por ano

    Sr. Automation QA Engineer - São Paulo, Brazil - ContractWorking Hours:8:00 a.m. CST – 5:00 p.m. CSTKey Highlights Build and own test automation frameworks (UI + API) Integrate suites into CI/CD pipelines Drive quality metrics and reliability across teams Portuguese + strong English (verbal & written)About the RoleWe're looking for a Sr. Automation QA...

  • Senior Test Automation Engineer

    1 dia atrás

    São Paulo, Brasil QA Brains Tempo inteiro

    Job Description Side is hiring Senior Test Automation Engineer (Remote) This is a remote role. We are seeking an experienced Senior Test Automation Engineer to join our team. This role focuses on crafting high-quality automated tests, with an emphasis on API testing, to enhance software quality and user experience. The ideal candidate will have deep...