QA Engineer – RAG-Enabled Test Automation

Há 2 dias

São Paulo, São Paulo, Brasil Perform Tempo inteiro
Overview

We're looking for a hands-on QA Engineer to own functional quality as we integrate a Retrieval-Augmented Generation (RAG) assistant into our existing Java/Selenium/RestAssured automation stack. You will create high-value manual test cases, validate and refine autoscripted outputs, and help improve the feedback loop that makes our RAG engine smarter over time.

Responsibilities
  • Author and curate requirement tickets and manual test cases using structured formats (GIVEN/WHEN/THEN + data, edge cases, and links).
  • Validate autoscripted tests generated by the RAG pipeline: compile, run, triage, and refactor them following Screenplay best practices; log precision/recall metrics into LangChain evaluators with guidance from the Automation Agent Engineer.
  • Collaborate with SDETs to refactor duplicated Java/Cucumber steps, increase API-layer test coverage, and adopt code snippets surfaced by the retriever.
  • Perform exploratory and regression testing on the new onboarding UI MVP; file defects, verify fixes, and maintain traceable acceptance criteria in Qtest.
Qualifications
  • 3+ years hands-on QA automation experience with Java, Cucumber (BDD), Selenium/WebDriver, and RestAssured.
  • Comfortable writing structured requirement tickets and decomposing stories into atomic acceptance criteria.
  • Intermediate SQL skills for multi-database validation.
  • Familiarity with Jenkins pipelines and artifact triage processes.
  • Clear and precise communication skills, with the ability to translate fuzzy requirements into crisp GIVEN/WHEN/THEN steps.
Nice to have
  • Exposure to the Screenplay pattern (Serenity BDD) and Serenity reporting.
  • Experience reviewing or prompting AI-generated code (e.g., GitHub Copilot, Cursor).
  • Knowledge of LangChain evaluators or RAGAS for retrieval-quality scoring.
Job details
  • Seniority level: Not Applicable
  • Employment type: Other
  • Job function: Engineering and Information Technology
#J-18808-Ljbffr

  • Sr. Automation Qa Engineer

    Há 17 horas

    São Paulo, São Paulo, Brasil Elios Talent Tempo inteiro

    Sr.Automation QA Engineer - São Paulo, Brazil - ContractWorking Hours: 8:00 a.m.CST – 5:00 p.m.CSTKey Highlights Build and own test automation frameworks (UI + API)?? Integrate suites into CI/CD pipelines Drive quality metrics and reliability across teams Portuguese + strong English (verbal & written)About the RoleWe're looking for a Sr.Automation QA...

  • Senior Test Automation Engineer

    Há 2 dias

    São Paulo, São Paulo, Brasil QA Brains Tempo inteiro

    Job Description Side is hiring Senior Test Automation Engineer (Remote) This is a remote role. We are seeking an experienced Senior Test Automation Engineer to join our team. This role focuses on crafting high-quality automated tests, with an emphasis on API testing, to enhance software quality and user experience. The ideal candidate will have deep...

  • Sr. Automation Qa Engineer

    Há 3 dias

    São Paulo, São Paulo, Brasil Elios Talent Tempo inteiro

    Sr. Automation QA Engineer - São Paulo, Brazil - ContractWorking Hours:8:00 a.M. CST – 5:00 p.M. CSTKey Highlights Build and own test automation frameworks (UI + API) Integrate suites into CI/CD pipelines Drive quality metrics and reliability across teams Portuguese + strong English (verbal & written)About the RoleWe're looking for a Sr. Automation QA...

  • Lead QA Automation Engineer

    4 semanas atrás

    São Paulo, São Paulo, Brasil Braintrust Tempo inteiro

    Join to apply for the Lead QA Automation Engineer role at Braintrust 3 days ago Be among the first 25 applicants Join to apply for the Lead QA Automation Engineer role at Braintrust About Pyyne Job DescriptionAbout Pyyne Pyyne is a modern technology consultancy engineering the next generation of digital products and services.At Pyyne, we believe in using...

  • Lead QA Automation Engineer

    2 semanas atrás

    São Paulo, São Paulo, Brasil Braintrust Tempo inteiro

    Join to apply for the Lead QA Automation Engineer role at Braintrust 3 days ago Be among the first 25 applicants Join to apply for the Lead QA Automation Engineer role at Braintrust About Pyyne Job Description About Pyyne Pyyne is a modern technology consultancy engineering the next generation of digital products and services.At Pyyne, we believe in...

  • QA Automation Engineer

    3 semanas atrás

    São Paulo, São Paulo, Brasil Trading Technologies Tempo inteiro

    Join to apply for the QA Automation Engineer role at Trading Technologies8 months ago Be among the first 25 applicantsJoin to apply for the QA Automation Engineer role at Trading TechnologiesWe are currently seeking a self-motivated, creative and talented Automation Engineer – Contractor who will thrive on exposing issues and improving the quality of our...

  • Automation Test Engineer

    Há 4 dias

    São Paulo, São Paulo, Brasil beBeeAutomation Tempo inteiro US$80.000 - US$100.000

    Job Title: QA Automation Engineer (Junior/Middle)This role involves designing, developing, and executing automated test scripts using Selenium, Cucumber, and Java.Key Responsibilities:Design and develop automated test scriptsMaintain and improve the test automation frameworkIdentify and report bugsEnsure quality and reliability of applications through...

  • Sr. Automation QA Engineer

    Há 2 dias

    São Paulo, São Paulo, Brasil Elios Talent Tempo inteiro

    Sr. Automation QA Engineer - São Paulo, Brazil - Contract Working Hours: 8:00 a.m. CST – 5:00 p.m. CST Key Highlights Build and own test automation frameworks (UI + API) Integrate suites into CI/CD pipelines Drive quality metrics and reliability across teams Portuguese + strong English (verbal & written) About the Role We're looking for a Sr....

  • Qa Mobile Automation Engineer

    Há 3 dias

    São Paulo, São Paulo, Brasil Applaudo Tempo inteiro

    1 week ago Be among the first 25 applicantsGet AI-powered advice on this job and more exclusive features.You are someone who wants to influence your own development.You're looking for a company where you have the opportunity to pursue your interests and be able to grow professionally.You bring to Applaudo the following competencies:Bachelor's degree in...

  • Software Test Automation Engineer

    3 semanas atrás

    São Paulo, São Paulo, Brasil RDI Software Brazil Tempo inteiro

    Software Test Automation Engineer - Release ManagementJoin to apply for the Software Test Automation Engineer - Release Management role at RDI Software BrazilSoftware Test Automation Engineer - Release Management15 hours ago Be among the first 25 applicantsJoin to apply for the Software Test Automation Engineer - Release Management role at RDI Software...