QA Engineer – RAG-Enabled Test Automation

3 semanas atrás

Guarulhos, São Paulo, Brasil Totalperform Tempo inteiro

We're looking for a hands-on QA Engineer to own functional quality as we integrate a Retrieval-Augmented Generation (RAG) assistant into our existing Java/Selenium/RestAssured automation stack. You will create high-value manual test cases, validate and refine autoscripted outputs, and help improve the feedback loop that makes our RAG engine smarter over time.

What You'll Do
  • Author and curate requirement tickets and manual test cases using structured formats (GIVEN/WHEN/THEN + data, edge cases, and links).
  • Validate autoscripted tests generated by the RAG pipeline: compile, run, triage, and refactor them following Screenplay best practices; log precision/recall metrics into LangChain evaluators with guidance from the Automation Agent Engineer.
  • Collaborate with SDETs to refactor duplicated Java/Cucumber steps, increase API-layer test coverage, and adopt code snippets surfaced by the retriever.
  • Perform exploratory and regression testing on the new onboarding UI MVP; file defects, verify fixes, and maintain traceable acceptance criteria in Qtest.
What You Bring
  • 3+ years hands-on QA automation experience with Java, Cucumber (BDD), Selenium/WebDriver, and RestAssured.
  • Comfortable writing structured requirement tickets and decomposing stories into atomic acceptance criteria.
  • Intermediate SQL skills for multi-database validation.
  • Familiarity with Jenkins pipelines and artifact triage processes.
  • Clear and precise communication skills, with the ability to translate fuzzy requirements into crisp GIVEN/WHEN/THEN steps.
It is an asset if you have
  • Exposure to the Screenplay pattern (Serenity BDD) and Serenity reporting.
  • Experience reviewing or prompting AI-generated code (e.g., GitHub Copilot, Cursor).
  • Knowledge of LangChain evaluators or RAGAS for retrieval-quality scoring.
#J-18808-Ljbffr

  • Senior Test Automation Engineer

    Há 7 dias

    Guarulhos, São Paulo, Brasil beBeeTechnical Tempo inteiro US$100.000 - US$120.000

    Our organization has been delivering technology solutions for over 15 years, working with leaders and startups worldwide. We have a diverse team of professionals who work remotely on impactful projects.Key Responsibilities:Develop and implement technical strategies and frameworks for test automation and quality assurance to drive business growth.Lead and...

  • RPA Automation Engineer

    4 semanas atrás

    Guarulhos, São Paulo, Brasil Totalperform Tempo inteiro

    We are looking for an Automation Engineer to design, build, and optimize automation solutions that support our SaaS products and internal operations. You will work hands-on with Python, SQL, and automation tools to streamline workflows, enhance system performance, and deliver scalable integrations. This role offers the opportunity to collaborate across...

  • RAG Architect

    3 semanas atrás

    Guarulhos, São Paulo, Brasil Totalperform Tempo inteiro

    We are seeking a Senior AI Engineer to lead the design and implementation of an end-to-end Retrieval-Augmented Generation (RAG) architecture. This role will drive the ingestion of GitHub repositories, Confluence pages, Qtest artifacts, PRDs, and script libraries to power autoscripting, onboarding search, and long-term knowledge reuse. As a technical leader,...

  • Automated Quality Assurance Specialist

    2 semanas atrás

    Guarulhos, São Paulo, Brasil beBeeQAEngineer Tempo inteiro R$90.000 - R$110.000

    We are seeking a skilled QA Automation Engineer to join our team.Key ResponsibilitiesCreate high-value manual test cases and validate autoscripted outputs using structured formats (GIVEN/WHEN/THEN + data, edge cases, and links).Validate autoscripted tests generated by the Retrieval-Augmented Generation (RAG) pipeline, compile, run, triage, and refactor them...

  • Senior Software Test Automation Expert

    1 semana atrás

    Guarulhos, São Paulo, Brasil beBeeTestAutomation Tempo inteiro US$120.000 - US$170.000

    Job Description:The Senior Software Test Automation Expert is responsible for leading the development and implementation of test automation strategies and frameworks to ensure the highest level of software quality. This role requires a strong understanding of advanced testing methodologies, technical leadership skills, and experience in guiding junior team...

  • Chief QA Engineer

    2 semanas atrás

    Guarulhos, São Paulo, Brasil beBeeQuality Tempo inteiro R$60.000 - R$80.000

    We are seeking a skilled Quality Assurance (QA) Engineer to enhance our team's performance.

  • QA Engineer Specialist

    Há 6 dias

    Guarulhos, São Paulo, Brasil Wellhub Tempo inteiro

    Overview QA Engineer Specialist | Business Architecture Services at Wellhub. Join to apply for the QA Engineer Specialist role at Wellhub. Your Wellbeing Matters. Join a Company That Cares. GET TO KNOW US Wellhub (formerly Gympass) is a corporate wellness platform that connects employees to the best partners for fitness, mindfulness, therapy, nutrition,...

  • Remote Qa Engineer

    2 semanas atrás

    Guarulhos, São Paulo, Brasil INDI Staffing Services Tempo inteiro

    At INDI, we're passionate about empowering individuals and businesses worldwide. Our cutting-edge recruiters connect leading companies with top talent, fostering a dynamic environment where innovation thrives. Join us in shaping the future of work.Overview of the role:We are looking for QA Engineer profiles to join our QA team and participate in different...

  • Manual Qa

    Há 6 dias

    Guarulhos, São Paulo, Brasil Bairesdev Tempo inteiro

    OverviewHá mais de 15 anos, a BairesDev é líder em projetos tecnológicos.Entregamos soluções inovadoras para gigantes como Google e Rolls-Royce e as startups mais inovadoras do Vale do Silício.Temos uma equipe diversa de mais de 4.000 profissionais formada pelo Top 1% dos talentos de tecnologia do mundo, trabalhando remotamente em cargos de impacto...

  • Manual QA

    1 semana atrás

    Guarulhos, São Paulo, Brasil BairesDev Tempo inteiro

    OverviewHá mais de 15 anos, a BairesDev é líder em projetos tecnológicos. Entregamos soluções inovadoras para gigantes como Google e Rolls-Royce e as startups mais inovadoras do Vale do Silício.Temos uma equipe diversa de mais de 4.000 profissionais formada pelo Top 1% dos talentos de tecnologia do mundo, trabalhando remotamente em cargos de impacto...