Automation Agent Engineer

Há 13 horas

Guarapari, Brasil Perform Tempo inteiro

OverviewJoin to apply for the Automation Agent Engineer (SDET + RAG/Prompt Engineering) role at Perform.We're looking for a forward-thinking Automation Agent Engineer—part seasoned SDET, part prompt engineer—who's excited to bridge the gap between classic QA automation and AI-assisted workflows.
In this hybrid role, you'll help develop and refine a mini-RAG system that transforms manual test cases into intelligent, LLM-generated test skeletons.
You'll shape how context is retrieved, how prompts are designed, and how generated test code aligns with standards for our Java-based automation stack (RestAssured, Selenium, Cucumber, Screenplay).
This is a hands-on, highly collaborative role where your decisions will directly affect the quality, consistency, and scalability of our AI-enabled testing pipeline.
What You'll Do
Design and refine prompt templates and few-shot examples to guide the LLM toward generating high-quality test code.
Collaborate on RAG logic, including chunking strategies, metadata filters, and reranker tuning for optimal context retrieval.
Help convert manual test cases into structured test skeletons, normalizing them to project standards.
Build evaluation loops to validate generated code—ensuring compliance with naming, format, assertions, lint rules, and compile/run requirements.
Review and land autoscripted code with proper guardrails, documentation, and handoff to the SDET team.
Optimize token usage and latency while maintaining test fidelity in collaboration with the AI and QA teams.
What You Bring
5+ years of experience in QA automation with strong skills in Java, RestAssured, Selenium, Cucumber, and ideally the Screenplay pattern.
Hands-on knowledge of prompt engineering, including few-shot prompting and structured output design.
Working understanding of RAG concepts (embeddings, retrievers, rerankers) and how they apply to software development workflows.
Familiarity with CI pipelines (Jenkins), Git workflows, and code review best practices.
It is an asset if you have
Experience with LangChain, ChromaDB, or other local retrieval systems.
Understanding of LLMs like Claude 4 Sonnet and how to manage token/cost trade-offs.
Ability to build small tools such as static analyzers, linters, or rule-based code evaluators.
Seniority level
Not Applicable
Employment type
Other
Job function
Sales and Business Development
#J-18808-Ljbffr

  • Senior Automation Engineer

    Há 13 horas

    Guarapari, Brasil Perform Tempo inteiro

    Join to apply for the Senior Automation Engineer (SDET) role at Perform3 days ago Be among the first 25 applicantsJoin to apply for the Senior Automation Engineer (SDET) role at PerformAbout the RoleWe're looking for a hands-on Automation Engineer to take full ownership of our existing QA automation framework and elevate it to the next level.You'll focus...

  • Test Engineer Automation Career Opportunities At Dev.Pro

    Há 5 dias

    Guarapari, Brasil Dev.Pro Tempo inteiro

    Test Engineer Automation Career Opportunities at Dev.Pro - 01Test Engineer Automation Career Opportunities at Dev.Pro - 013 weeks ago Be among the first 25 applicantsAre you interested in building an exciting IT career at Dev.Pro?Join our exclusive screening process to gain valuable career insights and access personalized feedback on your skill set.???? What...

  • Qa Engineer

    Há 5 dias

    Guarapari, Brasil Techunting Tempo inteiro

    Join to apply for the QA Engineer role at Techunting.We are seeking a QA Engineer to join the Marketing Tech (Buy-Side) team.This role will support the delivery of high-impact, high-quality features by enhancing our end-to-end test automation coverage, participating in release validation, and contributing to platform sustainability and observability.The...

  • Qa Automation Engineer

    Há 5 dias

    Guarapari, Brasil Randstad Argentina Tempo inteiro

    OverviewWe are seeking versatile and passionate QA professionals to join our team, focusing on ensuring the quality of our applications, with a special emphasis on a LLM chatbot for document retrieval.This role involves working across various software projects, including Machine Learning and Data Analytics/Data Warehouse applications.As QA professionals, you...

  • Windows Engineer

    Há 13 horas

    Guarapari, Brasil Sur Latam Tempo inteiro

    2 days ago Be among the first 25 applicantsGet AI-powered advice on this job and more exclusive features.Our client is looking for a Windows Escalation Engineer to join their growing team.Responsibilities:Provide technical support and troubleshooting expertise for complex Windows issues escalated from front-line support teams.Analyze and isolate complex...

  • Security Engineer

    Há 5 dias

    Guarapari, Brasil Yuno Tempo inteiro

    Join to apply for the Security Engineer role at Yuno1 day ago Be among the first 25 applicantsJoin to apply for the Security Engineer role at YunoGet AI-powered advice on this job and more exclusive features.Remote, LATAM, Full Time, Individual Contributor, +4 years of experienceWho We AreAt Yuno, we are building the payment infrastructure that enables all...

  • Solutions Engineer

    Há 5 dias

    Guarapari, Brasil Techunting Tempo inteiro

    Join to apply for the Solutions Engineer (Data Platform) role at Techunting16 hours ago Be among the first 25 applicantsJoin to apply for the Solutions Engineer (Data Platform) role at TechuntingIs looking for a highly organized and technically skilled engineer to help optimize and manage their data platform operations, focusing on user access, permissions,...

  • Full Stack Engineer

    Há 5 dias

    Guarapari, Brasil Salesforce Tempo inteiro

    Join to apply for the Full Stack Engineer - SMTS role at Salesforce1 day ago Be among the first 25 applicantsJoin to apply for the Full Stack Engineer - SMTS role at SalesforceGet AI-powered advice on this job and more exclusive features.To get the best candidate experience, please consider applying for a maximum of 3 roles within 12 months to ensure you are...

  • Qa Automation Engineer

    Há 3 dias

    Guarapari, Brasil Artax Advisors Tempo inteiro

    Somos ARTAX, una startup que combina tecnología e innovación para acelerar la transformación digital del sistema financiero.Nos destacamos por nuestra velocidad de respuesta, flexibilidad operativa y por tener al talento como motor del cambio.Acompañamos a empresas líderes del sector en la creación de soluciones con impacto real, conectando a las...

  • Software Development Engineer In Test

    Há 5 dias

    Guarapari, Brasil Sur Latam Tempo inteiro

    Software Development Engineer in Test (MacOS)Our US-based client is seeking a deeply technical and hands-on Software Development Engineer in Test (macOS) to own the quality of their macOS integration layers, including endpoint security agents, network extensions, and other system-level components.You will work closely with engineering and product teams to...