Senior QA Engineer

Employment type: 6-12 month contract with possibility of renewal depending on business needs and personal performance. Pay in USD.

Location: Remote in Latin America. Preferred locations include Peru, Mexico, Brazil, Chile, Bolivia, Ecuador, or Colombia.

Timezone: Must be able to work on Central Time.

About us

Concord isn't your typical consulting firm; we are an execution company with a passion for making things happen. Our mission is to help clients enhance customer experiences, optimize operations, and revolutionize their product offerings through seamless integration, optimization, and activation of technology and data.

We are purpose-built, merging the industry's top specialty companies to amplify our Innovation Capabilities in analytics & AI, data management & engineering, UX and digital experience development, and technical platform integration, automation & security engineering.

About the role

In this role, you will design and implement testing strategies to ensure the reliability, accuracy, and security of our AI-powered applications. You'll work closely with software engineers, data scientists, and product managers to validate full-stack applications, APIs, and AI-driven features.

This is an opportunity to contribute to cutting-edge AI initiatives, including LLM-powered systems, Retrieval-Augmented Generation (RAG) architectures, and intelligent user interfaces, while establishing quality best practices for emerging technologies.

• Design, develop, and execute automated and manual test cases for AI-driven applications (front-end, back-end, and APIs).
• Validate Large Language Model (LLM)-powered features, including accuracy, reliability, and safety.
• Test Retrieval-Augmented Generation (RAG) systems and vector database integrations for performance and correctness.
• Collaborate with engineers to define acceptance criteria and build test automation into CI/CD pipelines.
• Perform functional, regression, performance, and exploratory testing on web and cloud-based systems.
• Implement monitoring and validation frameworks for non-deterministic AI behavior (e.g., prompt consistency, bias detection, and output validation).
• Contribute to the development of testing tools and frameworks for AI/ML-specific quality challenges.
• Report, prioritize, and track defects, collaborating with developers for timely resolution.
• Ensure compliance with security, privacy, and governance requirements in AI systems.

• 5+ years of experience in software quality assurance or test engineering.
• Strong experience with test automation frameworks (e.g., PyTest, Playwright, Cypress, or Selenium).
• Proficiency in scripting/programming with Python or JavaScript/TypeScript.
• Experience testing APIs and microservices (REST/GraphQL).
• Familiarity with CI/CD pipelines (e.g., GitHub Actions, Azure DevOps, Jenkins).
• Solid understanding of front-end testing for React/TypeScript applications.
• Experience validating applications built on Large Language Models (LLMs). Exposure to testing AI/ML pipelines, including bias, fairness, and safety validation.
• Knowledge of vector databases (Pinecone, Weaviate, FAISS, Azure AI Search).
• Familiarity with cloud environments (Azure preferred, AWS or GCP acceptable).
• Strong problem-solving and analytical skills, with attention to detail.
• Excellent communication and collaboration skills, especially in Agile environments.
• Advanced English proficiency (C1 or C2) with proven experience working in English-speaking environments and collaborating with global teams.

***

More than just a consulting firm, Concord is an execution company helping clients enhance customer experience, optimize operations, and differentiate product offerings. From digital transformation and legacy modernization to domain-driven design, we deliver real solutions for the problems our clients face. Join one of the fastest growing consulting firms in the Midwest

Our core capabilities work together to help companies untangle their toughest business and technology challenges: Business Strategy & Alignment, Digital & User Experience, Cloud Applications & Integration, Data Solutions & Analytics, Quality Engineering, and Information Security.

***

9UITOEZufI