Senior AI Model Validator

Há 6 dias


São Bernardo do Campo, São Paulo, Brasil beBeeTester Tempo inteiro US$80.000 - US$90.000
Software Tester

AgileEngine is an award-winning software development company that creates innovative solutions for Fortune 500 brands and trailblazing startups across various industries. We rank among the leaders in areas like application development and AI/ML, and our people-first culture has earned us multiple Best Place to Work awards.

Key Responsibilities:
  • We are looking for a skilled Software Tester who can design and execute automated and manual end-to-end test strategies across all layers of the testing pyramid.
  • You will validate AI model performance, including accuracy, confidence thresholds, and fallback behavior.
  • Automate quality processes from data ingestion to extraction and classification, with a focus on speed, repeatability, and resilience.
  • You will test and validate integration points between AI components and core business logic.
  • Maintain Test Infrastructure and Define Quality Gates, Automated Scripts, and Synthetic Data.
  • Define and track quality metrics that matter to the business (e.g., turnaround time, confidence scores, correction rates).
Requirements:
  • Bachelor's degree in Computer Science, Engineering, Information Systems, or equivalent experience.
  • 3+ years of experience in QA, Test Engineering, or related roles with a strong grasp of QA methodologies.
  • Solid understanding of SDLC, Agile methodologies, and software quality principles.
  • Hands-on experience with automation frameworks like Pytest, Selenium, Cypress, Postman, etc.
  • Comfortable working with REST APIs, data pipelines, and backend services.
  • Familiarity with cloud platforms (AWS or Azure) and CI/CD tools.
  • Detail-oriented mindset with a sharp eye for edge cases and a strong sense of ownership.
  • Quick, proactive learner—especially important in the fast-evolving world of AI.
Nice to Haves:
  • Experience testing AI/ML systems in production environments.
  • Familiarity with GenAI model evaluation metrics.
  • Experience setting up monitoring/alerting for model drift, workflow failures, or performance issues.

Competitive USD-based compensation package, professional growth opportunities, and exciting projects to work on.


  • Senior AI Engineer

    3 semanas atrás


    São Paulo, São Paulo, Brasil Elios Talent Tempo inteiro

    Senior AI Engineer – Machine Learning | LLMs | PythonWe're hiring a Senior AI Engineer to design and deploy advanced AI solutions that power intelligent features across our product ecosystem. This is a hands-on opportunity to drive innovation using machine learning, deep learning, and LLMs in production environments. Tech Stack You'll Work With:Python,...

  • AI Model Developer

    Há 6 dias


    São Paulo, São Paulo, Brasil beBeeArtificialIntelligence Tempo inteiro R$120.000 - R$180.000

    Job Overview\The Generative AI Development Specialist is responsible for designing and implementing artificial intelligence models to enhance business efficiency, improve decision-making, and boost customer satisfaction.\This role requires expertise in machine learning, natural language processing, and software development. The ideal candidate will have a...


  • São Paulo, São Paulo, Brasil beBeeMACHINELEARNING Tempo inteiro

    Job Title: Advanced AI Model DeveloperAbout the JobWe are seeking an experienced AI model developer to join our team of expert engineers. As a key member of our team, you will be responsible for designing, developing, and optimizing advanced machine learning models using state-of-the-art technologies such as LangChain and Python.Key ResponsibilitiesDevelop...


  • São Paulo, São Paulo, Brasil beBeePsychology Tempo inteiro US$20.000 - US$40.000

    Job Opportunity:We are seeking an expert to help develop and refine AI models in psychology. The ideal candidate will have a strong background in psychology and experience with AI.About the Role:As a key member of our team, you will work on challenging projects that push the boundaries of AI technology. You will have the flexibility to set your own hours and...


  • São Paulo, São Paulo, Brasil beBeeWriter Tempo inteiro US$720 - US$1.200

    Job Title: Ai Training for Brazilian Portuguese WritersWe are looking for freelance writers to help train generative artificial intelligence models to become better writers.This opportunity involves contracting for a prominent organization in the tech industry, with flexible hours and remote work arrangements.You will work on various writing projects in...


  • São Paulo, São Paulo, Brasil beBeePsychology Tempo inteiro US$20.000 - US$40.000

    Opportunity OverviewPursue a challenging role as an AI model trainer, leveraging your expertise in psychology to drive innovation and improvement in AI technology.Key HighlightsCutting-Edge Projects: Engage with complex projects that push the boundaries of AI in psychology.Flexibility: Work remotely with autonomy and flexibility to manage your...


  • São Paulo, São Paulo, Brasil Nokia Tempo inteiro

    Senior Research Engineer – AI & Industrial InnovationJoin to apply for the Senior Research Engineer – AI & Industrial Innovation role at NokiaSenior Research Engineer – AI & Industrial InnovationJoin to apply for the Senior Research Engineer – AI & Industrial Innovation role at NokiaJob DescriptionWe are seeking a hands-on Senior Research Engineer to...


  • São Paulo, São Paulo, Brasil Motorola Solutions Tempo inteiro

    Overview Join to apply for the Senior AI/ML Engineer, Conversational AI role at Motorola Solutions. At Motorola Solutions, we believe that everything starts with our people. We're a global close-knit community, united by the relentless pursuit to help keep people safer everywhere. Our critical communications, video security and command center technologies...


  • São Paulo, São Paulo, Brasil Nokia Tempo inteiro

    Senior Research Engineer – AI & Industrial Innovation Join to apply for the Senior Research Engineer – AI & Industrial Innovation role at Nokia Senior Research Engineer – AI & Industrial Innovation Join to apply for the Senior Research Engineer – AI & Industrial Innovation role at Nokia Job DescriptionWe are seeking a hands-on Senior Research...

  • AI Engineer ID34949

    4 semanas atrás


    São Bernardo do Campo, São Paulo, Brasil AgileEngine Tempo inteiro

    Join to apply for the AI Engineer ID34949 ($3,000 signing bonus) role at AgileEngine1 day ago Be among the first 25 applicantsJoin to apply for the AI Engineer ID34949 ($3,000 signing bonus) role at AgileEngineGet AI-powered advice on this job and more exclusive features.AgileEngine is an Inc. 5000 company that creates award-winning software for Fortune 500...