evaluation

Company Description Founded in 1961, WWF works to help people and nature thrive. As a global conservation organization, WWF operates in more than 100 countries, partnering with communities, companies, and governments to protect wildlife, conserve vital habitats, and advance sustainable solutions. Grounded in science and driven by collaboration, WWF works to...

This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Senior FP&A Expert – Financial Task Design and Evaluation based in Brazil. We are seeking an experienced Financial Planning & Analysis professional to contribute to an innovative AI evaluation project focused on complex...

Apply and adapt coding rubrics to evaluate LLM code responses and agent trajectories (correctness, code quality, efficiency, security, tool usage) Run and test code, reproduce issues, and verify outcomes against test cases and acceptance criteria Identify and attribute errors (reasoning, implementation, tool use, environment) and write structured...

This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Senior FP&A Expert – Financial Task Design and Evaluation based in Brazil. We are seeking an experienced Financial Planning & Analysis professional to contribute to an innovative AI evaluation project focused on complex...

This opportunity is only for candidates currently residing in the specified country. Your location may affect eligibility and rates. Please submit your resume in English and indicate your level of English proficiency. At Mindrift, innovation meets opportunity. We believe in using the power of collective human intelligence to ethically shape the future of...

AI Fact-Checking & Response Evaluation Reviewer (French) Mission of the Role Apply independent judgment to identify AI blind spots, reasoning failures, factual inaccuracies, contradictory evidence, and quality gaps. Successful reviewers do not simply validate AI-generated conclusions, they critically evaluate them. Your role is to verify evidence, challenge...

$30-$100 per hour equivalent, paid per accepted task About 15 hours a week, you choose when Use your backend engineering judgment to design and evaluate coding tasks for AI systems, on your own schedule, and get paid for the backend expertise you already have. AI coding systems are tested by engineers. Teams need backend engineers who can create realistic...

About The Role Join Rex.zone to evaluate and improve AI system outputs using structured human-in-the-loop feedback. You will support RLHF workflows, prompt evaluation, and QA evaluation for large language models, ensuring training data quality and measurable model performance improvement across domains and languages. What You Will Do Design and run LLM...

About The Role What if the code you write could determine how smart the next generation of AI truly is? We're looking for experienced Software Engineers to design and build the coding benchmarks and data pipelines used to evaluate frontier AI models — the systems that decide whether an AI can actually reason, debug, and write production-quality...

**About Us** Ascent has recently been acquired by Acuity Analytics. This is both a significant milestone for us and a tremendous opportunity for you. Acuity Analytics is a business with a strong global reputation, an impressive client base and ambitious growth plans. We deliver deep insights and domain-led digital transformation to high-growth and heavily...

Founded in 1961, WWF works to help people and nature thrive. As a global conservation organization, WWF operates in more than 100 countries, partnering with communities, companies, and governments to protect wildlife, conserve vital habitats, and advance sustainable solutions. Grounded in science and driven by collaboration, WWF works to help nature by...

Gramian Consultancy is a boutique consultancy specializing in IT professional services and engineering talent solutions. With a strong background in software engineering and leadership, we help companies build high-performing teams by matching them with professionals who truly fit their needs. **Role Overview** We are looking for an...

Projeto de inovação do ICT Itaú em parceria com Inova Talentos Pré-Requisitos:Formação: DoutoradoCursos: Ciência da Computação, Engenharia da Computação, Sistemas de Informação, Ciência de Dados, Estatística, Matemática Aplicada, áreas correlatas à Computação, Inteligência Artificial, Machine Learning.Atividades:Projetar e implementar...

Projeto de inovação do ICT Itaú em parceria com Inova Talentos Pré-Requisitos:Formação: MestreCursos: Ciência da Computação, Engenharia da Computação, Sistemas de Informação, Ciência de Dados, Estatística, Matemática Aplicada, áreas correlatas à Computação, Inteligência Artificial, Machine Learning.Atividades:Desenvolver e executar...

**This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for an AI Research Scientist – Scientific Evaluation (ML/AI) based in Brazil.** Join an advanced AI research evaluation project focused on assessing scientific work produced by autonomous AI research agents. In this remote,...

Online generalist jobs at Rex.zone are remote, full-time AI data operations roles supporting LLM training pipelines through data labeling, RLHF evaluation, prompt evaluation, QA evaluation, and content safety labeling. You will follow clear rubrics and annotation guidelines to deliver high-quality training and evaluation data. Key Responsibilities Perform...

About The Role As an AI Engineer, you will design, train, evaluate, and deploy ML models with a strong emphasis on LLM training pipelines and measurable model performance improvement. You will build data and evaluation workflows that connect model development to training data quality, annotation guidelines compliance, and QA evaluation. What You Will...

Remote STEM Jobs in Brazil Rex.zone connects remote professionals with AI/ML and engineering work that strengthens model training pipelines, improves dataset reliability, and supports scalable evaluation operations across distributed teams. Remote STEM Jobs in Brazil Rex.zone connects remote professionals with AI/ML and engineering work that strengthens...

## Descrição da vaga**Position:** LATAM Software Engineers: Coding Tasks for AI Evaluation**Type:** Hourly Contract**Compensation:** $40/hr**Location:** Remote**Role Responsibilities*** Review programming tasks designed for AI evaluation.* Assess the accuracy and structure of evaluation harnesses.* Explain your thought process while checking code...

## Descrição da vaga**Position:** LATAM Software Engineers: Coding Tasks for AI Evaluation**Type:** Hourly Contract**Compensation:** $40/hr**Location:** Remote**Role Responsibilities*** Review programming tasks designed for AI evaluation.* Assess the accuracy and structure of evaluation harnesses.* Explain your thought process while checking code...