Freelance Agent Evaluation Engineer
1 hora atrás
Please submit your CV in English and indicate your level of English proficiency.Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems.Participation is project-based, not permanent employment.What this opportunity involvesWhile each project involves unique tasks, contributors may:Create structured test cases that simulate complex human workflowsDefine gold-standard behavior and scoring logic to evaluate agent actionsAnalyze agent logs, failure modes, and decision pathsWork with code repositories and test frameworks to validate your scenariosIterate on prompts, instructions, and test cases to improve clarity and difficultyEnsure that scenarios are production-ready, easy to run, and reusableWhat we look forThis opportunity is a good fit for software engineers, open to part-time, non-permanent projects. Ideally, contributors will have:3+ of software development experience with strong Python focusExperience with Git and code repositoriesComfortable with structured formats like JSON/YAML for scenario descriptionUnderstanding core LLM limitations (hallucinations, bias, context limits) and how these affect evaluation designFamiliarity with DockerEnglish proficiency - B2How it worksApply ? Pass qualification(s) ? Join a project ? Complete tasks ? Get paidProject time expectationsTasks for this project are estimated to take 6-10 hours to complete, depending on complexity. This is an estimate and not a schedule requirement; you choose when and how to work. Tasks must be submitted by the deadline and meet the listed acceptance criteria to be accepted.PaymentPaid contributions, with ratesup to $17/hour*Fixed project rate or individual rates, depending on the projectSome projects include incentive payments*Note: Rates vary based on expertise, skills assessment, location, project needs, and other factors. Higher rates may be offered to highly specialized experts. Lower rates may apply during onboarding or non-core project phases. Payment details are shared per project.
-
Freelance Agent Evaluation Analyst
30 minutos atrás
Belo Horizonte, Brasil Mindrift Tempo inteiroFreelance Agent Evaluation Analyst1 week ago Be among the first 25 applicantsGet AI-powered advice on this job and more exclusive features.This opportunity is only for candidates currently residing in the specified country.Your location may affect eligibility and rates.Please submit your resume in English and indicate your level of English proficiency.At...
-
Freelance Agent Evaluation Analyst
2 semanas atrás
Belo Horizonte, Brasil Mindrift Tempo inteiroFreelance Agent Evaluation Analyst 1 week ago Be among the first 25 applicants Get AI-powered advice on this job and more exclusive features. This opportunity is only for candidates currently residing in the specified country. Your location may affect eligibility and rates. Please submit your resume in English and indicate your level of English proficiency....
-
Freelance Agent Evaluation Engineer
Há 2 horas
Belo Horizonte, Brasil Mindrift Tempo inteiroThis opportunity is only for candidates currently residing in the specified country.Your location may affect eligibility and rates.Please submit your resume in English and indicate your level of English.At Mindrift, innovation meets opportunity.We believe in using the power of collective human intelligence to ethically shape the future of AI.What We DoThe...
-
Freelance Agent Evaluation Analyst
Há 3 horas
Belo Horizonte, Brasil Mindrift Tempo inteiroThis opportunity is only for candidates currently residing in the specified country.Your location may affect eligibility and rates.Please submit your resume in English and indicate your level of English proficiency.At Mindrift, innovation meets opportunity.We believe in using the power of collective human intelligence to ethically shape the future of AI.What...
-
Freelance Agent Evaluation Analyst
1 hora atrás
Belo Horizonte, Brasil Mindrift Tempo inteiroThis opportunity is only for candidates currently residing in the specified country. Your location may affect eligibility and rates. Please submit your resume in English and indicate your level of English proficiency.At Mindrift , innovation meets opportunity. We believe in using the power of collective human intelligence to ethically shape the future of...
-
Ai Agent Evaluation Analyst
Há 2 horas
Belo Horizonte, Brasil Mindrift Tempo inteiroThis opportunity is only for candidates currently residing in the specified country.Your location may affect eligibility and rates.Please submit your resume in English and indicate your level of English proficiency.At Mindrift, innovation meets opportunity.We believe in using the power of collective human intelligence to ethically shape the future of AI.What...
-
Belo Horizonte, Brasil Mindrift Tempo inteiroThis opportunity is only for candidates currently residing in the specified country. Your location may affect eligibility and rates. Please submit your resume in English and indicate your level of English proficiency.At Mindrift , innovation meets opportunity. We believe in using the power of collective human intelligence to ethically shape the future of...
-
Civil Engineer With Python Experience
Há 4 dias
Belo Horizonte, Brasil Mindrift Tempo inteiroOverviewCivil Engineer with Python Experience - Freelance AI Trainer at Mindrift.This opportunity involves contributing to GenAI projects by creating prompts, defining evaluation criteria, and correcting model responses based on civil engineering expertise.This is a remote freelance role.ResponsibilitiesGenerate prompts that challenge AI.Define comprehensive...
-
Freelance Software Developer
30 minutos atrás
Belo Horizonte, Brasil Mindrift Tempo inteiroOverviewFreelance Software Developer (Ruby) / Quality Assurance (AI Trainer)Mindrift connects specialists with AI projects from major tech innovators.Our mission is to unlock the potential of Generative AI by tapping into real-world expertise from across the globe.ResponsibilitiesCode generation and code reviewPrompt evaluation and complex data...
-
Belo Horizonte, Brasil Mindrift Tempo inteiroElectrical Engineer with Python Experience - Freelance AI Trainer1 day ago Be among the first 25 applicantsThis opportunity is only for candidates currently residing in the specified country.Your location may affect eligibility and rates.Please submit your resume in English and indicate your level of English.At Mindrift, innovation meets opportunity.We...
