Coding Agent Evaluation Specialist
Há 5 dias
Brasil
Thoth AI
Tempo integral
Grátis com e-mail ou Google
Salve esta vaga e mantenha sua pesquisa organizada
Crie uma conta gratuita para salvar vagas, criar alertas e retornar a esta listagem a partir do seu painel.
Grátis com e-mail ou Google
Ao continuar, você concorda com nossos Termos & Política de Privacidade.
Apply and adapt coding rubrics to evaluate LLM code responses and agent trajectories (correctness, code quality, efficiency, security, tool usage)
Run and test code, reproduce issues, and verify outcomes against test cases and acceptance criteria
Identify and attribute errors (reasoning, implementation, tool use, environment) and write structured feedback
Complete rubric interpretation and golden-task training; pass the post-training qualification before starting work