Coding Agent Evaluation Specialist

Há 5 dias

Brasil Thoth AI Tempo integral
Apply and adapt coding rubrics to evaluate LLM code responses and agent trajectories (correctness, code quality, efficiency, security, tool usage) Run and test code, reproduce issues, and verify outcomes against test cases and acceptance criteria Identify and attribute errors (reasoning, implementation, tool use, environment) and write structured feedback Complete rubric interpretation and golden-task training; pass the post-training qualification before starting work