Quality Operations Lead Contract
Há 22 horas
Brasil
Careerflow.ai
Remoto
Tempo integral
Grátis com e-mail ou Google
Salve esta vaga e mantenha sua pesquisa organizada
Crie uma conta gratuita para salvar vagas, criar alertas e retornar a esta listagem a partir do seu painel.
Grátis com e-mail ou Google
Ao continuar, você concorda com nossos Termos & Política de Privacidade.
Careerflow Human Data Labs partners with AI companies to bring real-world professional expertise into their products.
About the role
Manage day-to-day quality operations for multimodal AI annotation projects. Reporting to the Quality Manager, you will lead QA teams, monitor quality performance, resolve issues quickly, and ensure deliverables meet client standards within tight turnaround times.
Key Responsibilities
• Lead Senior QA Leads and QA Leads across shifts.
• Set review priorities, sampling plans, and quality coverage.
• Implement audits, scoring rubrics, and calibration processes.
• Track accuracy, agreement, error rates, review throughput, and turnaround time.
• Identify root causes and drive corrective actions with Team Leads.
• Resolve guideline-related questions and document decisions.
• Share quality insights after each delivery.
• Report quality performance to the Quality Manager.
• Support client reviews and quality-based incentive programs. Required Qualifications
• 5–7 years of overall experience, including 2–3 years leading QA or quality operations teams.
• Strong knowledge of sampling, auditing, calibration, and root-cause analysis.
• Excellent attention to detail and ability to identify systemic issues.
• Strong communication and stakeholder-management skills.
• Experience in annotation, data labeling, or AI training data projects is preferred. Offer Details:
• This is a project-based role involving a defined number of evaluation tasks.
• Each task will involve comparing multiple chatbots and providing a final assessment.
• Work Schedule: Five working days per week, including weekends as required, with two weekdays off.
• Work Hours
- 7am-4pm PST
• Duration: 16 weeks.
About the role
Manage day-to-day quality operations for multimodal AI annotation projects. Reporting to the Quality Manager, you will lead QA teams, monitor quality performance, resolve issues quickly, and ensure deliverables meet client standards within tight turnaround times.
Key Responsibilities
• Lead Senior QA Leads and QA Leads across shifts.
• Set review priorities, sampling plans, and quality coverage.
• Implement audits, scoring rubrics, and calibration processes.
• Track accuracy, agreement, error rates, review throughput, and turnaround time.
• Identify root causes and drive corrective actions with Team Leads.
• Resolve guideline-related questions and document decisions.
• Share quality insights after each delivery.
• Report quality performance to the Quality Manager.
• Support client reviews and quality-based incentive programs. Required Qualifications
• 5–7 years of overall experience, including 2–3 years leading QA or quality operations teams.
• Strong knowledge of sampling, auditing, calibration, and root-cause analysis.
• Excellent attention to detail and ability to identify systemic issues.
• Strong communication and stakeholder-management skills.
• Experience in annotation, data labeling, or AI training data projects is preferred. Offer Details:
• This is a project-based role involving a defined number of evaluation tasks.
• Each task will involve comparing multiple chatbots and providing a final assessment.
• Work Schedule: Five working days per week, including weekends as required, with two weekdays off.
• Work Hours
- 7am-4pm PST
• Duration: 16 weeks.