AI Model Assessment Specialist
Há 24 horas
We are seeking an experienced and skilled professional to develop and implement rigorous evaluation frameworks across the artificial intelligence lifecycle. The ideal candidate will be responsible for designing metrics, benchmarking, collaborating with cross-functional teams, and improving evaluation pipelines.
Key Responsibilities- Design and deploy evaluation frameworks assessing models during pre-training, post-training, and inference, tracking metrics like accuracy, latency, throughput, and memory usage.
- Develop high-quality evaluation datasets and benchmarks to ensure consistent measurement of model robustness and improvements.
- Collaborate with product, engineering, and data science teams to align evaluation strategies with business goals, presenting insights via dashboards and reports.
- Analyze evaluation data to identify bottlenecks, optimize model performance, and ensure resource-efficient deployment.
- Refine evaluation methodologies through empirical research, staying updated on emerging techniques to enhance model reliability and value.
Requirements:
- Degree in Computer Science or related field; PhD in NLP, Machine Learning, or similar is preferred, with a strong publication record.
- Proven experience in designing and evaluating AI models at multiple lifecycle stages, with expertise in evaluation metrics and frameworks.
- Strong programming skills and experience building scalable evaluation pipelines, familiar with performance metrics like latency, throughput, and memory footprint.
- Ability to conduct iterative experiments, stay abreast of emerging trends, and refine evaluation practices continuously.
- Experience collaborating with cross-functional teams and translating technical insights into actionable recommendations.
-
AI Model Developer
Há 5 dias
São Paulo, São Paulo, Brasil beBeeArtificialIntelligence Tempo inteiro R$120.000 - R$180.000Job Overview\The Generative AI Development Specialist is responsible for designing and implementing artificial intelligence models to enhance business efficiency, improve decision-making, and boost customer satisfaction.\This role requires expertise in machine learning, natural language processing, and software development. The ideal candidate will have a...
-
AI Engineer Specialist
Há 6 dias
São Paulo, São Paulo, Brasil Digibee Tempo inteiroJoin to apply for the AI Engineer Specialist role at Digibee About Digibee Digibee is an iPaaS that scales integration workflows while reducing cost and technical debt. Rather than require specialized integration experts, Digibee lets every developer quickly build, test, deploy, govern, and monitor integrations across on-premise and cloud environments...
-
Ai Specialist/Engineer
Há 5 dias
São Paulo, São Paulo, Brasil Data Meaning Tempo inteiroAI Specialist/Engineer – Qualified PipelineLocation:BR/LatAm/USA, RemotePosition type:Full-time Contract (Short Term or Long Term)Position SummaryData Meaning is a front-runner in Business Intelligence and Data Analytics consulting, renowned for our high-quality consulting services throughout the US and beyond.Our expertise lies in delivering tailored...
-
AI Specialist/Engineer
2 semanas atrás
São Paulo, São Paulo, Brasil Data Meaning Tempo inteiroAI Specialist/Engineer – Qualified Pipeline Location: BR/LatAm/USA, Remote Position type: Full-time Contract (Short Term or Long Term) Position Summary Data Meaning is a front-runner in Business Intelligence and Data Analytics consulting, renowned for our high-quality consulting services throughout the US and beyond. Our expertise lies in...
-
Generative AI Development Specialist
Há 6 dias
São Paulo, São Paulo, Brasil C6 Bank Tempo inteiroJoin to apply for the Generative AI Development Specialist | AI Engineering role at C6
-
Servicenow AI Specialist
1 dia atrás
São Paulo, São Paulo, Brasil beBeeArtificialIntelligence Tempo inteiro R$80.000 - R$112.000Servicenow Developer JobA career opportunity awaits a skilled Servicenow Developer to spearhead the development and implementation of cutting-edge solutions using ServiceNow's AI capabilities.About the RoleThis position involves collaborating with stakeholders to gather requirements and develop custom applications, integrations, and fine-tuning AI models...
-
Risk Assessment Specialist
Há 6 dias
São Paulo, São Paulo, Brasil beBeeRiskAssessment Tempo inteiro R$1.000.000 - R$1.500.000Job SummaryWe are seeking a highly skilled Risk Assessment Specialist to join our team. As a key member of our underwriting team, you will be responsible for reviewing and assessing potential risks associated with new and existing customers.Main ResponsibilitiesEvaluate customer applications and assess potential risks using sound underwriting judgmentDevelop...
-
Sr. Ai Specialist
Há 5 dias
São Paulo, São Paulo, Brasil Amazon Aws Services Brazil Ltd Tempo inteiroBachelor's degree in computer science or equivalent with 8+ years of relevant working experience, or Master's degree in computer science or equivalent with 5+ years of working experience.- Experiences related to machine learning, deep learning, NLP, CV, GNN, or distributed training.- 5+ years of relevant experience in developing and deploying large scale...
-
Talent Acquisition Assessment Specialist
4 semanas atrás
São Paulo, São Paulo, Brasil Miratech Tempo inteiroCompany DescriptionMiratech helps visionaries change the world. We are a global IT services and consulting company that brings together enterprise and start-up innovation. Today, we support digital transformation for some of the world's largest enterprises. By partnering with both large and small players, we stay at the leading edge of technology, remain...
-
São Paulo, São Paulo, Brasil Zendesk, Inc. Tempo inteiroPrincipal AI Specialist, Customer Success page is loadedPrincipal AI Specialist, Customer Success Apply remote type In Office locations São Paulo, Brazil time type Full time posted on Posted Yesterday job requisition id R32128Job Description The Principal AI Specialist, Customer Success role is a dynamic customer advisory role responsible for getting...
