Content Evaluation Specialist
Há 2 dias
Job DescriptioniMerit seeks detail-oriented and analytically minded content evaluation specialists to perform nuanced evaluations of AI system outputs across different modalities: text, image, video, and multimodal interactions.Analysts will assess the accuracy, appropriateness, quality, clarity, and cultural alignment of model outputs against complex guidelines, ensuring that results align with project standards and real-world use cases.These evaluations will directly inform the development and fine-tuning of advanced large language models (LLMs), vision models (LVMs), and multimodal AI systems.Responsibilities:Evaluate outputs generated by LLMs across multiple modalities (text, image captions, video descriptions, and multimodal prompts).Assess quality against project-specific criteria such as correctness, coherence, completeness, style, cultural appropriateness, and safety.Identify subtle errors, hallucinations, or biases in AI responses.Apply domain expertise and logical reasoning to resolve ambiguous or unclear outputs.Provide detailed written feedback, tagging, and scoring of outputs to ensure consistency across the evaluation team.Escalate unclear cases and contribute to refining evaluation guidelines.Collaborate with Project Managers and Quality Leads to meet accuracy, reliability, and turnaround benchmarks.Required Skills and QualificationsBachelor's degree/ diploma or equivalent educational qualification.1+ years of experience in data annotation, LLM evaluation, content moderation, or related AI/ML domains.Demonstrated experience working with data annotation tools and software platforms.Strong understanding of language and multimodal communication (instruction following in image generation, fact-checking, narrative coherence in video, etc.).Ability to adapt quickly to changing project directions and fast-paced work environments.Previous experience creating or annotating complex data specifically for Large Language Model (LLM) training.Prior exposure to generative AI, prompt engineering, or LLM fine-tuning workflows is a plus.BenefitsThis role offers a unique opportunity to apply your analytical skills in a dynamic and innovative environment.As a content evaluation specialist, you will have the chance to contribute to the development of cutting-edge AI technologies and collaborate with a talented team of professionals.
-
Business Specialist
1 semana atrás
Salvador, Brasil Innodata Inc. Tempo inteiroWe are seeking a Subject Matter Expert (SME) with deep expertise in Business Specialist to contribute to the design, review, and validation of high-quality academic and training content.Job Title: Business Specialist Location: Brazil Language: Portuguese Required Education: Business related stream Education Qualification: Masters or PhD (No Bachelor's)...
-
Physics Content Specialist
4 semanas atrás
Salvador, Brasil beBeeContent Tempo inteiroPhysics Content Specialist We're seeking a skilled Physics Content Specialist to join our team. In this role, you will help develop and refine high-quality educational and technical physics content for advanced Large Language Models (LLMs). Your expertise in theoretical and applied physics will directly shape the way AI systems understand, explain, and...
-
Legal Specialist
4 semanas atrás
Salvador, Brasil buscojobs Brasil Tempo inteiroOverview We are seeking a Subject Matter Expert (SME) with deep expertise in Legal Specialist to contribute to the design, review, and validation of high-quality academic and training content. Job Title : Legal Specialist Location : Brazil Language : Portuguese Required Education : Law or Legal related stream Education Qualification : Masters or...
-
Content Evaluator
1 semana atrás
Salvador, Brasil Innodata Inc. Tempo inteiro4 weeks ago Be among the first 25 applicants Get AI-powered advice on this job and more exclusive features. Overview Job Opportunity: Content Quality Assurance Specialist. We are seeking highly analytical and detail-oriented professionals with hands-on experience in testing and evaluating AI-generated content to identify vulnerabilities, assess risks, and...
-
Language Specialist
Há 6 dias
Salvador, Brasil Innodata Inc. Tempo inteiroInnodata (NASDAQ: INOD) is a leading data engineering company. With more than 2,000 customers and operations in 13 cities around the world, we are an AI technology solutions provider-of-choice for 4 out of 5 of the world’s biggest technology companies, as well as leading companies across financial services, insurance, technology, law, and medicine. By...
-
Statistics Specialist
4 semanas atrás
Salvador, Brasil Innodata Inc. Tempo inteiroWe are seeking a Subject Matter Expert (SME) with deep expertise in Statistics to contribute to the design, review, and validation of high-quality academic and training content. Job Title: Statistics Specialist Location: Brazil Language: Portuguese Required Education: Statistics Education Qualification: Masters or PhD (No Bachelor's) Mandatory: LLM...
-
Mathematical Content Expert
4 semanas atrás
Salvador, Brasil Innodata Inc. Tempo inteiroJob Summary: As a Mathematics Specialist, you will play a crucial role in developing high-quality academic and training content with deep expertise in mathematics. Key Responsibilities: Content Development Develop, review, and validate Mathematics-related content, assessments, and training material. Ensure accuracy, clarity, and adherence to academic and...
-
Ai Engineering Content Specialist
Há 5 dias
Salvador, Brasil Bebeeexpert Tempo inteiroJob TitleA Master's or PhD in Engineering, Computer Science or Software Engineering is required for this position.As a Technical Expert, you will design and curate technical content to enhance AI understanding of engineering disciplines.The successful candidate will have expertise in creating high-quality technical content, including problem-solving...
-
Salvador, Brasil Invisible Expert Marketplace Tempo inteiroOverview We’re looking for a Persian Trilingual Language Specialist who can bring deep linguistic knowledge, cultural awareness, and multilingual proficiency to AI training. You’ll work with cutting‑edge AI tools to evaluate, annotate, and refine model outputs in Persian, English, and your third language, helping improve cross‑lingual reasoning,...
-
Mathematical Content Expert
3 semanas atrás
Salvador, Brasil Caderno Nacional Tempo inteiroOverview Mathematics Specialist job description: This is a unique opportunity to utilize your mathematical expertise to contribute to the creation of high-quality educational content. As a Mathematics Specialist, you will be responsible for developing and reviewing mathematical content, ensuring accuracy and clarity, and collaborating with cross-functional...
