Multimodal Ai Evaluator

Job Title: Multimodal AI EvaluatorWe are seeking a highly skilled and detail-oriented professional to evaluate the accuracy, appropriateness, and quality of AI system outputs across multiple modalities.The successful candidate will assess the performance of large language models (LLMs), vision models (LVMs), and multimodal AI systems against complex guidelines, ensuring that results align with project standards and real-world use cases.This is a challenging role that requires strong analytical skills, attention to detail, and the ability to work in a fast-paced environment.Responsibilities:Evaluate outputs generated by LLMs and LVMs across multiple modalities (text, image captions, video descriptions, and multimodal prompts).Assess quality against project-specific criteria such as correctness, coherence, completeness, style, cultural appropriateness, and safety.Identify subtle errors, hallucinations, or biases in AI responses.Apply domain expertise and logical reasoning to resolve ambiguous or unclear outputs.Provide detailed written feedback, tagging, and scoring of outputs to ensure consistency across the evaluation team.Escalate unclear cases and contribute to refining evaluation guidelines.Collaborate with Project Managers and Quality Leads to meet accuracy, reliability, and turnaround benchmarks.Requirements:Bachelor's degree/diploma or equivalent educational qualification.1+ years of experience in data annotation, LLM evaluation, content moderation, or related AI/ML domains.Demonstrated experience working with data annotation tools and software platforms.Strong understanding of language and multimodal communication (instruction following in image generation, fact-checking, narrative coherence in video, etc.).Ability to adapt quickly to changing project directions and fast-paced work environments.Prior exposure to generative AI, prompt engineering, or LLM fine-tuning workflows is a plus.BenefitsAs a Multimodal AI Evaluator, you will have the opportunity to work on cutting-edge projects, collaborate with a talented team, and develop your skills in AI and ML.Our company values innovation, teamwork, and excellence, and we offer a dynamic and supportive work environment that allows you to grow professionally and personally.Additionally, our benefits package includes competitive compensation, comprehensive health insurance, and opportunities for professional development.