Multimodal Genai Evaluation Specialist

Job Description:We are seeking a detail-oriented and analytically minded Multimodal GenAI Evaluation Specialist to perform highly nuanced evaluations of AI system outputs across different modalities: text, image, video, and multimodal interactions.The ideal candidate will assess the accuracy, appropriateness, quality, clarity, and cultural alignment of model outputs against complex guidelines ensuring that results align with project standards and real-world use cases.Role Responsibilities:Evaluate outputs generated by LLMs across multiple modalities (text, image captions, video descriptions, and multimodal prompts).Assess quality against project-specific criteria such as correctness, coherence, completeness, style, cultural appropriateness, and safety.Identify subtle errors hallucinations or biases in AI responses.Apply domain expertise and logical reasoning to resolve ambiguous or unclear outputs.Provide detailed written feedback tagging and scoring of outputs to ensure consistency across the evaluation team.Escalate unclear cases and contribute to refining evaluation guidelines.Collaborate with Project Managers and Quality Leads to meet accuracy reliability and turnaround benchmarks.Required Skills and Qualifications:Bachelor's degree/diploma or equivalent educational qualification.1+ years of experience in data annotation LLM evaluation content moderation or related AI/ML domains.Demonstrated experience working with data annotation tools and software platforms.Strong understanding of language and multimodal communication.Ability to adapt quickly to changing project directions and fast-paced work environments.What We Offer:A competitive compensation package, opportunities for professional growth, and a dynamic work environment that values innovation and collaboration.How to Apply:If you are a motivated and detail-oriented individual looking for a challenging role in AI evaluation, please submit your application for consideration.