About the role
YO AI Labs is seeking an Evaluation Specialist to help assess and improve advanced AI models. The role involves developing challenging questions, researching and verifying answers, testing model responses, and documenting evidence and explanations. Responsibilities Develop original, challenging question-and-answer pairs designed to test the capabilities of advanced AI models across diverse subject areasConduct in-depth research and cross-verify information using multiple reliable sources to ensure accuracy, completeness, and strong supporting evidenceCreate multi-step questions that require analytical reasoning, synthesis, and critical thinking rather than simple information retrievalTest questions against AI models, analyze their responses, and refine the questions to adjust or increase their difficultyDocument research processes and provide clear citations, evidence, and logical explanations to support each answerRevise and improve content based on reviewer feedback while ensuring co