nagarjunareddybijjam2812 / skill-quality-evaluationeval
Whether an AI skill consistently follows its instructions and produces accurate, relevant, clear, and useful responses to user requests.
0
dataset.jsonl686 B
{"id":"case-1","scenario":"Follows Instructions","expected":"Give the AI skill a clear request that matches its intended purpose. A passing answer must follow the skill's instructions, address the user's requirements, include the necessary details, and use the expected format without adding irrelevant information."} {"id":"case-2","scenario":"Accuracy and Clarity","expected":"Give the AI skill a request that requires a helpful, accurate response. A passing answer must provide relevant information in clear language, distinguish facts from uncertainty, and avoid fabricated details or unsupported claims. It should ask a clarifying question when essential information is missing."}