sakthivelksakthi217 / student-career-growth-mentor-evaluationeval

Name: sakthivelksakthi217/student-career-growth-mentor-evaluation
Author: sakthivelksakthi217

Measures whether a career-mentor AI provides personalized, realistic, actionable career roadmaps for students without inventing resources or promising guaranteed jobs.

Version

manifest.yaml524 B

1version: "0.1.1"
2metadata:
3  name: "Student Career Growth Mentor Evaluation"
4  id: "student-career-growth-mentor-evaluation"
5  description: "Checks whether a career guidance assistant gives personalized, realistic, actionable roadmaps for students."
6  license: "MIT"
7dataset:
8  format: "jsonl"
9  file_path: "./dataset.jsonl"
10  features:
11    input: "scenario"
12    expected_output: "expected"
13evaluation_type:
14  method: "llm_as_a_judge"
15  rubrics_directory: "./rubrics"
16  metrics:
17    - name: "Pass rate"
18      threshold: 0.8