LLMSkillHub
mirroredCopied from kunchenguid/compact-adviser under MIT. kunchenguid has not claimed this page, and is not affiliated with LLM SkillHub.

kunchenguid / judge-evaluation

Use when changing or evaluating judge prompts, scoring thresholds, usage floors, or judgment eval corpora.

0
SKILL.md
747 B
  • Judge design rule, measured: two one-sentence atomic questions composed in code beat any single question that folds two judgments together (TypeSafe's own guidance). Hill-climb prompt changes with eval/tools/earn.py (paired bootstrap) and read the usage-floor ladder with eval/tools/schedule.py; a clause stays only if it earns its place.
  • Judgment eval harness: packages/pi-extension/eval/. Session transcripts, labels, worksheets, and results stay in gitignored eval/local/. See that README for the corpus contract and label rubric.