patil-sudu237 / migration-guard-evaleval

Name: patil-sudu237/migration-guard-eval
Author: patil-sudu237

Measures whether an AI agent reliably identifies production risks in database migrations and recommends safe rollout strategies.

Version

manifest.yaml381 B

1metadata:
2  name: migration-guard-eval
3  id: migration-guard-eval
4  description: Measures whether an AI agent reliably identifies production risks in database migrations and recommends safe rollout strategies.
5  license: MIT
6version: "1.0.0"
7dataset:
8  file_path: dataset.jsonl
9  features:
10    input: scenario
11    expected: expected
12metrics:
13  - name: Pass rate
14    threshold: 0.8