preethikaaridass / traceloc-bug-localizationeval
Checks whether an agent ranks the right suspicious files with evidence and avoids auto-fixing or claiming an unproven root cause.
0
manifest.yaml331 B
version: "1.0.0" metadata: id: traceloc-bug-localization name: TraceLoc Bug Localization Eval description: Checks whether an agent ranks the right suspicious files with evidence and avoids auto-fixing or claiming an unproven root cause. dataset: file_path: dataset.jsonl features: input: input expected: expected