3 Commits

Author SHA1 Message Date
Seth Hobson 4ccf9424a4 fix(plugin-eval): address code review findings
- Fix _beta_cdf Simpson's rule lower bound (was 0.001, now 0.0 for a>=1)
- Fix parse_agent crash on YAML-list tools: field (list vs string)
- Replace hardcoded absolute paths with ${CLAUDE_PLUGIN_ROOT}
- Register plugin-eval in marketplace.json
2026-03-26 00:54:01 -04:00
Seth Hobson 8fd490b7c8 fix(plugin-eval): restructure LLM judge as Claude Code native agent
Layer 2 now runs via eval-judge agent using Max plan session auth
instead of Agent SDK subprocess calls. No API key required.
Also fixes composite scoring to exclude unmeasured dimensions.
2026-03-25 20:57:01 -04:00
Seth Hobson b4afcc4063 feat(plugin-eval): add Claude Code plugin shell (commands, agents, skill)
Add plugin.json, three commands (eval/compare/certify), eval-orchestrator agent,
and evaluation-methodology skill to wire plugin-eval into the claude-agents ecosystem.
2026-03-25 17:51:28 -04:00