Seth Hobson 50a9730f05 fix(plugin-eval): address PR review comments ...

P1: Normalize Monte Carlo nested dict sub_scores to flat dimension→float
before blending. Prevents TypeError when deep/thorough runs include MC.

P2: Plugin-level eval always shows "Estimated" confidence since only
Layer 1 runs (judge/MC are per-skill only). Prevents misleading
"Certified" label on plugin-level certify runs.

2026-03-26 17:33:24 -04:00

..

layers

improve: enhance 5 bottom skills + add technical depth signal

2026-03-26 12:05:49 -04:00

__init__.py

feat(plugin-eval): scaffold project with uv, ruff, ty

2026-03-25 17:31:00 -04:00

cli.py

refactor(plugin-eval): simplify — parse once, deduplicate composite, single event loop

2026-03-25 22:13:32 -04:00

corpus.py

refactor(plugin-eval): simplify — parse once, deduplicate composite, single event loop

2026-03-25 22:13:32 -04:00

elo.py

feat(plugin-eval): implement Elo ranking system and corpus management

2026-03-25 17:48:18 -04:00

engine.py

fix(plugin-eval): address PR review comments

2026-03-26 17:33:24 -04:00

models.py

feat(plugin-eval): add Pydantic data models for all eval layers

2026-03-25 17:33:32 -04:00

parser.py

fix(plugin-eval): address code review findings

2026-03-26 00:54:01 -04:00

py.typed

feat(plugin-eval): scaffold project with uv, ruff, ty

2026-03-25 17:31:00 -04:00

reporter.py

feat(plugin-eval): add reporter (JSON/MD/HTML) and Typer CLI with score/certify/compare/init commands

2026-03-25 17:45:34 -04:00

stats.py

fix(plugin-eval): address code review findings

2026-03-26 00:54:01 -04:00