Wire an automated evaluation pipeline instead of a one-time manual grading pass
DONE 2026-07-02: scripts/evaluate-workers.py (built by an opus subagent under a fixed JSON I/O contract, verified by lead). Deterministic: rubric fetched from subagentrubrics.com/rbc_worker_quality, site list from build-graph.json (routes+D1 metadata), 7 mechanical checks (d1_binding, grid_overflow_fix, p3_block, build_lock, mcp_live, rel_alternate, changes_or_citeas), fixed result mapping, every explanation cites check evidence + rubric fragment. 62 eval_auto_* rows POSTed live (e.g. eval_auto_wc2026-bracket); secret read at runtime from the local store, never in repo (py_compile clean, no 32+ hex literals). Rerun on any deploy: python3 scripts/evaluate-workers.py --post.
closes contract: ctr_evaluation_evidence
created 2026-07-01 20:06:48 · updated 2026-07-03 03:51:45