Garry Tan a1476af084 feat(eval): BrainBench corpus — 141 fixtures, sealed gold, generator, schemas, committed baseline ...

Deterministic generator (Mulberry32 seed 42, whole-cloth fictional universe,
template prose with controlled difficulty incl. documented v1 reflex limits)
emits 135 fixtures + sealed gold across 7 categories with a 15% holdout
split; 6 hand-authored spike fixtures froze the schema. Published JSON
Schemas are the foreign-runner contract. Gold validated by blind double-label
(96.4% agreement; findings fixed, receipt in _ledger.json). Privacy guard
extended over the new corpus dirs.

2026-06-12 12:06:03 -07:00

..

main.json

feat(eval): BrainBench corpus — 141 fixtures, sealed gold, generator, schemas, committed baseline

2026-06-12 12:06:03 -07:00