Garry Tan and Claude Opus 4.8
073d311327
fix(skillopt): budget no-pricing for Haiku silently scored every rollout 0
...
Surfaced by the SkillOpt real-LLM eval (Track B). Two coupled bugs that made
a budget-capped Haiku run report a vacuous "0/N" measurement in ~2ms with
zero LLM calls — indistinguishable from a real deficient-skill score:
1. Claude Haiku 4.5's canonical dateless id (`claude-haiku-4-5`) was missing
from anthropic-pricing.ts (only the dated `-20251001` was present). With
`--max-cost` set, BudgetTracker.reserve() threw no_pricing on the FIRST
chat() of every rollout. Added the dateless entry (sonnet already had its
dateless form).
2. runValidationGate swallowed that BUDGET_EXHAUSTED error — runWithLimit
settled it as {ok:false}, which the gate turned into median:0. A pricing/cap
crash became a fake score. The gate now scans settled results for
isMustAbortError() and re-throws so the caller aborts loudly; ordinary
(non-abort) rollout errors still fail-open to 0 (judge-hiccup posture kept).
Pinned by test/skillopt/validate-gate-abort.test.ts (3 cases). Folds into the
open v0.42.9.0 PR (#1759 ).
Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com >
2026-06-01 23:25:57 -07:00
..
2026-06-01 23:20:28 -07:00
2026-05-22 13:38:07 -07:00
2026-06-01 23:03:09 -07:00
2026-05-24 21:50:08 -07:00
2026-05-30 09:14:14 -07:00
2026-06-01 22:13:19 -07:00
2026-05-24 22:56:21 -07:00
2026-05-24 09:30:57 -07:00
2026-04-29 23:46:36 -07:00
2026-05-14 19:13:14 -07:00
2026-06-01 21:54:13 -07:00
2026-05-10 20:06:31 -07:00
2026-06-01 22:13:19 -07:00
2026-05-22 11:53:11 -07:00
2026-05-22 13:38:07 -07:00
2026-06-01 22:13:19 -07:00
2026-05-22 13:38:07 -07:00
2026-05-22 22:37:15 -07:00
2026-06-01 20:16:37 -07:00
2026-05-27 07:16:30 -07:00
2026-05-10 06:34:40 -07:00
2026-05-27 08:27:05 -07:00
2026-06-01 21:54:13 -07:00
2026-05-24 22:56:21 -07:00
2026-06-01 22:01:14 -07:00
2026-05-27 07:01:28 -07:00
2026-05-11 19:25:48 -07:00
2026-05-26 17:31:48 -07:00
2026-05-26 18:59:17 -07:00
2026-05-17 08:00:29 -07:00
2026-05-30 14:56:26 -07:00
2026-06-01 23:03:09 -07:00
2026-05-20 13:55:12 -07:00
2026-06-01 23:25:57 -07:00
2026-05-19 18:12:01 -07:00
2026-04-22 01:34:22 -07:00
2026-05-10 06:34:40 -07:00
2026-06-01 21:54:13 -07:00
2026-06-01 23:25:57 -07:00
2026-05-02 08:41:11 -07:00
2026-05-22 22:16:25 -07:00
2026-05-20 13:55:12 -07:00
2026-05-23 10:01:08 -07:00
2026-05-23 08:49:28 -07:00
2026-05-22 11:53:11 -07:00
2026-05-26 23:15:44 -07:00
2026-05-09 20:46:34 -07:00
2026-05-19 17:14:53 -07:00
2026-04-14 19:41:34 -10:00
2026-05-23 08:49:28 -07:00
2026-05-02 22:01:05 -07:00
2026-05-26 18:59:17 -07:00
2026-05-24 10:49:56 -07:00
2026-05-25 14:56:38 -07:00
2026-05-25 20:00:03 -07:00
2026-05-11 22:54:35 -07:00
2026-05-25 14:20:19 -07:00
2026-05-23 10:01:08 -07:00
2026-05-10 18:59:11 -07:00
2026-06-01 23:03:09 -07:00
2026-06-01 19:09:15 -07:00
2026-05-08 13:25:48 -07:00
2026-05-25 12:48:55 -07:00
2026-05-23 10:57:32 -07:00
2026-05-24 10:49:56 -07:00
2026-06-01 23:03:09 -07:00
2026-05-11 21:49:57 -07:00
2026-05-23 08:49:28 -07:00
2026-05-23 08:49:28 -07:00
2026-06-01 22:13:19 -07:00
2026-04-14 19:41:34 -10:00
2026-05-26 16:58:18 -07:00
2026-05-28 19:04:48 -07:00
2026-05-03 20:41:39 -07:00
2026-04-29 22:21:07 -07:00
2026-06-01 23:03:09 -07:00
2026-05-25 14:56:38 -07:00
2026-05-20 13:55:12 -07:00
2026-05-07 21:52:58 -07:00
2026-05-23 10:21:59 -07:00
2026-05-25 14:43:12 -07:00
2026-05-24 10:49:56 -07:00
2026-05-30 10:30:56 -07:00
2026-05-23 08:49:28 -07:00
2026-05-26 18:29:03 -07:00
2026-05-15 18:54:36 -07:00
2026-05-30 10:30:56 -07:00
2026-05-27 08:50:53 -07:00
2026-04-11 00:01:09 -10:00
2026-06-01 23:03:09 -07:00
2026-05-11 19:25:48 -07:00
2026-04-25 12:25:34 -07:00
2026-05-14 19:13:14 -07:00
2026-05-01 09:02:43 -07:00
2026-05-18 21:26:12 -07:00
2026-05-26 18:59:17 -07:00
2026-05-26 18:59:17 -07:00
2026-05-26 18:59:17 -07:00
2026-05-30 11:21:56 -07:00
2026-04-29 23:46:36 -07:00
2026-05-23 10:21:59 -07:00
2026-05-11 19:25:48 -07:00
2026-04-22 01:34:22 -07:00
2026-05-20 13:55:12 -07:00
2026-04-29 23:46:36 -07:00
2026-05-21 09:26:37 -07:00
2026-05-30 10:56:46 -07:00
2026-05-17 08:00:29 -07:00
2026-05-30 12:34:43 -07:00
2026-05-14 20:51:11 -07:00
2026-06-01 23:03:09 -07:00
2026-04-05 12:48:10 -07:00
2026-05-25 14:20:19 -07:00
2026-05-21 18:57:05 -07:00
2026-06-01 22:28:20 -07:00
2026-05-27 07:01:28 -07:00
2026-05-09 19:47:56 -07:00
2026-06-01 22:28:20 -07:00
2026-05-26 18:59:17 -07:00
2026-05-27 07:16:30 -07:00
2026-06-01 21:54:13 -07:00
2026-05-25 20:00:03 -07:00
2026-05-10 13:33:05 -07:00
2026-05-25 09:57:30 -07:00
2026-05-27 06:30:46 -07:00
2026-05-30 13:11:25 -07:00
2026-06-01 23:05:09 -07:00
2026-05-06 21:14:34 -07:00
2026-05-23 08:49:28 -07:00
2026-05-23 10:21:59 -07:00
2026-06-01 23:03:09 -07:00
2026-04-22 01:34:22 -07:00
2026-06-01 22:28:20 -07:00
2026-05-26 17:31:48 -07:00
2026-06-01 23:03:09 -07:00
2026-05-09 20:46:34 -07:00
2026-05-25 14:43:12 -07:00
2026-05-23 10:57:32 -07:00
2026-06-01 23:03:09 -07:00
2026-05-11 23:20:17 -07:00
2026-05-22 11:53:11 -07:00
2026-05-23 08:49:28 -07:00
2026-05-07 22:56:22 -07:00
2026-05-18 12:53:01 -07:00
2026-05-23 10:01:08 -07:00
2026-05-10 13:20:07 -07:00
2026-05-25 19:43:20 -07:00
2026-05-25 15:10:23 -07:00
2026-06-01 22:01:14 -07:00
2026-06-01 22:28:20 -07:00
2026-05-25 12:48:55 -07:00
2026-06-01 22:28:20 -07:00
2026-05-22 13:38:07 -07:00
2026-04-27 22:59:08 -07:00
2026-05-22 21:18:09 -07:00
2026-05-20 13:55:12 -07:00
2026-05-30 13:11:25 -07:00
2026-05-20 13:55:12 -07:00
2026-05-20 13:55:12 -07:00
2026-04-23 19:34:27 -07:00
2026-05-25 20:00:03 -07:00
2026-05-14 20:51:11 -07:00
2026-05-23 10:21:59 -07:00
2026-05-30 10:56:46 -07:00
2026-05-22 21:04:30 -07:00
2026-05-25 19:53:59 -07:00
2026-05-30 10:56:46 -07:00
2026-05-30 14:58:40 -07:00
2026-05-19 17:14:53 -07:00
2026-05-09 22:58:19 -07:00
2026-05-19 17:14:53 -07:00
2026-04-29 22:21:07 -07:00
2026-04-09 10:17:13 -07:00
2026-05-08 13:25:48 -07:00
2026-05-26 18:29:03 -07:00
2026-06-01 23:03:09 -07:00
2026-05-30 11:21:56 -07:00
2026-05-20 09:19:18 -07:00
2026-05-25 14:56:38 -07:00
2026-05-10 18:59:11 -07:00
2026-05-25 14:43:12 -07:00
2026-05-23 10:21:59 -07:00
2026-05-22 22:37:15 -07:00
2026-05-17 18:52:38 -07:00
2026-04-14 19:41:34 -10:00
2026-05-07 21:52:58 -07:00
2026-06-01 23:03:09 -07:00
2026-05-08 13:25:48 -07:00
2026-05-08 13:25:48 -07:00
2026-05-06 21:14:34 -07:00
2026-06-01 22:28:20 -07:00
2026-05-08 13:25:48 -07:00
2026-05-26 18:29:03 -07:00
2026-05-30 09:14:14 -07:00
2026-04-09 10:17:13 -07:00
2026-05-06 11:54:06 -07:00