* fix(conversation-parser): threshold-gated fallback + acceptance floor (closes#1533)
`gbrain conversation-parser scan` reported `phase: no_match` on meeting
pages where 175 of 226 lines (77.8%) were valid `imessage-slack` format.
The 36 reformatted Circleback meetings could not flow through the
conversation facts pipeline.
Root cause: `scorePattern` only scans the first 10 non-blank lines. A
meeting page's `## Summary` + blockquote + `## Transcript` preamble takes
all 10 head slots, so every pattern scored 0 and the orchestrator
short-circuited to `no_match` without ever seeing the transcript.
Fix: two-tier scoring with threshold gates.
1. Fast path unchanged: chat-only pages match on line 1, scoring 1.0,
skipping the fallback entirely.
2. Full-body fallback fires when `top.score < SCORING_HEAD_TRIGGER_THRESHOLD`
(0.3). NOT `=== 0` — Codex P1 #1 caught the bug class where a stray
head match (blockquote that accidentally matches an unrelated
pattern at 0.1) would suppress the fallback. 0.3 leaves the fast
path untouched while triggering on any preamble-dominated page.
3. Minimum acceptance floor `SCORING_MIN_ACCEPTANCE` (0.05) prevents
essay false positives: a 300-line essay with one stray
`**Name** (date time):` line scores ~0.003 — without the floor it
would flip to `regex_match` with `messages.length = 1`. Closes
Codex P1 #2.
DRY refactor: extract `getNonBlankLines` + `scoreFromLines` so the
quick_reject + regex loop lives in one place. New exported
`scorePatternFull` for direct unit testing. Fallback pre-splits the
body ONCE per pass to avoid 12 redundant splits.
Plan + decisions + Codex consult absorption at:
~/.claude/plans/system-instruction-you-are-working-starry-frost.md
Tests: 10 new cases in test/conversation-parser/parse.test.ts (87
pass). Highlights:
- #1533 IRON-RULE regression pin (meeting page → regex_match,
imessage-slack, 20 messages)
- Stray-head-match guard (Codex P1 #1: irc-classic 0.1 in head does
not suppress fallback; imessage-slack wins on full body)
- Essay false-positive guard (Codex P1 #2: 1/301 score below
acceptance floor stays no_match)
- 300-line preamble + 50 chat lines hits fallback
- Cap test reshaped (Codex P2 #6): pins behavior not constant value
Once landed and a brain has `cycle.conversation_facts_backfill.enabled
= true` (opt-in), the 36 Circleback meetings flow through the fact
extractor automatically. Operators on the manual path run
`gbrain extract-conversation-facts <source>` directly.
Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
* feat(conversation-parser): add bold-paren-time built-in pattern (closes user-facing half of #1533)
Per /codex follow-up D-FOLLOWUP-1.B: the threshold-gated fallback fix
(8d7a18ac) closed the bug CLASS — but the user's actual 112 Circleback
meeting files at ~/git/brain/meetings/ use a transcript shape that no
existing built-in pattern matches:
**Participant 2** (00:00): Companies that we... ← (HH:MM)
**Participant 1** (00:00:00): We found the... ← (HH:MM:SS)
Without a pattern that matches this shape, even the fallback re-scoring
all 12 candidates against the full body returned zero matches → no_match.
Add `bold-paren-time` as the 13th built-in. Two sub-shapes covered via
non-capturing optional seconds group; capture indexes stay identical.
date_source: frontmatter so the page's `date:` provides the day anchor.
Time semantics: Circleback timestamps are elapsed-time-from-meeting-
start, not wall-clock. Parser treats them as wall-clock 24h on the
frontmatter date, so every message lands on the same day at HH:MM. The
fact extractor only cares about speaker + content, so this is honest
enough; precise per-line wall-clock would need an elapsed_time flag on
PatternEntry (v0.42+ scope).
Declaration position: after imessage-slack and telegram-bracket so on
the rare tie those more-specific patterns win. The regex requires `\)`
immediately after the time group, so imessage-slack's
`(2024-03-15 9:00 AM)` shape falls through correctly.
EMPIRICAL RESULT against all Circleback meetings in ~/git/brain/meetings:
- 367 total files with `source: circleback`
- Pre-fix: 0 parsed (no pattern matched the shape)
- Post-fix: 113 parsed (112 via bold-paren-time, 1 via telegram-bracket)
- 20,167 messages flow through to the fact extractor (was 0)
- 254 remain no_match (notes-only meetings without inline transcripts —
transcripts in those cases live in separate files referenced via
blockquote, not in the meeting body)
Smoke-tested manually against 3 representative files:
- 2026-03-19-yc-partner-strategy-ai-leverage-review.md → 225 messages
- 2026-01-15-ro-khanna-c4.md → 294 messages
- 2026-04-01-narrative-arc-equity-regrets.md → 9 messages (HH:MM:SS variant)
Tests: 54 unit cases pass (88 across full parser suite). 3 new cases in
parse.test.ts pin the contract: (HH:MM) shape matches, (HH:MM:SS) shape
matches, imessage-slack still wins on full-datetime overlap, and meeting
page with preamble + bold-paren-time transcript hits the threshold
fallback correctly.
Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
* chore: bump version and changelog (v0.41.21.0)
Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
* docs: bump conversation-parser entry to v0.41.21.0 (13 patterns + threshold gates)
Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
* fix(privacy): scrub OpenClaw fork name from new pattern's source_doc + CLAUDE.md
CI verify failed on check:privacy — the new bold-paren-time pattern
added in 80208f21 referenced the private OpenClaw fork name in
builtins.ts:125 (comment) and builtins.ts:178 (source_doc), and the
CLAUDE.md doc-sync commit 1710020a leaked it once more.
CLAUDE.md privacy rule (line 550): the private fork name is banned
in CHANGELOG.md, README.md, docs/, skills/, PR titles + bodies,
commit messages, and comments in checked-in code. Canonical
replacement: "your OpenClaw" or "OpenClaw reference deployment".
This commit rewrites all three sites. Source pipeline attribution
stays accurate ("OpenClaw meeting-ingestion pipeline reformat of
Circleback transcripts") without naming the specific private fork.
bun run verify: 28/28 green.
Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
* chore: bump version 0.41.21.0 → 0.41.24.0
Queue reservation by user — 0.41.22.0 / 0.41.23.0 slots left for
sibling worktrees. Bumps VERSION, package.json, CHANGELOG header,
and the CLAUDE.md entry's version tag in lockstep. llms-full.txt
regenerated.
bun run verify: 28/28 green. Parser tests: 92/92.
Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
---------
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
