mirror of
https://github.com/garrytan/gbrain.git
synced 2026-07-27 22:15:33 +00:00
* fix(doctor,entities): supervisor crash classification + bare-name resolver + stub guard - doctor.ts/jobs.ts: classify worker exits with code !== 0 as real crashes vs code === 0 clean restarts (separate counter); fixes false-positive WARN on healthy supervisors - entities/resolve.ts: prefix-expansion step between fuzzy match and slugify fallback catches bare first names that score too low on pg_trgm; picks highest-connection candidate as tiebreaker - facts/fence-write.ts: stub-creation guard refuses to spawn unprefixed entity pages at brain root - facts/backstop.ts: routes stubGuardBlocked facts to engine.insertFact so the fact still persists even when no markdown file is created - docs/issues/doctor-auto-heal-and-scoring.md: spec for follow-up doctor health-score improvements - .gitignore: guard reports/network-intelligence/ (private brain exports) Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com> * chore(privacy): scrub real names from entity-resolve test fixtures and JSDoc Replace YC partner names with placeholders per CLAUDE.md privacy rule: alice-example, bob-example, charlie-example, dave-example. Stripe and Stripe Atlas retained (allowed household brands; exercises the two-word company-prefix case). Test semantics preserved: - Alice / Dave: single-match cases - Bob / Charlie: multi-match tiebreaker cases (winner has more chunks) All 13 entity-resolve cases pass with the scrubbed fixtures. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com> * refactor(supervisor): extract classifyWorkerExit() helper (DRY) Three call sites were inline-classifying worker exits: supervisor's restart policy (child-worker-supervisor.ts:291), doctor's supervisor check (doctor.ts:1016), and jobs supervisor status (jobs.ts:806). Same rule, three copies — drift risk if one is updated without the others. Extract to src/core/minions/exit-classification.ts as a pure function. Signature consumes audit-JSON shape ({ code: number | null }) so doctor and jobs (which read serialized events from JSONL) and supervisor (which reads Node's exit callback) call the same function. Helper's classification rule: code === 0 → clean_exit, everything else (non-zero, null, undefined, missing) → crash. Default-to-crash prevents corrupted rows from silently demoting into the clean-restart bucket. 5 hermetic unit tests (test/exit-classification.test.ts) pin all edge cases. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com> * feat(facts): audit + sunset comment for stub-guard fires Wire telemetry into the v0.34.5 stub-guard at fence-write.ts:190. Every guard fire now appends a JSONL line to ~/.gbrain/audit/stub-guard-YYYY-Www.jsonl with {ts, slug, source_id, fact_count}. Operator visibility for the sunset criterion: when the new audit log reads <5 hits/week for 3 consecutive weeks on production brains, the prefix-expansion in resolveEntitySlug is sufficient and the guard can be removed in v0.36. Reader (readRecentStubGuardEvents) deliberately diverges from supervisor-audit.ts:readSupervisorEvents — it reads BOTH the current AND previous ISO-week file before filtering by ts. supervisor-audit's reader only reads the current week, which loses 24h-window correctness across Monday 00:00 UTC (a Sunday 23:55 event lives in last week's file). The 2-file read costs nothing and makes the window actually 24h. 9 hermetic unit tests pin filename math, the writer's swallows-errors contract, the cross-week-boundary read, sort order, missing-file behavior, and malformed-row tolerance. The cross-week test is the regression guard: if a future refactor copies the supervisor's single-file pattern, that test fails. Follow-up TODO (not in this PR): fix readSupervisorEvents to use the same 2-file pattern. The new stub-guard reader becomes the canonical template to copy back. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com> * feat(doctor): stub_guard_24h check surfaces resolver gaps Adds a new doctor check that reads ~/.gbrain/audit/stub-guard-YYYY-Www.jsonl (via the dual-week-aware reader from T8) and surfaces the 24h fire count. WARN at >10 fires — at that rate the prefix-expansion in resolveEntitySlug is probably missing a case (typo prefix, alias, non-Latin script) and operators should grep the audit log for the offending slugs. Below the threshold but non-zero shows as OK with a count, so operators can watch the v0.36 sunset criterion (<5/week for 3 weeks → guard can be removed). Zero hits emits no check, keeping the doctor output clean on healthy brains. 5 source-grep regression tests pin the contract: check name, WARN threshold, fix hint mentions the audit log + the resolver function name, reader is the dual-week-aware variant (NOT the supervisor-audit single- week pattern), and zero-hits stays silent. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com> * test(facts): pin stub-guard contract at writeFactsToFence + backstop layers - fence-write.test.ts: 3 new cases for the v0.34.5 stub guard. Bare slugs return {inserted: 0, stubGuardBlocked: true, ids: []} and create no file/.tmp at brain root. Prefixed slugs bypass the guard (regression guard against accidentally inverting the slug.includes('/') check). Empty facts array short-circuits before the guard fires. - facts-backstop.test.ts: 1 new case for the end-to-end routing. A bare-name LLM extraction resolves through to a bare slug, hits the guard, and lands in the facts table via engine.insertFact (DB-only). No phantom .md file; entity_slug stores the bare slug; source_markdown_slug is null. This is the routing contract Codex flagged as a "split-brain" data shape — the test pins the by-design behavior so a future refactor can't silently drop these facts. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com> * test(supervisor): pin classifyWorkerExit consumer wire-up + regressions 12 new cases on top of the 5 helper unit tests: - doctor.ts / jobs.ts / child-worker-supervisor.ts each import the helper - All three call classifyWorkerExit at least once - doctor.ts and jobs.ts no longer carry the pre-T7 inline filter - supervisor uses the helper result to choose the clean_exit branch - audit-event shape round-trip: code=0 → clean_exit, code=1 → crash, code=null+SIGKILL → crash (catches future shape changes) The regression guards (3) and the wire-up checks (6) close the gap that motivated T7 in the first place: if a future change accidentally re-inlines the filter or shifts the audit event shape, the test fails before production sees the silent divergence. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com> * perf(entities): correlated subqueries scoped to slug-LIKE candidates Replace the derived-table JOIN shape in tryPrefixExpansion with correlated subqueries. The pre-fix SQL did LEFT JOIN (SELECT to_page_id, COUNT(*) FROM links GROUP BY to_page_id) li ON ... which forced the planner to aggregate the entire links + content_chunks tables on every prefix-expansion call — O(N) per call where N is total links/chunks in the brain. On a 100K-link / 50K-chunk brain that's slow enough to bottleneck fact-extraction. New shape uses correlated subqueries: (SELECT COUNT(*) FROM links WHERE to_page_id = p.id) + (SELECT COUNT(*) FROM links WHERE from_page_id = p.id) + (SELECT COUNT(*) FROM content_chunks WHERE page_id = p.id) The slug LIKE filter is already selective (typical brain has 0-5 pages per prefix), so the three subqueries run N≈3 times per matched row against the existing indexes on links.to_page_id, links.from_page_id, and content_chunks.page_id. Behavior preserved: 13/13 entity-resolve tests pass (single-match + multi-match tiebreaker + edge cases). Codex's outside-voice review caught the dead-end design that an earlier draft of this plan proposed (a CTE with `LIMIT 50` candidate cap — would have excluded correct high-connection candidates if their slug sorted late). Correlated subqueries without a candidate cap are the cleaner shape that lets the LIKE filter do the bounding work. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com> * test(entities): perf regression guard for prefix-expansion (58x speedup) Hermetic PGLite benchmark with 5K pages + 50K links + 25K chunks. Runs the pre-T12 derived-table shape and the new correlated-subquery shape side-by-side against the same fixture, asserts NEW >= 5x faster than OLD. Baseline-ratio, not absolute wall-clock — different machines / Bun versions / CI load can shift absolute timings by 10x without indicating a real regression, but the SHAPE difference between "aggregate the full tables" and "correlated subquery per candidate" is what we care about. Measured: old_median=18.16ms, new_median=0.31ms, speedup=58.22x. The 5x assertion has plenty of headroom. The OLD SQL is embedded verbatim as the regression baseline. If a future refactor re-introduces full-table aggregation (LEFT JOIN against SELECT...GROUP BY over the whole links or content_chunks table), the test fails. PGLite-only — Postgres planner can shape derived-table JOINs differently enough that the 5x ratio could be noise on a 5K-page fixture. The structural correctness of the rewrite is the same on both; this is purely a planner-shape regression guard. .slow.test.ts suffix keeps it out of the fast loop (run via `bun run test:slow`). Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com> * chore: bump version and changelog (v0.35.2.0) Wave content: - Privacy scrub: PII rebuilt out of branch history; real names → placeholders - Bug fix: doctor + jobs no longer count clean worker exits as crashes - Bug fix: entity resolver prefix-expansion catches bare first names - DRY refactor: classifyWorkerExit() helper (one rule, 3 call sites) - Observability: stub_guard_24h doctor check + ISO-week audit log - Perf: 58x speedup on tryPrefixExpansion query shape Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com> * fix: rebump v0.35.2.0 → v0.35.4.0 + scrub TODOS.md privacy violation VERSION/package.json/CHANGELOG header rebumped to v0.35.4.0 per user request (queue allocation). TODOS.md rephrased to not literally name the banned private-agent string — that was the CI failure root cause on the v0.35.2.0 push. CHANGELOG.md is on check-privacy.sh's allow-list (meta-documentation exception); TODOS.md is not. CI re-runs against this commit. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com> --------- Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
200 lines
8.8 KiB
TypeScript
200 lines
8.8 KiB
TypeScript
import { describe, it, expect } from 'bun:test';
|
|
import { mkdirSync, writeFileSync, readFileSync, rmSync, existsSync } from 'node:fs';
|
|
import { join } from 'node:path';
|
|
import { tmpdir } from 'node:os';
|
|
import { withEnv } from './helpers/with-env.ts';
|
|
import {
|
|
computeStubGuardAuditFilename,
|
|
readRecentStubGuardEvents,
|
|
logStubGuardEvent,
|
|
} from '../src/core/facts/stub-guard-audit.ts';
|
|
|
|
/** Make a fresh tempdir for one test's audit files. Caller is responsible for cleanup. */
|
|
function freshTmpDir(): string {
|
|
const dir = join(tmpdir(), `stub-guard-audit-test-${Date.now()}-${Math.random().toString(36).slice(2)}`);
|
|
mkdirSync(dir, { recursive: true });
|
|
return dir;
|
|
}
|
|
|
|
describe('computeStubGuardAuditFilename', () => {
|
|
it('produces ISO-week filename for a mid-week date', () => {
|
|
// 2026-05-13 is a Wednesday in ISO week 20 of 2026.
|
|
const filename = computeStubGuardAuditFilename(new Date('2026-05-13T12:00:00Z'));
|
|
expect(filename).toBe('stub-guard-2026-W20.jsonl');
|
|
});
|
|
|
|
it('handles ISO year-boundary correctly (2027-01-01 is W53 of 2026)', () => {
|
|
// The ISO-week standard: 2027-01-01 (Friday) belongs to W53 of 2026
|
|
// because W1 of 2027 starts on Monday 2027-01-04.
|
|
const filename = computeStubGuardAuditFilename(new Date('2027-01-01T12:00:00Z'));
|
|
expect(filename).toBe('stub-guard-2026-W53.jsonl');
|
|
});
|
|
});
|
|
|
|
describe('logStubGuardEvent', () => {
|
|
it('appends a JSONL line to the current ISO-week file', async () => {
|
|
const tmpAuditDir = freshTmpDir();
|
|
try {
|
|
await withEnv({ GBRAIN_AUDIT_DIR: tmpAuditDir }, async () => {
|
|
logStubGuardEvent({ slug: 'alice', source_id: 'default', fact_count: 3 });
|
|
const filename = computeStubGuardAuditFilename();
|
|
const fullPath = join(tmpAuditDir, filename);
|
|
expect(existsSync(fullPath)).toBe(true);
|
|
const content = readFileSync(fullPath, 'utf8');
|
|
const lines = content.trim().split('\n');
|
|
expect(lines.length).toBe(1);
|
|
const obj = JSON.parse(lines[0]);
|
|
expect(obj.slug).toBe('alice');
|
|
expect(obj.source_id).toBe('default');
|
|
expect(obj.fact_count).toBe(3);
|
|
expect(typeof obj.ts).toBe('string');
|
|
expect(obj.ts).toMatch(/^\d{4}-\d{2}-\d{2}T/);
|
|
});
|
|
} finally {
|
|
if (existsSync(tmpAuditDir)) rmSync(tmpAuditDir, { recursive: true, force: true });
|
|
}
|
|
});
|
|
|
|
it('never throws when audit dir is unwritable', async () => {
|
|
// Point GBRAIN_AUDIT_DIR at a file (not a directory) — mkdirSync will fail,
|
|
// appendFileSync will fail. Both should be swallowed.
|
|
const blockerFile = join(tmpdir(), `stub-guard-blocker-${Date.now()}.txt`);
|
|
writeFileSync(blockerFile, 'this is a regular file');
|
|
try {
|
|
await withEnv({ GBRAIN_AUDIT_DIR: blockerFile }, async () => {
|
|
expect(() => logStubGuardEvent({ slug: 'bob', source_id: 'default', fact_count: 1 })).not.toThrow();
|
|
});
|
|
} finally {
|
|
if (existsSync(blockerFile)) rmSync(blockerFile);
|
|
}
|
|
});
|
|
});
|
|
|
|
describe('readRecentStubGuardEvents — cross-week-boundary correctness', () => {
|
|
it('reads events from BOTH current and previous ISO-week files', async () => {
|
|
// Simulate "Monday 00:01 UTC just after a Sunday 23:55 UTC fire."
|
|
// The Sunday event is in last week's file; the Monday read window
|
|
// must surface it. This is the case readSupervisorEvents misses.
|
|
const tmpAuditDir = freshTmpDir();
|
|
try {
|
|
await withEnv({ GBRAIN_AUDIT_DIR: tmpAuditDir }, async () => {
|
|
const fakeNow = new Date('2026-05-11T00:01:00Z'); // Monday W20 2026
|
|
const prevSunday = new Date('2026-05-10T23:55:00Z'); // Sunday W19 2026
|
|
const earlierInWindow = new Date('2026-05-10T00:30:00Z'); // earlier in 24h window, W19
|
|
const outsideWindow = new Date('2026-05-09T12:00:00Z'); // outside 24h window, W19
|
|
const earlyMonday = new Date('2026-05-11T00:00:30Z'); // current week, in window
|
|
|
|
const prevWeekFile = computeStubGuardAuditFilename(prevSunday);
|
|
const currentFile = computeStubGuardAuditFilename(fakeNow);
|
|
|
|
// Sanity: they MUST be different files for this regression test to mean anything.
|
|
expect(prevWeekFile).not.toBe(currentFile);
|
|
|
|
// Manually write to both files (bypass writer to control timestamps).
|
|
const prevPath = join(tmpAuditDir, prevWeekFile);
|
|
const currentPath = join(tmpAuditDir, currentFile);
|
|
writeFileSync(prevPath, [
|
|
JSON.stringify({ ts: outsideWindow.toISOString(), slug: 'too-old', source_id: 'default', fact_count: 1 }),
|
|
JSON.stringify({ ts: earlierInWindow.toISOString(), slug: 'monday-prev-week', source_id: 'default', fact_count: 1 }),
|
|
JSON.stringify({ ts: prevSunday.toISOString(), slug: 'sunday-late', source_id: 'default', fact_count: 1 }),
|
|
].join('\n') + '\n');
|
|
writeFileSync(currentPath, [
|
|
JSON.stringify({ ts: earlyMonday.toISOString(), slug: 'monday-current-week', source_id: 'default', fact_count: 1 }),
|
|
].join('\n') + '\n');
|
|
|
|
// Read with a 24h window relative to fakeNow.
|
|
const events = readRecentStubGuardEvents({ sinceMs: 24 * 60 * 60 * 1000, now: fakeNow });
|
|
const slugs = events.map(e => e.slug);
|
|
|
|
expect(slugs).toContain('sunday-late');
|
|
expect(slugs).toContain('monday-prev-week');
|
|
expect(slugs).toContain('monday-current-week');
|
|
expect(slugs).not.toContain('too-old');
|
|
});
|
|
} finally {
|
|
if (existsSync(tmpAuditDir)) rmSync(tmpAuditDir, { recursive: true, force: true });
|
|
}
|
|
});
|
|
|
|
it('returns events sorted oldest-first', async () => {
|
|
const tmpAuditDir = freshTmpDir();
|
|
try {
|
|
await withEnv({ GBRAIN_AUDIT_DIR: tmpAuditDir }, async () => {
|
|
const now = new Date('2026-05-13T12:00:00Z');
|
|
const filename = computeStubGuardAuditFilename(now);
|
|
const fullPath = join(tmpAuditDir, filename);
|
|
|
|
writeFileSync(fullPath, [
|
|
JSON.stringify({ ts: '2026-05-13T11:00:00Z', slug: 'second', source_id: 'default', fact_count: 1 }),
|
|
JSON.stringify({ ts: '2026-05-13T10:00:00Z', slug: 'first', source_id: 'default', fact_count: 1 }),
|
|
JSON.stringify({ ts: '2026-05-13T11:30:00Z', slug: 'third', source_id: 'default', fact_count: 1 }),
|
|
].join('\n') + '\n');
|
|
|
|
const events = readRecentStubGuardEvents({ sinceMs: 24 * 60 * 60 * 1000, now });
|
|
expect(events.map(e => e.slug)).toEqual(['first', 'second', 'third']);
|
|
});
|
|
} finally {
|
|
if (existsSync(tmpAuditDir)) rmSync(tmpAuditDir, { recursive: true, force: true });
|
|
}
|
|
});
|
|
|
|
it('returns empty array when no files exist', async () => {
|
|
const tmpAuditDir = freshTmpDir();
|
|
try {
|
|
await withEnv({ GBRAIN_AUDIT_DIR: tmpAuditDir }, async () => {
|
|
const events = readRecentStubGuardEvents({ sinceMs: 24 * 60 * 60 * 1000 });
|
|
expect(events).toEqual([]);
|
|
});
|
|
} finally {
|
|
if (existsSync(tmpAuditDir)) rmSync(tmpAuditDir, { recursive: true, force: true });
|
|
}
|
|
});
|
|
|
|
it('skips malformed JSON lines without crashing', async () => {
|
|
const tmpAuditDir = freshTmpDir();
|
|
try {
|
|
await withEnv({ GBRAIN_AUDIT_DIR: tmpAuditDir }, async () => {
|
|
const now = new Date('2026-05-13T12:00:00Z');
|
|
const filename = computeStubGuardAuditFilename(now);
|
|
const fullPath = join(tmpAuditDir, filename);
|
|
|
|
writeFileSync(fullPath, [
|
|
JSON.stringify({ ts: '2026-05-13T11:00:00Z', slug: 'valid', source_id: 'default', fact_count: 1 }),
|
|
'this is not JSON',
|
|
'{"ts":"truncated',
|
|
'',
|
|
].join('\n') + '\n');
|
|
|
|
const events = readRecentStubGuardEvents({ sinceMs: 24 * 60 * 60 * 1000, now });
|
|
expect(events.length).toBe(1);
|
|
expect(events[0].slug).toBe('valid');
|
|
});
|
|
} finally {
|
|
if (existsSync(tmpAuditDir)) rmSync(tmpAuditDir, { recursive: true, force: true });
|
|
}
|
|
});
|
|
|
|
it('skips rows missing required fields (ts, slug)', async () => {
|
|
const tmpAuditDir = freshTmpDir();
|
|
try {
|
|
await withEnv({ GBRAIN_AUDIT_DIR: tmpAuditDir }, async () => {
|
|
const now = new Date('2026-05-13T12:00:00Z');
|
|
const filename = computeStubGuardAuditFilename(now);
|
|
const fullPath = join(tmpAuditDir, filename);
|
|
|
|
writeFileSync(fullPath, [
|
|
JSON.stringify({ ts: '2026-05-13T11:00:00Z', source_id: 'default' }), // missing slug
|
|
JSON.stringify({ slug: 'no-ts', source_id: 'default', fact_count: 1 }), // missing ts
|
|
JSON.stringify({ ts: '2026-05-13T11:30:00Z', slug: 'valid', source_id: 'default', fact_count: 1 }),
|
|
].join('\n') + '\n');
|
|
|
|
const events = readRecentStubGuardEvents({ sinceMs: 24 * 60 * 60 * 1000, now });
|
|
expect(events.length).toBe(1);
|
|
expect(events[0].slug).toBe('valid');
|
|
});
|
|
} finally {
|
|
if (existsSync(tmpAuditDir)) rmSync(tmpAuditDir, { recursive: true, force: true });
|
|
}
|
|
});
|
|
});
|