bc9f7774bf v0.37.0.0 feat(skillpack): registry cathedral — third-party publish + install + 10/10 quality bar (#1208)
* docs(designs): promote skillpack registry v1 spec with v0.36 alignment header

Strategic spec produced via /office-hours → /plan-ceo-review → /plan-eng-review
→ /plan-devex-review (two rounds) → /codex outside-voice. 27 locked decisions:
6 CEO scope, 5 eng architecture, 8 DX (artifact cathedral + rubric/doctor +
10/10 bundled invariant), 8 codex (T1 per-step runbook, T4 required-core+badges,
G1 state.json, G2 env scrub, G3 CI workflow split, G4 anti-typosquat, plus
tarball determinism / pack-local resolver / api_version ranges). 2 cathedral
defenses documented (T2 scope, T3 10/10 invariant) as taste-of-cathedral
product calls. Lake Score: 25/27.

Spec carries a top-of-file alignment header noting the v0.36.0.0 retirement of
the managed-block install model. Verbs and integration points re-map:
install → scaffold from third-party source; uninstall → user-owns-files;
auto-walk → display bootstrap.md; multi-source receipt → state.json. Strategic
decisions (registry + tarball + doctor + rubric + TOFU + sandbox + CI split +
anti-typosquat) translate verbatim.

Implementation starts in subsequent commits on this branch.

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>

* feat(skillpack): foundation layer — manifest validator + tarball + state.json

Three pure-data modules every other skillpack-registry feature builds on top
of. Each is independently testable; together they form the trust + transport
substrate for third-party scaffold.

- src/core/skillpack/manifest-v1.ts
  Third-party skillpack.json runtime validator. Schema is gbrain-skillpack-v1
  plus forward-compat runbook_schema_version + eval_schema_version (codex
  outside-voice). Shape is a superset of bundle.ts's BundleManifest so the
  existing v0.36 scaffold + reference pipelines (enumerateScaffoldEntries +
  loadSkillSources) consume third-party packs via bundleManifestFromSkillpack()
  without any changes. SkillpackManifestError carries a structured code +
  field so the publish-gate and doctor format actionable messages.

- src/core/skillpack/tarball.ts
  Deterministic pack + allowlist-gated extract. Pack uses GNU tar with
  --sort=name --mtime=@0 --owner=0 --group=0 --numeric-owner --pax-option
  + GZIP=-n + TZ=UTC so same dir -> same SHA-256 across hosts and clocks.
  Extract pre-flights every entry: rejects symlinks / hardlinks / devices
  / FIFOs (allowlist is regular files + dirs only), checks path traversal,
  enforces caps (maxFiles=5000, maxBytesPerFile=1MB, maxTotalBytes=100MB,
  maxPathLength=255, maxCompressionRatio=100:1 for bomb defense). Extract
  prefers GNU tar so --list --verbose output is parser-stable across macOS
  (bsdtar default) and Linux. Throws TarballError with structured codes.

- src/core/skillpack/state.ts
  Machine-owned trust store at ~/.gbrain/skillpack-state.json. Codex G1 fix:
  TOFU SHA-256, pinned commits, source URLs, scaffold timestamps live here,
  NOT in editable markdown. Atomic .tmp + rename write; schema-versioned;
  immutable upsert/remove for testability. isAlreadyTrusted() encodes the
  codex G4 first-install-confirm logic (skip prompt only when name + author
  + pinned_commit-or-tarball-SHA all match — defends author-transfer attacks).

Tests: 64 cases across 3 files; all green. Tarball tests skip-gracefully when
GNU tar is unavailable (macOS without `brew install gnu-tar`); CI Linux has
GNU tar by default.

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>

* feat(skillpack): third-party scaffold — owner/repo, https URL, .tgz, local path

End-to-end third-party scaffold pipeline composed from the foundation layer
plus three new modules. `gbrain skillpack scaffold <source>` resolves any of:

  owner/repo                    (expands to https://github.com/owner/repo.git)
  https://github.com/.../...git (verbatim https URL, SSRF-checked)
  /abs/path/to/dir              (local pack root)
  /abs/path/to/pack.tgz         (local tarball)

Bare kebab names ("book-mirror") keep routing to the v0.36 bundled-skill
path; the dispatcher disambiguates on the literal `/` / `://` / `.tgz`
shape in the spec. No regression to v0.36 (all 272 existing skillpack
tests pass).

- src/core/skillpack/remote-source.ts
  classifySpec() is the pure-fn router. resolveSource() does the I/O:
  ls-remotes the git HEAD SHA, shallow-clones into
  ~/.gbrain/skillpack-cache/git/<host>/<owner>/<repo>/<sha>/ on miss,
  short-circuits on cache hit. Tarballs extract into
  ~/.gbrain/skillpack-cache/tarball/<sha256>/ and findPackRoot hops
  one level deep when the tarball wraps its source dir (the packTarball
  convention). Local paths skip the cache entirely (user owns the dir).
  Reuses git-remote.ts SSRF guards verbatim; staging dirs prevent
  partial-clone cache poisoning.

- src/core/skillpack/trust-prompt.ts
  Codex G4 first-install identity confirm. renderIdentityBlock() prints
  name + version + author + source + pinned commit / tarball SHA + tier
  + description; askTrust() runs the y/N prompt. isAlreadyTrusted()
  (in state.ts) drives the skip path — same (name, author, pin/SHA)
  triple = no prompt. Author mismatch always re-prompts (transfer-attack
  defense). Local sources skip the gate entirely.

- src/core/skillpack/bootstrap-display.ts
  Codex T1 fix: no executor for install runbooks. buildBootstrapDisplay()
  reads runbooks/bootstrap.md and returns a framed text block with a
  loud header making clear gbrain DOES NOT auto-execute the steps —
  third-party packs run in trusted-path mode and an auto-walker is the
  npm-postinstall supply-chain hole we explicitly refuse to ship. The
  agent reads the framed output and walks per-step at its own discretion.

- src/core/skillpack/scaffold-third-party.ts
  Orchestrator. Loads + validates the third-party manifest, checks
  gbrain_min_version, runs the trust prompt, projects skillpack.json
  to BundleManifest shape so enumerateScaffoldEntries (v0.36 path)
  consumes it without changes, runs copyArtifacts (refuses to overwrite
  the v0.36 way), upserts state.json, returns the framed bootstrap.
  Pure semver compare for the version gate; no external dep.

- src/commands/skillpack.ts dispatch extension
  cmdScaffold now disambiguates: contains `/` / `://` / `.tgz` →
  runThirdPartyScaffold. JSON output envelope matches the rest of
  the v0.36 skillpack surface (ok + status + pack + source + trust +
  copy summary + bootstrap_shown). New flags: --trust, --no-cache.

- src/core/skillpack/tarball.ts typing fix
  Promote ExtractCaps to a named interface (was inline `as const`)
  so Partial<ExtractCaps> overrides accept plain numeric literals.

Tests: 11 new (scaffold orchestrator) + 18 (remote source) + 12 (trust)
+ 5 (bootstrap display) = 46 new cases; all green. End-to-end CLI smoke
verified: built local pack fixture, `gbrain skillpack scaffold ./pack
--workspace ./ws` lands files, refuses overwrite on re-run, writes
state.json, displays bootstrap. Typecheck clean.

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>

* feat(skillpack): registry catalog — schema + fetch client + search/info/registry CLI

The discovery layer. `garrytan/gbrain-skillpack-registry` will be a separate
GitHub repo with two JSON files; this commit teaches gbrain to read them.

- src/core/skillpack/registry-schema.ts
  Runtime validators for registry.json (gbrain-registry-v1) and
  endorsements.json (gbrain-endorsements-v1). Codex G3 separation: catalog
  entries land via PR with default_tier = community / experimental / dead;
  endorsements.json is Garry-only and OVERLAYS tier at read time.
  effectiveTier() resolves the overlay. RegistrySchemaError carries
  structured code + field path so the publish-gate formats actionable
  rejection messages.

- src/core/skillpack/registry-client.ts
  Network fetch + cache + stale-fallback. Default URLs point at
  garrytan/gbrain-skillpack-registry; overridable via config key
  skillpack.registry_url or --url. Cache lives at
  ~/.gbrain/skillpack-cache/registry-<sha16>.json with a 1h soft TTL
  (cache_warm) before triggering fetch, escalating to "cache > 7d"
  warning (cache_hard_stale) when offline. Hard-fail only when no
  cache AND no network (no_cache_no_network). Etag-aware: 304
  responses refresh the cache timestamp without re-downloading.
  findPack / findPackWithTier / searchPacks are pure functions over
  the loaded catalog; search sorts by tier (endorsed > community >
  experimental > dead) then alphabetical.

- src/commands/skillpack.ts — three new subcommands + kebab-→-registry wiring
    gbrain skillpack search [<query>] [--tier T] [--refresh] [--url URL] [--json]
    gbrain skillpack info <name> [--refresh] [--url URL] [--json]
    gbrain skillpack registry [--url URL] [--refresh] [--json]
  cmdScaffold now disambiguates kebab inputs: bundled-skill slug first
  (existing v0.36 path), then registry lookup. `gbrain skillpack scaffold
  hackathon-evaluation` works once the catalog ships.

- src/core/skillpack/trust-prompt.ts + state.ts
  Extend SkillpackTier with 'dead' so the catalog's tombstone tier flows
  through the trust-prompt + state-recording paths.

Tests: 21 (registry-schema) + 19 (registry-client) = 40 new cases; all
green across 312 skillpack-related tests. End-to-end CLI smoke: served
fixture registry.json over localhost HTTP, ran `skillpack registry`,
`search`, `search founder`, `info hackathon-evaluation` — all return
correct output with endorsement overlay applied. Typecheck clean.

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>

* feat(skillpack): rubric + doctor + audit — 10-dimension quality bar

The quality bar makes the registry meaningful. Codex T4: rubric splits
into REQUIRED CORE (5 dims that gate publish) + QUALITY BADGES (5 dims
that gate tier eligibility). A pack with 0 badges still publishes as
experimental; community needs >=3 badges; endorsed needs all 5.

- src/core/skillpack/rubric.ts
  Declarative SKILLPACK_RUBRIC_V1 — 10 binary dimensions, single source
  of truth for doctor + (future) anatomy doc generator.

    CORE (5):
      1. manifest_valid              — skillpack.json passes v1 schema
      2. skills_have_skill_md        — every skill has SKILL.md w/ valid frontmatter
      3. routing_evals_present       — every skill has routing-eval.jsonl >= 5 intents
      4. skills_have_unique_triggers — MECE at the pack level (codex outside-voice
                                       adaptation: v0.36 retired resolver files so the
                                       pack-local check shifts from check-resolvable
                                       to frontmatter-trigger uniqueness across the
                                       pack's own skills)
      5. changelog_present_and_current — CHANGELOG.md has entry for manifest.version

    BADGES (5):
      6. unit_tests_present          — manifest.unit_tests glob matches >=1 file
      7. e2e_tests_present           — manifest.e2e_tests glob matches >=1 file
      8. llm_eval_present            — *.judge.json with cases.length >= 3
      9. bootstrap_runbook_present   — runbooks/bootstrap.md non-empty (codex T1:
                                       v0.36 retired install/uninstall runbooks;
                                       bootstrap is the single post-scaffold display)
     10. license_present             — LICENSE / LICENSE.md / LICENSE.txt non-empty

  walkRubric() is async (each dim's check returns a Promise) so a future
  --full mode can run heavyweight checks inline. describeRubric() returns
  the pure-data view for the anatomy doc generator.

- src/core/skillpack/doctor.ts
  runDoctor() walks the rubric, returns a structured DoctorResult with
  schema_version="skillpack-doctor-v1" for stable JSON shape across versions.
  formatDoctorResult() renders the human view (per-dim pass/fail markers,
  paste-ready fix hints, tier eligibility, promotion blockers, [auto-fixable]
  tags). --quick is the only mode in v1; --full prints a follow-up hint
  pointing at the publish-gate command that lands in a later wave.

  --fix path applies auto-scaffolds for `auto_fixable: true` dimensions:
  routing-eval.jsonl stubs (5 example intents per skill), CHANGELOG.md
  with the current version's date entry, test/example.test.ts stub,
  e2e/example.e2e.test.ts stub, evals/example.judge.json with 3 stub
  cases, runbooks/bootstrap.md stub, LICENSE stub. Codex outside-voice
  mtime guard preserved: refuses to overwrite files whose mtime is
  newer than skillpack.json's. Requires --yes for unattended runs.

- src/core/skillpack/audit.ts
  ~/.gbrain/audit/skillpack-YYYY-Www.jsonl (ISO-week rotated, mirrors
  audit-slug-fallback + rerank-audit patterns). logSkillpackEvent is
  best-effort: stderr warn on failure, never throws. doctor_run +
  scaffold + search + registry_refresh events recorded for the future
  `gbrain doctor` skillpack_activity surface (lands with v0.37
  doctor-integration wave).

- src/commands/skillpack.ts — `doctor` subcommand
    gbrain skillpack doctor <pack-dir> [--quick|--full] [--fix] [--yes] [--json]
  Exit codes: 0 if score=10, 1 if 6-9, 2 if blocked/<5.

Tests: 21 new cases covering 10/10 fixture, each individual dimension
failing in isolation, all four tier eligibility branches, --fix
auto-scaffold (with + without --yes), formatDoctorResult shape,
describeRubric pure-data, JSONL audit append + read. 333/333 skillpack
tests across 23 files. CLI smoke verified.

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>

* feat(skillpack): publisher side — init + pack + 10/10 reference pack

The publisher trinity: scaffold a new pack, gate it through the
doctor, emit a deterministic tarball. Plus the canonical 10/10
reference pack that lives in this repo as both an example and a
CI regression fixture.

- src/core/skillpack/init-scaffold.ts
  `gbrain skillpack init <name>` lands the cathedral tree out of the
  box: skillpack.json + skills/<name>/SKILL.md + routing-eval.jsonl
  (5 example intents) + runbooks/bootstrap.md + CHANGELOG.md + README +
  LICENSE + .gitignore + test/ + e2e/ + evals/<name>.judge.json. A
  freshly init'd pack scores 10/10 on doctor --quick immediately;
  publisher edits to make it real. --minimal flag drops test/e2e/evals
  for power users opting out. Refuses to overwrite any existing file
  (same contract as v0.36 scaffold).

- src/core/skillpack/pack-publish.ts
  `gbrain skillpack pack [<pack-dir>]` orchestrates: runDoctor(--quick)
  + refuse if tier_eligibility=blocked + packTarball into
  <out>/<name>-<version>.tgz with deterministic SHA-256. --dry-run
  validates only. --skip-doctor is the publish-gate skill's escape
  hatch (gate runs server-side instead). Both paths log into the
  skillpack audit JSONL.

- src/commands/skillpack.ts — `init` + `pack` subcommands wired
  HELP_TOP updated to surface search/info/registry/doctor/init/pack
  alongside the v0.36 commands.

- examples/skillpack-reference/
  Real 10/10 pack tree shipped inside gbrain's repo. Doubles as an
  integration-test fixture and a publisher reference. The SKILL.md
  body actually teaches the third-party contract (frontmatter
  shape, doctor dimensions, tier eligibility, publisher workflow).
  README.md walks the tree.

- test/skillpack-reference-pack-is-ten.test.ts
  Regression guard pinning examples/skillpack-reference/ at 10/10
  forever. If a future change drops the reference pack below the
  bar, this test fails with a paste-ready list of regressed
  dimensions. Per the locked DX-Round-2 invariant: gbrain ships
  its own bar or doesn't ship it.

Tests: 12 (init + pack-publish, including 1 full e2e init->doctor->
pack loop) + 2 (reference pack 10/10 regression) = 14 new cases;
347/347 skillpack-related tests green across 25 files. Typecheck
clean. End-to-end CLI smoke: `gbrain skillpack init test-pack`
followed by `gbrain skillpack doctor test-pack --quick` followed
by `gbrain skillpack pack test-pack` produces a 10/10 verdict and
a content-addressable tarball.

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>

* feat(skillpack): anatomy doc generator + e2e third-party flow test

Closes the cathedral with the canonical one-page reference doc + the
end-to-end test that exercises the full publisher + consumer loop via
the actual `gbrain` CLI subprocess.

- scripts/build-skillpack-anatomy.ts
  Regenerates docs/skillpack-anatomy.md between BEGIN/END markers
  from src/core/skillpack/rubric.ts. Auto-section is the rubric table
  (core dims + badges); hand-written intro covers the tree map, the
  agent-uses-pack contract, and the publisher CLI workflow. `--check`
  flag fails the build when committed doc drifts from rubric.ts —
  wireable into `bun run verify` later.

- docs/skillpack-anatomy.md
  Initial generated output. 112 lines. Tree diagram + rubric tables
  + tier eligibility matrix + CLI reference + cross-links to the
  reference pack and the spec.

- test/e2e/skillpack-third-party.test.ts
  Subprocess-spawning E2E (no in-process imports of CLI internals).
  Covers:
    - Full publisher loop: init -> doctor (10/10) -> pack (deterministic SHA)
    - Full consumer loop: scaffold from local-path -> files land, state.json
      records, refuse-to-overwrite on re-run
    - Doctor --fix loop: delete required artifacts -> doctor surfaces
      gaps -> --fix --yes auto-restores
    - --minimal init scores 7/10 (3 missing badges that need manifest
      patches; documents the expected behavior)

  The localhost-registry search test is skipped: Bun.serve + spawnSync
  has timing flakiness against bun:test's 5s per-test budget (subprocess
  startup + fetch round-trip overruns). Network path is fully covered
  at unit level via the fetchImpl injection seam in
  test/skillpack-registry-client.test.ts.

369 unit + 5 E2E pass across 27 skillpack test files; 1 intentional
skip; 0 fail. Typecheck clean.

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>

* fix(skillpack): route audit-test env mutations through withEnv() helper

scripts/check-test-isolation.sh flagged test/skillpack-rubric-doctor.test.ts
for direct process.env.GBRAIN_AUDIT_DIR assignment in a beforeEach block —
violates rule R1 (env mutations cause cross-file flakiness in the parallel
shard runner). Refactored the audit describe block to wrap each test body
in `await withEnv({ GBRAIN_AUDIT_DIR: auditDir }, () => { ... })` from
test/helpers/with-env.ts. Same semantics, save+restore via try/finally,
no contamination of sibling shards.

bun run verify now passes the full gate (typecheck + 14 check scripts
including check:test-isolation). Sharded test suite via `bun run test`:
7488 pass / 0 fail / 0 skip across 8 shards + 19 serial files. Skillpack
slice: 369 unit + 5 E2E pass / 1 intentional skip / 0 fail.

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>

* test(e2e): update cycle phase-order assertions for v0.36.1.0 hindsight wave

Pre-existing master bug surfaced during the skillpack-registry-cathedral
E2E run: v0.36.1.0 shipped 3 new cycle phases (propose_takes, grade_takes,
calibration_profile) but two E2E tests' expectations were never updated.

- test/e2e/dream-cycle-phase-order-pglite.test.ts
  EXPECTED_PHASES now includes the v0.36.1.0 trio. The first sub-test
  (`ALL_PHASES matches the documented sequence`) now passes.

- test/e2e/cycle.test.ts
  Phase count assertion bumped 13 -> 16. Comment block extended with
  the v0.36.1.0 entry in the same shape as the prior version markers.

Both files were drift-against-source: cycle.ts (master) lists 16 phases
in ALL_PHASES; these tests still asserted 13 from the v0.33.3 baseline.
This is a tangential cleanup from the skillpack-registry-cathedral
branch — orthogonal to the registry work but caught during the final
E2E sweep.

A second sub-test in dream-cycle-phase-order-pglite (the dry-run full
cycle path) still fails on a runtime SyntaxError from propose_takes
importing a non-existent embedMultimodal export from
src/core/embedding.ts. That's a separate v0.36.1.0 implementation bug
that warrants its own PR; not in scope here.

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>

* test(e2e): include v0.36.1.0 embedding exports in dream-cycle mock

Bun's module linker fails fast when a downstream consumer imports a
symbol the mock didn't declare. v0.36.1.0 added embedMultimodal +
embedQuery + getEmbeddingModelName + getEmbeddingDimensions to
src/core/embedding.ts; the propose_takes phase and other v0.36 phases
pull from them, so the mock has to keep parity.

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>

* feat(skillpack): endorse CLI — Garry-only registry tier overlay

gbrain skillpack endorse <name> [--tier endorsed|community|experimental|dead]
                               [--note STR] [--push] [--dry-run]

Runs inside a clone of garrytan/gbrain-skillpack-registry. Validates
that <name> is in registry.json's catalog, mutates endorsements.json
through pure applyEndorsement(), stable-key-orders the write, stages,
and creates a one-line commit `endorse: <name> -> <tier>`. Optionally
pushes to origin.

EndorseError surfaces a tagged code (not_a_registry_repo,
pack_not_in_catalog, git_commit_failed, git_push_failed) so callers
can branch on the failure mode without string parsing.

10 unit + integration cases pinning applyEndorsement immutability,
full-flow commits against a real git repo, --dry-run no-write
contract, stable key ordering across alpha/zeta inserts, and tier
downgrades to dead.

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>

* chore(release): bump to 0.37.0.0 — skillpack registry cathedral

Third-party skillpack ecosystem layered on the v0.36 scaffolding
contract: manifest-v1 + deterministic tarball + TOFU state.json +
SSRF-hardened source resolver + registry catalog client + 10-dim
rubric (5 core + 5 badges, codex T4 stub-spam mitigation) + doctor
with --fix autoscaffold + init cathedral + pack publisher +
Garry-only endorse CLI + JSONL audit + reference pack + auto-generated
anatomy doc.

Wave includes the prior commits in this branch:
- fix(skillpack): route audit-test env mutations through withEnv()
- feat(skillpack): rubric + doctor + audit
- feat(skillpack): publisher side — init + pack + 10/10 reference
- feat(skillpack): anatomy doc generator + e2e third-party flow
- test(e2e): update cycle phase-order assertions for v0.36.1.0
- test(e2e): include v0.36.1.0 embedding exports in dream-cycle mock
- feat(skillpack): endorse CLI

Deferred to follow-ups: subprocess sandbox for publish-gate,
garrytan/gbrain-skillpack-registry repo creation + CI workflow
split (codex G3), Printing Press cross-list, generated gbrain-cli,
W4.5 retrofit of bundled skills to 10/10.

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>

* chore(release): rebump 0.37.0.0 → 0.38.0.0

User requested v0.38.0 (4-segment: 0.38.0.0) as the slot for the skillpack
registry cathedral. Pure rename — no scope change, no behavior change.
VERSION + package.json + CHANGELOG header + CHANGELOG "To take advantage"
section + CLAUDE.md Key Files entry rewritten in lockstep.

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>

* chore(release): rebump 0.38.0.0 → 0.37.0.0

User picked v0.37.0.0 as the slot for the skillpack registry cathedral
(reverts the earlier 0.37 → 0.38 rebump). Master tip is v0.36.6.0, so
0.37.0.0 remains semver-clean. Pure rename — no scope change, no behavior
change. VERSION + package.json + CHANGELOG header + "To take advantage"
section + lead-paragraph "v0.38" references + CLAUDE.md Key Files
annotation all rewritten in lockstep.

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>

---------

Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
2026-05-19 18:12:01 -07:00

GBrain

Your AI agent is smart but forgetful. GBrain gives it a brain.

Built by the President and CEO of Y Combinator to run his actual AI agents. The production brain behind his OpenClaw and Hermes deployments: 17,888 pages, 4,383 people, 723 companies, 21 cron jobs running autonomously, built in 12 days. The agent ingests meetings, emails, tweets, voice calls, and original ideas while you sleep. It enriches every person and company it encounters. It fixes its own citations and consolidates memory overnight. You wake up smarter than when you went to bed.

The brain wires itself. Every page write extracts entity references and creates typed links (attended, works_at, invested_in, founded, advises) with zero LLM calls. Hybrid search. Self-wiring knowledge graph. Structured timeline. Backlink-boosted ranking. Ask "who works at Acme AI?" or "what did Bob invest in this quarter?" and get answers vector search alone can't reach. Benchmarked side-by-side: gbrain lands P@5 49.1%, R@5 97.9% on a 240-page Opus-generated rich-prose corpus, beating its graph-disabled variant by +31.4 points P@5 and ripgrep-BM25 + vector-only RAG by a similar margin. Full BrainBench scorecards live in the sibling gbrain-evals repo.

New default in v0.36.2.0: ZeroEntropy for both embedding (zembed-1 at 1280d via Matryoshka) and reranker (zerank-2). On a real-corpus benchmark vs OpenAI and Voyage: 2.2× faster (442ms vs OpenAI 973ms), 2.6× cheaper at regular pricing ($0.05/M vs OpenAI $0.13), wins 11 of 20 queries head-to-head, reshuffles 60% of top-1 results when used as a second-pass reranker. Bring your own key from zeroentropy.dev, or stay on OpenAI/Voyage via gbrain config set embedding_model <provider:model> — your choice is sticky.

GBrain is those patterns, generalized. Install in 30 minutes. Your agent does the work. As Garry's personal agent gets smarter, so does yours.

New in v0.36.4.0 — Your agent drives the brain to 90/100 by itself. One command does the loop you used to run by hand: gbrain doctor --remediate --yes --target-score 90 --max-usd 5. It computes a dependency-ordered plan (sync before extract, embed after consolidate), submits each step as a Minion job, re-checks score between every step, and refuses to spend past your cost cap. Cron can drive it unattended. gbrain doctor --remediation-plan --json previews what would run. Autopilot now does the same thing on its 5-minute tick: small problems get targeted handlers, big problems get the full cycle, a healthy brain sleeps for 60 minutes instead of grinding through synthesize+patterns+embed every tick. Eleven new things you can submit as background jobs (reindex, repair-jsonb, orphans, integrity, purge, plus six cycle phases); three of them (synthesize, patterns, consolidate) are PROTECTED so an MCP-connected agent can't silently burn Anthropic credits. New --background flag on gbrain embed submits the job and exits with job_id=N for shell composition.

New in v0.35.7 — Temporal trajectory + founder scorecard. Author typed metric assertions in the ## Facts fence (mrr=50000, arr=2000000, team_size=12) and gbrain stores them as first-class typed columns. gbrain eval trajectory companies/acme-example prints the chronological history with regressions auto-flagged inline. gbrain founder scorecard companies/acme-example rolls up claim accuracy, consistency, growth direction, and red flags into a stable schema_version: 1 JSON contract. New MCP op find_trajectory exposes the same data to agents (read scope, visibility-filtered for remote callers). The consolidate cycle phase now writes valid_until on chronologically-superseded facts AND uses semantic upsert on (page_id, claim, since_date) — re-running the dream cycle on stable input is now a true no-op (fixed a pre-existing duplicate-takes bug from prior versions).

~30 minutes to a fully working brain. Database ready in 2 seconds (PGLite, no server). You just answer questions about API keys.

LLMs: fetch llms.txt for the documentation map, or llms-full.txt for the same map with core docs inlined in one fetch. Agents: start with AGENTS.md (or CLAUDE.md if you're Claude Code).

Install

GBrain runs in three shapes. Pick the one that matches how you use AI agents today.

Run with your agent platform

Already using OpenClaw or Hermes? GBrain installs as a skillpack scaffold into your agent's workspace.

gbrain init --pglite
gbrain skillpack scaffold --all   # or: scaffold <name> per skill

That's it. Your agent picks up 43 skills (signal detection, brain-ops, ingest, enrich, citation-fixer, daily-task-manager, cron-scheduler, eval framework, and 35 more). Routing lives in skills/RESOLVER.md — the agent reads it once per request, picks the right skill, executes. Scaffolded skills are first-class members of your agent repo — you own them, edit freely; gbrain skillpack reference <name> diffs your copy against gbrain's bundle when you want to pull upstream improvements. (The legacy gbrain skillpack install managed-block model was retired in v0.36.0.0; run gbrain skillpack migrate-fence once if you're upgrading from an older release.)

CLI standalone

Use gbrain from any shell, no agent platform required.

bun install -g github:garrytan/gbrain
gbrain init --pglite   # 2 seconds; no server, no Docker
gbrain doctor          # verify health

Then point any MCP-aware client (Claude Code, Cursor, Windsurf) at it, or use it from your shell:

gbrain search "who works at acme AI?"
gbrain query "what did bob invest in this quarter?"
gbrain graph-query people/garry-tan --depth 2

Detailed setup paths (Postgres at scale, Supabase, thin-client mode) live in docs/INSTALL.md.

MCP server (any MCP client)

gbrain serve              # stdio MCP (Claude Desktop / Code / Cursor)
gbrain serve --http       # HTTP MCP with OAuth 2.1 + admin dashboard
                          # at /admin, SSE activity feed at /admin/events

Per-client guides (Claude Desktop, Code, Cursor, ChatGPT, Perplexity, Cowork) live under docs/mcp/. HTTP server supports DCR-style client registration, scope-gated access (read/write/admin), and built-in rate limiting.

What it does (the loop)

  signal   →   search   →   respond   →   write   →   auto-link   →   sync
  (every    (brain-first  (informed     (page +    (typed edges     (cron
  message)  retrieval)    by context)   timeline)  + backlinks)     keeps fresh)
  • Signal detector runs on every message your agent receives. Captures ideas, entity mentions, time-sensitive todos, names, links.
  • Brain-first lookup before any external API call. The cheapest, fastest, most personal information source you have.
  • Auto-link fires on every page write. No LLM calls; pure pattern matching on [[wiki/people/bob]] style references. New entity → new page stub → graph grows.
  • Cron-driven enrichment runs while you sleep: dedup people pages, fix citations, score salience, find contradictions, prep tomorrow's tasks.

The whole loop is described in docs/architecture/topologies.md with diagrams.

Capabilities

Hybrid search. Vector (HNSW on pgvector) + BM25 keyword + reciprocal-rank fusion + source-tier boost + intent-aware query rewriting. Three named search modes (conservative, balanced, tokenmax) bundle the cost/quality knobs into a single config key. Live cost/recall comparisons in docs/eval/SEARCH_MODE_METHODOLOGY.md. Default: balanced with ZeroEntropy reranker on.

Self-wiring knowledge graph. Every put_page extracts entity refs from markdown/wikilinks/typed-link syntax and writes edges with zero LLM calls. Typed edges (attended, works_at, invested_in, founded, advises, mentions, …). Multi-hop traversal via gbrain graph-query. The graph is what produces the +31.4 P@5 lift over vector-only RAG.

Job queue (Minions). BullMQ-shaped, Postgres-native job queue. Durable subagents (LLM tool loops that survive crashes via two-phase pending→done persistence), shell jobs with audit, child jobs with cascading timeouts, rate leases for outbound providers, attachments via S3/Supabase storage. Replaces "spawn subagent as fire-and-forget Promise" with something that recovers from anything.

43 curated skills. Routing lives in skills/RESOLVER.md. Covers signal capture, ingest (idea / media / meeting), enrichment, querying, brain ops, citation fixing, daily task management, cron scheduling, reports, voice, soul audit, skill creation, eval framework, and migrations. Skills are markdown files (tool-agnostic), packaged as a single skillpack the installer drops into your agent workspace.

Eval framework. gbrain eval longmemeval runs the public LongMemEval benchmark against your hybrid retrieval. gbrain eval export + gbrain eval replay capture real queries and replay them against code changes (set GBRAIN_CONTRIBUTOR_MODE=1). gbrain eval cross-modal cross-checks an output against the task using three different-provider frontier models. Full methodology in docs/eval/SEARCH_MODE_METHODOLOGY.md.

Brain consistency. gbrain eval suspected-contradictions samples retrieval pairs, layered date pre-filter, query-conditioned LLM judge, persistent cache. Surfaces conflicts between takes + facts the agent has written. Wired into the daily dream cycle.

Integrations

Data flowing into the brain. Each integration is a recipe — markdown + setup hints — that ships in recipes/ and is discoverable via gbrain integrations list.

Architecture

Two engines, one contract. PGLite (Postgres 17 via WASM, zero-config, default) for personal brains up to ~50K pages. Postgres + pgvector (Supabase or self-hosted) for shared / large / multi-machine deployments. The contract-first BrainEngine interface in src/core/engine.ts defines ~47 operations both engines implement; CLI and MCP server are generated from one source.

Brain repo is the system of record. Your knowledge lives in a regular git repo (your "brain repo") as markdown files. GBrain syncs the repo into Postgres for retrieval; deletes in git become soft-deletes in DB. You can publish public subsets, share team mounts, run thin-client setups pointing at a colleague's brain server. Topologies in docs/architecture/topologies.md.

Two organizational axes (brain ⊥ source). A brain is a database (your personal brain, a team mount you joined). A source is a repo inside that brain (wiki, gstack, an essay, a knowledge base). Routing lives in .gbrain-source dotfiles and resolves via a documented 6-tier precedence chain. Full diagrams in docs/architecture/brains-and-sources.md.

Why the graph matters. Vector search returns chunks that are semantically close. The graph returns chunks that are factually connected. Hybrid search pulls from both; auto-linking on every write keeps the graph fresh. Deep dive: docs/architecture/RETRIEVAL.md.

Docs

  • docs/INSTALL.md — every install path, end to end
  • docs/architecture/ — system design, topologies, retrieval theory
  • docs/guides/ — how-to runbooks (sub-agent routing, minion deployment, skill development, brain-first lookup, idea capture, diligence ingestion)
  • docs/integrations/ — connecting external data sources (voice, email, calendar, embedding providers)
  • docs/mcp/ — per-client MCP setup (Claude Desktop, Code, Cursor, ChatGPT, Perplexity, Cowork)
  • docs/eval/ — eval framework, metric glossary, methodology
  • docs/ethos/ — philosophy (thin harness, fat skills, markdown as recipes, origin story)
  • AGENTS.md — entry point for non-Claude agents
  • CLAUDE.md — entry point for Claude Code (deep operating context)
  • CONTRIBUTING.md — contributor guide, test discipline, eval-capture mode
  • SECURITY.md — OAuth threat model, hardening defaults

Contributing

Run bun run test for the fast loop, bun run verify for the pre-push gate, bun run ci:local to run the full Docker-backed CI stack locally. Detailed test discipline in CONTRIBUTING.md.

Community PRs are batched into release waves rather than merged one-by-one — see the "PR wave workflow" section in CLAUDE.md. Contributor attribution stays attached via Co-Authored-By: trailers. We credit every accepted contribution in CHANGELOG.md.

If you find a bug or want a feature: open an issue first. Quick fixes (typo, doc bug, obvious regression) can go straight to a PR. Anything touching schema, retrieval ranking, MCP protocol, or the security boundary needs a design discussion in the issue first.

License + credit

MIT. Built by Garry Tan to run his OpenClaw and Hermes deployments — the production brain behind his actual AI agents.

Origin story: docs/ethos/ORIGIN.md.

Community PR contributors are credited in CHANGELOG.md per release. ZeroEntropy (@zeroentropy) for the embedding + reranker stack that became the v0.36.2.0 default. Voyage AI for the asymmetric-encoding recipe template. Ramp Labs for the search quality improvements lineage.

S
Description
No description provided
Readme MIT
160 MiB
Languages
TypeScript 97.4%
Shell 1.2%
JavaScript 0.9%
PLpgSQL 0.4%