4 people b3891fa7fc fix(chunkers/code): tolerate tiktoken special tokens in estimateTokens (#2453) (#3315) ...

Code legitimately contains tiktoken special-token strings (e.g. CLIP/GPT tokenizers embed the literal <|endoftext|>). The default encode() uses disallowed_special='all' and THROWS on those, crashing reindex-code on valid source files. Re-encode treating them as ordinary text (allowed=[], disallowed=[]); heuristic fallback if even that fails. A token COUNT needs no special-token semantics.

Co-authored-by: Jim Tang <jimruitang@gmail.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>

2026-07-23 18:15:15 -07:00

..

assets/wasm

v0.40.9.0 feat(chunker): .sql indexing via tree-sitter + code-def on SQL DDL (#1173) (#1350)

2026-05-24 09:30:57 -07:00

commands

fix dream orphan source scope (#2368) (#3344)

2026-07-23 18:01:07 -07:00

core

fix(chunkers/code): tolerate tiktoken special tokens in estimateTokens (#2453) (#3315)

2026-07-23 18:15:15 -07:00

eval

v0.42.56.0 feat(chronicle): Life Chronicle — temporal timeline + thought diary + bi-temporal per-entity ontology (#2390) (#2533)

2026-07-02 10:48:54 -07:00

mcp

fix(sources): federated-source pages visible to get_page/list_pages/resolve_slugs and no-grant MCP callers (#3242) (#3301)

2026-07-23 17:28:38 -07:00

types

v0.28.9 feat: Voyage multimodal embeddings (v0.27.1 catch-up + v0.28.6 master merge) (#706)

2026-05-07 10:03:38 -07:00

admin-embedded.ts

fix: send admin SSE cookies through reverse proxies (#1560)

2026-07-17 11:32:12 -07:00

cli.ts

fix(thin-client): map --source scope onto source_id for remote-routed ops (#3086)

2026-07-23 16:45:36 -07:00

openclaw-context-engine.ts

fix(openclaw): declare gbrain plugin manifest entry (takeover of #2551) (#3185)

2026-07-22 01:32:11 -07:00

schema.sql

fix(cycle): preserve per-page multi-claim proposals (#3297)

2026-07-23 17:12:57 -07:00

version.ts

feat: GBrain v0.2.0 — incremental sync, file storage, install skill (#2)

2026-04-06 16:50:15 -07:00