* fix: include kanbanImmersive in immersiveOverlayActive calculation When Kanban board is open, HUD elements (camera preset buttons, edit toolbar, overlays) should be suppressed. The kanbanImmersive flag was defined but not included in the immersiveOverlayActive condition, causing HUD elements to remain visible. This fix adds kanbanImmersive to the immersiveOverlayActive calculation so HUD elements are properly hidden when the Kanban board is open. Co-authored-by: Luke The Dev <iamlukethedev@users.noreply.github.com> * Fix: Hide mini status bar when Kanban immersive overlay is open Wraps the bottom-left mini status bar (showing agent stats, vibe score, and control hints) with !immersiveOverlayActive check to match the behavior of other HUD elements like camera controls and toolbar. This ensures the status bar is properly hidden when the Kanban board or any other immersive overlay is active, maintaining a clean immersive experience. Co-authored-by: Luke The Dev <iamlukethedev@users.noreply.github.com> * chore: drop unrelated package-lock line from branch Co-authored-by: Luke The Dev <iamlukethedev@users.noreply.github.com> * universal-backend-plan * backend-neutral runtime seam * package.json update * feat: add Hermes gateway adapter as alternative to OpenClaw Adds a WebSocket adapter that lets Claw3D connect to a Hermes AI agent runtime without any changes to the frontend. The adapter implements the full Claw3D gateway protocol and bridges it to the Hermes HTTP API. Changes: - server/hermes-gateway-adapter.js: WebSocket bridge implementing the Claw3D gateway protocol against the Hermes HTTP API. Supports all core methods (agents, sessions, chat streaming, cron, config, files, approvals) and multi-agent orchestration via spawn_agent/delegate_task tools. Persists conversation history to ~/.hermes/clawd3d-history.json. - scripts/clawd3d-start.sh: All-in-one startup script that launches Hermes, the adapter, and the Next.js dev server with auto port conflict resolution. Alias as `claw3d` for convenience. - src/features/office/hooks/useCronAgents.ts: Hook that polls the gateway for cron-scheduled agents and surfaces them in the 3D office. - package.json: adds `hermes-adapter` npm script - .env.example: documents Hermes config vars - docs/hermes-gateway.md: setup guide and protocol reference Usage: npm run hermes-adapter # start adapter (connect to http://localhost:8642) npm run dev # start Claw3D, point browser at localhost:3000 # or: bash scripts/clawd3d-start.sh (starts everything automatically) Both OpenClaw and Hermes are supported simultaneously — the gateway URL in NEXT_PUBLIC_GATEWAY_URL determines which backend Claw3D connects to. Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com> * feat: add read_agent_context tool for cross-agent coordination Agents can now read each other's conversation history via the read_agent_context tool, enabling the orchestrator to check what a sub-agent has done before re-delegating work. Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com> * feat: wire Hermes office UX and role-aware runtime updates * feature update - demomode & hermes adapter * fix lint blockers * lintfix #2 * fix: stabilize retro office camera preset callbacks * Initial plan * fix: stabilize retro office overview preset hooks Agent-Logs-Url: https://github.com/gsknnft/Claw3D/sessions/9cc71555-591e-44cf-aec4-25affbdcb405 Co-authored-by: gsknnft <123185582+gsknnft@users.noreply.github.com> * feat: add truthful backend selection, Hermes adapter hardening, and demo gateway mode * fix: address bugbot review and finalize backend selection * fixed - onboarding and hermes calls * office systems roadmap * feat specs in docs * specs ready * feat: continue custom runtime seam and gateway alignment * custom lane wired * feat: add custom runtime provider path and office runtime alignment * office_sys prep * tighten multi-floor runtime spec * multi-floor v1 implementation * moved floor nav * runtime architecture specs * claw3doctor specs * feat: add first pass claw3doctor diagnostics * docs: align roadmap with runtime profiles and office systems priorities * feat: expand claw3doctor provider diagnostics and json output * feat: improve claw3doctor formatting and multi-runtime diagnostics * feat: formalize runtime profile resolution * feat: expand claw3doctor profile health diagnostics * feat: polish claw3doctor output and tunnel remediation * feat: add claw3doctor profile scoping and failure classification * docs: define claw3doctor v1 boundary and v2 backlog * test: fix stale claw3doctor branch expectations * test: fix stale expectations on claw3doctor branch * fix(claw3doctor): scope provider-specific checks to --profile / --all-profiles flags PR #101 finding: - Medium: --profile <adapter> and --all-profiles only scoped the profile health probe loop; OpenClaw/Hermes/Demo/Custom check blocks still ran based on the selected adapter type in runtimeContext, making CLI output misleading. Fix: introduce adapterInScope(adapterType, defaultBehavior) helper in main(). - --profile <adapter> -> only that adapter's checks run - --all-profiles -> all adapter checks run - no flag -> falls back to existing shouldRun* predicate (unchanged) Also: - Export parseDoctorArgs from claw3doctor-core.mjs (removed duplicate in script) - Add test suites: parseDoctorArgs flag parsing (6 cases) and adapterInScope scoping semantics (4 cases) — 10 new tests, all green * fix(office): persist per-floor selectedAgentId on focusLocalAgent + wire officeFloors runtime state PR #96 findings: - Medium #1: focusLocalAgent now writes selectedAgentId back to floorRosterCache so handleSelectFloor restores the agent the user last picked on each floor rather than snapping back to the hydration-time suggestion. - Medium #2: Add useEffect that calls settingsCoordinator.schedulePatch with officeFloors[activeFloorId] patch on every status/gatewayUrl change, writing status, gatewayUrl, lastKnownGoodAt, lastErrorCode, and lastErrorMessage so the persisted floor runtime state actually tracks live connection transitions. * fix unkept changes * fix audit findings - cross-floor misattribution & officefloors silent drops * pushed changes * multi-agentic runtime & chat bubble fix * partial parity with office-sys-next * claw3doctor parity * partial parity with v_lane * merged feat/office-systems-next -> merge_sys * parity across PR branches * rm *.orig postmerge * full parity across unmerged PRs & main * fix lukes findings * fix findings - bigger chatbox * real local upload path * fixed file upload, MIME integgration * minor fix * fix lukess findings * deleted *.orig * three bugs fixed - gatewayclient, coord, claw3doctor * address findings * fix lukes findings * fix findings #2 * fix: ignore temporary skill-agent names during identity recovery * fix: preserve stable identity names during temp-name recovery * fix(gateway): correct disconnect race and token-blanking on adapter switch - disconnect() now checks actual connection status rather than selectedAdapterType, which may already reflect the target adapter when the effect fires. Prevents stale WebSocket clients from persisting after switching to local/claw3d/custom backends. - setSelectedAdapterType() falls back to loadedGatewaySettings.current.profiles token when the in-memory adapterProfiles entry has an empty token (sanitized API form). Prevents saved tokens from being cleared when switching between backends. Closes Luke findings: High (stale gateway on floor switch), Medium (token blanking). Authored-By: GSKNNFT * feat(gateway): loopback bypass, control-ui remap, operator.read scope, 75ms connect Cherry-picked clean additions from pr/gsknnft-2 (fix/reduce-gateway-connect-delay): - proxy-url.ts: resolveStudioProxyGatewayUrl() now accepts optional upstreamGatewayUrl; loopback hosts (localhost/127.0.0.1/::1) bypass the Studio proxy and connect directly - gateway-proxy.js: remap unauthenticated openclaw-control-ui connections to webchat-ui client ID so OpenClaw doesn't reject them as unknown clients - GatewayBrowserClient.ts + nodeGatewayClient.ts: add operator.read scope to both browser and Node gateway clients for expanded access control - GatewayBrowserClient.ts: reduce socket open→connect delay from 750ms to 75ms GatewayClient.ts rewrites from that PR were intentionally excluded — they would regress our disconnect-race fix, token-blanking fix, broken-regex fix, local/claw3d adapter support, adapterProfiles type export, and private envelope path. Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com> * fix(floor-nav): show only available floors per active adapter; block hang on unconfigured runtime - floors.ts: add paperclip to FloorProvider; add listAvailableFloorsForAdapter() — lobby always visible, runtime floors only shown when their provider matches the active adapter, so demo-only users only see Lobby - OfficeFloorNav: accept activeAdapterType prop, filter floor list via listAvailableFloorsForAdapter(); fall back displayActiveFloorId to lobby if current floor is no longer in the available set - OfficeScreen: pass selectedAdapterType to OfficeFloorNav; add guard in handleSelectFloor — bail back to lobby immediately when a runtime floor has no gateway URL configured, preventing the connect-hang limbo state Authored-By: GSKNNFT * hardening: drop unsafe-eval in production CSP; add TRUSTED_PROXY IP resolution next.config.ts: - unsafe-eval removed from production script-src (Next.js dev/HMR needs it, but production build does not; React and Three.js make no use of eval) - connect-src intentionally kept broad with note: gateway URLs are user-configured at runtime, cannot be enumerated at build time server/access-gate.js: - Add resolveClientIp() helper: when TRUSTED_PROXY=1 env var is set, prefer the first value of X-Forwarded-For for rate-limiter keying (correct behavior behind nginx/Caddy/Vercel edge). Without the flag, remoteAddress is used (safe default for direct exposure — prevents X-Forwarded-For spoofing by untrusted clients). Authored-By: GSKNNFT * fix(security): remove upstream tokens from browser API; propagate abort to custom runtime HIGH — /api/studio: strip gatewayPrivate and localGatewayDefaultsPrivate from GET and PUT responses. Upstream tokens must not cross the browser API boundary. The Studio proxy (server/gateway-proxy.js) already injects the server-side token into connect frames when the browser sends an empty token, so the browser never needed raw tokens. GatewayClient.ts and OfficeScreen.tsx updated to work from sanitized public settings only. MEDIUM — /api/runtime/custom route: pass request.signal to the upstream fetch() call. Client abort (e.g. hitting Stop) now cancels the upstream runtime request instead of leaving it running after the browser fetch resolves. Authored By: GSKNNFT * fix(security): preserve stored token through empty-token UI state; handle non-JSON health responses GatewayClient.ts — autosave effects no longer overwrite persisted gateway tokens with empty strings. When the in-memory token is empty (proxy handles auth server-side), the patch omits the token field (undefined) so mergeGatewaySettings/mergeGatewayProfiles treats it as "leave unchanged". adapterProfiles updater also preserves the existing stored token when the new token is empty, preventing floor-switch from erasing tokens. runtime/custom/http.ts — requestCustomRuntime() checks the response Content-Type before calling response.json(). Non-JSON responses (e.g. plain-text /health "OK") are returned as-is instead of throwing a JSON parse error, making the custom/local/claw3d health probe path reliable for runtimes that return plain text. Authored By: GSKNNFT * fix(bug): avoid overwriting stored tokens with an empty UI value GatewayClient.ts:944 → token: "" || undefined = undefined → omitted from patch mergeGatewayConnectionState: patch.token === undefined → patchedToken = undefined → nextToken = undefined || current?.token ?? "" = "abc123" ✓ scenarionn- user explicitly clears token (empty string patch): mergeGatewayConnectionState: patchedToken = "" → nextToken = "" || current?.token ?? "" = falls back to existing stored token Authored By: GSKNNFT * fix ongoing findings issue * test: update gateway connection persistence expectations Co-authored-by: Luke The Dev <iamlukethedev@users.noreply.github.com> * fix: tighten ts.net hostname matching in doctor Co-authored-by: Luke The Dev <iamlukethedev@users.noreply.github.com> * chore(release): prepare v0.1.4 Pin in-repo app version to 0.1.4 to match the planned GitHub release tag, and document the convergence release in CHANGELOG.md with verified 0.1.3 and 0.1.4 entries covering runtime profiles, multi-floor offices, remote messaging/handoffs, file uploads, security hardening, and the claw3doctor diagnostics CLI. Made-with: Cursor --------- Co-authored-by: Cursor Agent <cursoragent@cursor.com> Co-authored-by: Luke The Dev <iamlukethedev@users.noreply.github.com> Co-authored-by: Elias Pfeffer <eliaspfeffer@gmail.com> Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com> Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com> Co-authored-by: Greg Clark <greg.clark@gmail.com> Co-authored-by: iamlukethedev <lucas.guilherme@smartwayslfl.com>
6.5 KiB
Runtime Profile Architecture
Forward-looking runtime model for Claw3D after the OpenClaw + Hermes adapter work landed on
main.
Goal
Claw3D should treat runtime connection targets as profiles, not as ad hoc gateway URLs tied to one backend assumption.
That means the app should model:
- provider
- runtime profile
- floor binding
instead of making the user think in terms of:
- one hard-coded backend
- one port
- one global gateway selection
Recommendation
Use one gateway contract in the UI, with different backend providers behind it.
Default path:
OpenClawis the default runtime profile
Optional paths:
Hermes AdapterCustom Runtime(s)
The important rule is:
- the UI keeps speaking one Claw3D gateway contract
- the backend behind that contract may be native OpenClaw, Hermes through the adapter, or a custom runtime/provider
Core Terms
Provider
A provider identifies the backend family behind a runtime profile.
Initial provider set:
openclawhermescustomdemo
Provider answers questions like:
- what backend is this?
- what capabilities should the UI expect?
- which default labels or help copy apply?
Runtime Profile
A runtime profile is a named connection target.
Examples:
OpenClaw DefaultHermes AdapterCustom Staging RuntimeCustom Prod Runtime
Suggested shape:
export type RuntimeProfileId = string;
export type RuntimeProfile = {
id: RuntimeProfileId;
label: string;
provider: "openclaw" | "hermes" | "custom" | "demo";
gatewayUrl: string;
token?: string | null;
adapterType?: "openclaw" | "hermes" | "custom" | "demo" | null;
enabled: boolean;
defaultProfile: boolean;
notes?: string | null;
};
Runtime profile answers:
- where does Claw3D connect?
- what provider is behind this connection?
- which auth/token should be used?
- which profile should be the default?
Floor Binding
A floor binding maps an office floor to a runtime profile.
Examples:
OpenClaw Floor -> openclaw-defaultHermes Floor -> hermes-defaultCustom Floor -> custom-defaultLobby -> nullCampus -> null
Suggested shape:
export type FloorRuntimeBinding = {
floorId: FloorId;
runtimeProfileId: RuntimeProfileId | null;
};
Floor binding answers:
- which runtime powers this floor?
- is this floor provider-backed, function-backed, or a destination?
Runtime Model
The recommended mental model is:
Provider -> Runtime Profile -> Floor Binding
Examples:
-
provider:
openclaw- profile:
openclaw-default - bound floor:
openclaw-ground
- profile:
-
provider:
hermes- profile:
hermes-default - bound floor:
hermes-first
- profile:
-
provider:
custom- profiles:
custom-defaultcustom-stagingcustom-prod
- one or more custom floors may bind to them later
- profiles:
Default Behavior
Initial default behavior should be:
- if nothing else is configured, Claw3D prefers
OpenClaw - Hermes remains optional and adapter-backed
- custom runtimes remain optional and profile-driven
That means:
- OpenClaw is the safe baseline
- Hermes should not destabilize the default path
- custom runtimes should not require special-case UI logic
Hermes Adapter Position
Right now Hermes works through the adapter path, and that is acceptable as the near-term production path.
Architecture implication:
- Hermes should be represented as a provider/profile combination
- not as a special global mode
So the app should think:
- provider:
hermes - profile:
hermes-default - gateway URL: adapter endpoint
This keeps the runtime selection model uniform even though Hermes is still adapter-backed today.
Custom Runtime Position
Custom runtimes should fit the same profile model:
- provider:
custom - one or more named profiles
- floor binding selects which profile powers which floor
This avoids making the "Custom Floor" logic one-off and lets Claw3D grow to multiple custom environments without another architecture pass.
One Gateway Contract, Different Backends
The UI should not branch everywhere on backend family.
Instead:
- the browser talks one Claw3D gateway contract
- Studio/settings select the runtime profile
- profile/provider metadata informs capability checks and defaults
This keeps the frontend stable while backends differ behind the scenes.
Office Systems Implications
This model supports the current Office Systems direction cleanly.
Floor Zones
BuildingOutside
Floor Types
- provider-backed
- function-backed
- destination/outside
Examples
-
Lobby- function-backed
- no runtime binding required
-
OpenClaw Floor- provider-backed
- bound to
openclaw-default
-
Hermes Floor- provider-backed
- bound to
hermes-default
-
Custom Floor- provider-backed
- bound to
custom-default
-
Training Floor- function-backed
- may later bind to a chosen provider profile
-
Trader's Floor- function-backed
- may later bind to a chosen provider profile
-
Campus/Stadium- outside destinations
- not required to behave like numbered floors
Branch Sequence
Recommended next branches:
docs/runtime-profilesfeat/claw3doctorrefactor/office-shell- later:
docs/floor-builder-schemafeat/floor-builder
Next Sequence
1. docs: runtime profile architecture
Define:
- provider vs profile vs floor binding
OpenClawdefaultHermes AdapteroptionalCustom Runtime(s)optional- one gateway contract, different backends
2. feat: claw3doctor
First pass should check:
- Claw3D settings/env
- gateway reachability
- OpenClaw version
- Hermes adapter/API availability
- auth/token issues
- common websocket/origin/secure-context failures
3. refactor: office shell modularization
Next extractions:
OfficeShellOfficeFloorControllerOfficePanelsController
4. docs: floor schema and builder plan
Define the schema before building the editor.
5. feat: admin floor builder
Only after floor metadata/schema stabilizes.
Why This Comes First
The runtime-profile document should land before more implementation work because it informs both:
- multi-runtime support
claw3doctor
Without this, diagnostics and floor binding will keep being designed against moving assumptions.
Summary
Claw3D should move to a runtime profile model where:
- providers describe the backend family
- profiles describe named connection targets
- floors bind to profiles
OpenClaw remains the default. Hermes adapter remains optional. Custom runtimes become first-class without special-case UI debt.