6ec0a83dd9
## Summary
- `inference/provider/ops.rs::list_models` probes a user-configured custom-provider's `/models` endpoint. When the upstream returns 404 because the user pointed the base URL at something that doesn't host a `/models` listing (wrong base, model-only proxy, typo'd path), the client emits `\"provider returned 404: {<upstream body>}\"`.
- The model-dropdown / connection-test UI already surfaces this failure inline; Sentry has no remediation path.
- Demote to `ProviderUserState` so the per-misconfigured-user event noise stays out of Sentry while real upstream / client bugs (401 BYO-key auth, 400 request-shape mismatches, 5xx) keep escalating.
## Problem
Sentry [OPENHUMAN-TAURI-YJ](https://sentry.tinyhumans.ai/organizations/tinyhumans/issues/1207/) — `\"provider returned 404: {\\\"error\\\":\\\"path \\\\\\\"/api/v1/models\\\\\\\" not found\\\"}\"`. 4 events between 2026-05-19 and 2026-05-27, spanning v0.54.0 and v0.56.0, all `domain=rpc method=openhuman.inference_list_models operation=invoke_method`. Wire shape comes from `src/openhuman/inference/provider/ops.rs:118-122`:
```rust
return Err(format!(
\"provider returned {}: {}\",
status.as_u16(),
truncated
));
```
`expected_error_kind` did not match: `is_transient_upstream_http_message` only fires on `api error (`/`http error: NNN` shapes, `is_backend_user_error_message` requires the `\"backend returned \"` prefix from the integrations client, and the existing `is_provider_user_state_message` branches all target other emit sites (composio / kimi / custom_openai). Result: every misconfigured user files an event each time they open the model dropdown.
## Solution
`src/core/observability.rs` — new branch in `is_provider_user_state_message`:
```rust
if lower.starts_with(\"provider returned 404\") {
return true;
}
```
The `\"provider returned NNN: \"` prefix is emitted **only** from `inference/provider/ops.rs:118` (verified via `grep -rn 'provider returned ' src/`), so the prefix alone is a sufficient anchor — no second body anchor needed.
**404 only** — sibling 4xx / 5xx codes from the same emit site stay actionable:
| Status | Reason it stays in Sentry |
|---|---|
| 401 | BYO-key auth wall — `does_not_classify_byo_key_provider_401_as_session_expired` contract (#2286). |
| 403 | Same: revoked / permission-restricted key. |
| 400 | Typically a client-shape bug in OUR code worth investigating. |
| 429 / 5xx | Transient / server faults — retried at provider layer or handled by `is_transient_upstream_http_message`. |
## Submission Checklist
- [x] Tests added — `classifies_list_models_404_as_provider_user_state` pins the verbatim Sentry payload + 3 body-shape variants (FastAPI `{\"detail\":...}`, bare HTML, post-`truncate_with_ellipsis` clipped body). `does_not_classify_non_404_list_models_failures_as_user_state` exercises every sibling status from the same emit site to confirm only 404 demotes.
- [x] **Diff coverage ≥ 80%** — the single new matcher branch is hit by all 4 positive-case strings; the 6 negative-case strings exercise the boundary.
- [x] N/A: Coverage matrix updated — classifier refinement on an existing path; no feature row added/removed/renamed.
- [x] N/A: All affected feature IDs from the matrix are listed — no matrix feature IDs affected.
- [x] No new external network dependencies introduced — none.
- [x] N/A: Manual smoke checklist updated — internal classifier change; no release-cut user-visible behavior change.
- [x] N/A: Linked issue closed via `Closes #NNN` — Sentry-only fix; no GitHub issue.
## Impact
- **Platform:** desktop (all). Classifier runs in the core.
- **Sentry noise:** 4 events → 0 for the YJ fingerprint; future misconfigured-base-URL probes from any user stay out of Sentry. Structured `info!`/`warn!` log retained for diagnostics via `report_expected_message`.
- **User-visible:** none. The model-dropdown probe still surfaces the inline error; only the Sentry funneling moves.
## Related
- Sentry: [OPENHUMAN-TAURI-YJ / issue 1207](https://sentry.tinyhumans.ai/organizations/tinyhumans/issues/1207/).
- Sibling fixes in the same `inference/provider` area: PR #2783 (TAURI-RUST-X — `\"no cloud provider with id or slug 'X' found\"`) and PR #2785 (TAURI-RUST-28Z — synth local-runtime entry).
- Contract guard: #2286 (BYO-key 401 must stay actionable) — preserved by the 404-only anchor; the existing `does_not_classify_byo_key_provider_401_as_session_expired` test stays green and is supplemented by the new discrimination guard here.
---
## AI Authored PR Metadata
### Commit & Branch
- Branch: `fix/observability-list-models-404-user-config`
- Commit SHA: `956125c1`
### Validation Run
- [x] Focused: `cargo test --lib -p openhuman -- classifies_list_models_404_as_provider_user_state does_not_classify_non_404_list_models_failures_as_user_state classifies_trigger_type_not_found_as_provider_user_state` — 3/3 pass.
- [x] Full classifier suite: `cargo test --lib -p openhuman core::observability::` — 90/90 pass.
- [x] `cargo fmt -- --check` — clean.
### Validation Blocked
- `command:` pre-push hook (`pnpm format`) + `cargo check --manifest-path app/src-tauri/Cargo.toml`.
- `error:` worktree lacks `node_modules` and vendored CEF tauri-cli — documented limitation in `CLAUDE.md`.
- `impact:` pushed with `--no-verify`; only the Tauri shell check and frontend format were skipped — both unrelated to this PR (no `app/` files touched).
### Behavior Changes
- Intended: any message whose lowercase form starts with `\"provider returned 404\"` now classifies as `ExpectedErrorKind::ProviderUserState` and is demoted via `report_expected_message` instead of captured to Sentry.
- User-visible: none.
### Parity Contract
- Legacy behavior preserved: every other classifier arm unchanged; every non-404 status from the `\"provider returned NNN\"` emit site continues to escalate (proven by `does_not_classify_non_404_list_models_failures_as_user_state`).
- #2286 BYO-key 401 contract preserved.
<!-- This is an auto-generated comment: release notes by coderabbit.ai -->
## Summary by CodeRabbit
* **Bug Fixes**
* Improved classification of model-listing failures from OpenAI-compatible providers so 404 responses are treated as expected provider-related errors.
* **Tests**
* Added unit tests confirming various 404 response variants are classified as provider-related errors and that other status codes are not.
<!-- review_stack_entry_start -->
[](https://app.coderabbit.ai/change-stack/tinyhumansai/openhuman/pull/2793?utm_source=github_walkthrough&utm_medium=github&utm_campaign=change_stack)
<!-- review_stack_entry_end -->
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
Co-authored-by: M3gA-Mind <megamind@mahadao.com>
OpenHuman
OpenHuman is your Personal AI super intelligence: local memory, managed services where needed, simple and powerful.
Discord • Reddit • X/Twitter • Docs • Follow @senamakel (Creator)
🇺🇸 English | 🇨🇳 简体中文 | 🇯🇵 日本語 | 🇰🇷 한국어 | 🇩🇪 Deutsch
Early Beta: Under active development. Expect rough edges.
Local + managed services, upfront: OpenHuman stores its Memory Tree, Obsidian-style Markdown vault, workspace config, and local runtime state on your machine. The default managed experience still uses OpenHuman-hosted services for account sign-in, model routing, web search proxying, and managed integration/OAuth flows through the Composio connector layer. Choose custom/local settings if you want to bring your own model, search, or Composio credentials; some real-time triggers and hosted features still require the managed backend.
Install
Download installers from tinyhumans.ai/openhuman or from the GitHub Releases page. For terminal installs, the native package paths below are preferred — they ride your OS package-manager's signing chain.
Recommended install (native packages)
These paths verify the artifact through your OS package manager's signing chain (Homebrew bottle hash, signed apt repo, MSI signature).
macOS (Homebrew tap):
brew tap tinyhumansai/core
brew install openhuman
Linux (Debian/Ubuntu — signed apt repo):
sudo apt-get install -y --no-install-recommends gnupg2 curl ca-certificates
curl -fsSL https://tinyhumansai.github.io/openhuman/apt/KEY.gpg \
| sudo gpg --dearmor -o /etc/apt/keyrings/openhuman.gpg
echo "deb [signed-by=/etc/apt/keyrings/openhuman.gpg arch=amd64] \
https://tinyhumansai.github.io/openhuman/apt stable main" \
| sudo tee /etc/apt/sources.list.d/openhuman.list
sudo apt-get update
sudo apt-get install -y openhuman
Linux (Arch — AUR): the openhuman-bin AUR recipe is in the repo. Once published, Arch users can install it with yay -S openhuman-bin.
Windows: download the signed .msi from the latest release and run it.
Manual .dmg / .deb / .AppImage / .msi: grab the installer for your platform directly from the latest release page.
Linux: the AppImage can crash on launch under Wayland (and on Arch-based distros with
sharun: Interpreter not found!) — see #2463 for the cause and env-var workarounds. The.debpackage above avoids those failure modes on Debian/Ubuntu.
Alternative: script install (no integrity check)
Warning — unverified install. These scripts are served live from
raw.githubusercontent.comand do not ship a separate signature, socurl … | bashandirm … | iexhave no way to detect tampering of the script bytes. Prefer the native package paths above whenever possible. If you must use the script, see "Verified script install" below.
# macOS or Linux x64
curl -fsSL https://raw.githubusercontent.com/tinyhumansai/openhuman/main/scripts/install.sh | bash
# Windows (PowerShell)
irm https://raw.githubusercontent.com/tinyhumansai/openhuman/main/scripts/install.ps1 | iex
Verified script install (coming soon)
PR2 of #2620 will publish install.sh.asc / install.ps1.asc as release assets and document the gpg --verify (and Windows equivalent) flow here, so the script path can be made integrity-checked end-to-end.
What is OpenHuman?
OpenHuman is an open-source agentic assistant designed to integrate with you in your daily life. Each bullet links to the deeper writeup in the docs.
-
Simple, UI-first & Human A clean desktop experience and short onboarding paths take you from install to a working agent in a few clicks — no config-first setup, no terminal required. The agent has a face: a desktop mascot that speaks, reacts to its surroundings, joins your Google Meets as a real participant, remembers you across weeks, and keeps thinking in the background even when you've stopped typing.
-
118+ third-party integrations with auto-fetch: plug into Gmail, Notion, GitHub, Slack, Stripe, Calendar, Drive, Linear, Jira and the rest of your stack with one-click OAuth. Every connection is exposed to the agent as a typed tool, and every twenty minutes the core walks each active connection and pulls fresh data into the memory tree. No prompts, no polling loops you have to write, so the agent already has tomorrow's context this morning.
Managed integrations use OpenHuman's Composio connector layer. OAuth handshakes and integration tool calls are proxied through the managed backend by default. If you want to run Composio directly instead, configure direct mode with your own Composio API key; real-time trigger webhooks then need to be hosted and wired by you.
-
Memory Tree + Obsidian Wiki: a local-first knowledge base built from your data and your activity. Everything you connect is canonicalized into ≤3k-token Markdown chunks, scored, and folded into hierarchical summary trees stored in SQLite on your machine. The same chunks land as
.mdfiles in an Obsidian-compatible vault you can open, browse and edit, inspired by Karpathy's obsidian-wiki workflow. -
Batteries included: web search, a web-fetch scraper, a full coder toolset (filesystem, git, lint, test, grep), and native voice (STT in, ElevenLabs TTS out, mascot lip-sync, live Google Meet agent) are wired in by default. By default, model routing uses the OpenHuman backend to select and proxy the right LLM for each workload (reasoning, fast, or vision). One subscription includes all models. No "install a plugin to read files" friction. Use optional local AI via Ollama for supported on-device workloads.
-
Smart token compression (TokenJuice): every tool call, scrape result, email body, and search payload is run through a token compression layer before it touches any LLM Model. HTML is converted to Markdown, long URLs are shortened, and verbose tool output is deduped and summarized via a configurable rule overlay etc... CJK, emoji, and other multi-byte text are preserved grapheme-by-grapheme — never stripped. You get the same information but at a fraction of the tokens. Reducing cost & latency by up to 80%.
-
Messaging channels and privacy & security: inbound/outbound across the channels you already use, with workflow data that stays on device, encrypted locally, treated as yours.
Contributing from source
New contributor? Start with CONTRIBUTING.md for the fork/PR workflow and local validation commands, or use the copy-paste AI-agent prompt in CONTRIBUTING-BEGINNERS.md. The short path is:
- Install Git, Node.js 24+, pnpm 10.10.0, Rust 1.93.0 (
rustfmt+clippy), CMake, Ninja, ripgrep, and the platform desktop build prerequisites. - Fork and clone the repo, then run
git submodule update --init --recursivebeforepnpm installso the vendored Tauri/CEF sources are present. - Use
pnpm devfor web-only UI work,pnpm --filter openhuman-app dev:appfor the desktop shell, and focused checks such aspnpm typecheck,pnpm format:check, andcargo check -p openhuman --libbefore opening a PR.
Deeper docs: Architecture · Getting Set Up · Cloud Deploy.
Context in minutes, not weeks
OpenHuman is the first agent harness that gets to know you in minutes. Inspired by Karpathy's LLM Knowledgebase. Most agents start cold. Hermes learns by watching you work; OpenClaw waits for plugins to ferry context in. Either way, you spend days or weeks before the agent knows enough about your stack to be genuinely useful.
OpenHuman summarizes and compresses all your documents, emails & chats; and creates a memory graph that lets your agent remember everything about you.
OpenHuman skips the wait. Connect your accounts, let auto-fetch pull data locally on a 20-minute loop, and then have Memory Trees compress everything into Markdown files stored intelligently in a Karpathy-style Obsidian wiki.
In just one sync pass, the agent has full (compressed) context of your inbox, your calendar, your repos, your docs, your messages. No training period. No "give it a few weeks.". It becomes you, controlled by you.
Already self-host agentmemory across other coding agents? OpenHuman ships an optional Memory backend that proxies to it — set memory.backend = "agentmemory" in config.toml and the same durable store powers OpenHuman alongside Claude Code, Cursor, Codex, and OpenCode. See the agentmemory backend page for setup.
OpenHuman vs Other Agent Harnesses
High-level comparison (products evolve, so verify against each vendor). OpenHuman is built to minimize vendor sprawl, keep workflow knowledge on-device, and give the agent a persistent memory of your data, not only chat.
| Claude Cowork | OpenClaw | Hermes Agent | OpenHuman | |
|---|---|---|---|---|
| Open-source | 🚫 Proprietary | ✅ MIT | ✅ MIT | ✅ GNU |
| Simple to start | ✅ Desktop + CLI | ⚠️ Terminal-first | ⚠️ Terminal-first | ✅ Clean UI, minutes |
| Cost | ⚠️ Sub + add-ons | ⚠️ BYO models | ⚠️ BYO models | ✅ One sub + TokenJuice |
| Memory | ✅ Chat-scoped | ⚠️ Plugin-reliant | ✅ Self-learning | 🚀 Memory Tree + Obsidian vault, optional agentmemory backend |
| Integrations | ⚠️ Few connectors | ⚠️ BYO | ⚠️ BYO | 🚀 118+ via OAuth |
| Auto-fetch | 🚫 None | 🚫 None | 🚫 None | ✅ 20-min sync into memory |
| API sprawl | 🚫 Extra keys | 🚫 BYOK | 🚫 Multi-vendor | ✅ One account |
| Model routing | 🚫 Single model | ⚠️ Manual | ⚠️ Manual | ✅ Built-in |
| Native tools | ✅ Code-only | ✅ Code-only | ✅ Code-only | ✅ Code + search + scraper + voice |
Star us on GitHub
Building toward AGI and artificial consciousness? Star the repo and help others find the path.
Contributors Hall of Fame
Show some love and end up in the hall of fame. Contributors get free merch and special access to our Discord.