mirror of
https://github.com/tinyhumansai/openhuman.git
synced 2026-07-28 13:32:23 +00:00
* chore(workflows): comment out Windows smoke tests in installer and release workflows * feat: add usage field to ChatResponse structure - Introduced a new `usage` field in the `ChatResponse` struct across multiple files to track token usage information. - Updated various test cases and response handling to accommodate the new field, ensuring consistent behavior in the agent's responses. - Enhanced the `Provider` trait and related implementations to include the `usage` field in responses, improving observability of token usage during interactions. * feat: introduce structured error handling and event system for agent loop - Added a new `AgentError` enum to provide structured error types, allowing differentiation between retryable and permanent failures. - Implemented an `AgentEvent` enum for a typed event system, enhancing observability during agent loop execution. - Created a `ContextGuard` to manage context utilization and trigger auto-compaction, preventing infinite retry loops on compaction failures. - Updated the `mod.rs` file to include the new `UsageInfo` type for improved observability of token usage. - Added comprehensive tests for the new error handling and event system, ensuring robustness and reliability in agent operations. * feat: implement token cost tracking and error handling for agent loop - Introduced a `CostTracker` to monitor cumulative token usage and enforce daily budget limits, enhancing cost management in the agent loop. - Added structured error types in `AgentError` to differentiate between retryable and permanent failures, improving error handling and recovery strategies. - Implemented a typed event system with `AgentEvent` for better observability during agent execution, allowing multiple consumers to subscribe to events. - Developed a `ContextGuard` to manage context utilization and trigger auto-compaction, preventing excessive resource usage during inference calls. These enhancements improve the robustness and observability of the agent's operations, ensuring better resource management and error handling. * style: apply cargo fmt formatting Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com> * feat(agent): enhance error handling and event structure - Updated `AgentError` conversion to attempt recovery of typed errors wrapped in `anyhow`, improving error handling robustness. - Expanded `AgentEvent` enum to include `tool_arguments` and `tool_call_ids` for better context in tool calls, and added `output` and `tool_call_id` to `ToolExecutionComplete` for enhanced event detail. - Improved `EventSender` to clamp channel capacity to avoid panics and added tracing for event emissions, enhancing observability during event handling. * fix(agent): correct error conversion in AgentError implementation - Updated the conversion logic in the `From<anyhow::Error>` implementation for `AgentError` to return the `agent_err` directly instead of dereferencing it. This change improves the clarity and correctness of error handling in the agent's error management system. * refactor(config): simplify default implementations for ReflectionSource and PermissionLevel - Added `#[derive(Default)]` to `ReflectionSource` and `PermissionLevel` enums, removing custom default implementations for cleaner code. - Updated error handling in `handle_local_ai_set_ollama_path` to streamline serialization of service status. - Refactored error mapping in webhook registration and unregistration functions for improved readability. * refactor(config): clean up LearningConfig and PermissionLevel enums - Removed unnecessary blank lines in `LearningConfig` and `PermissionLevel` enums for improved code readability. - Consolidated `#[derive(Default)]` into a single line for `PermissionLevel`, streamlining the code structure. --------- Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
6.7 KiB
6.7 KiB
Telegram Login (Web → Desktop Handoff)
This app implements Telegram login for the desktop (Tauri) client using a system-browser auth flow plus a custom URL scheme deep link (openhuman://) to return control back to the desktop app.
High-level flow
- User clicks “Continue with Telegram” inside the desktop app.
- The app opens the system browser to the backend:
GET ${BACKEND_URL}/auth/telegram-widget?redirect=openhuman://auth
- The backend performs Telegram authentication (bot-based login / OAuth-like flow).
- On success, the backend generates a short-lived single-use
loginTokenand redirects the browser to:openhuman://auth?token=<loginToken>
- The OS routes that deep link to the installed desktop app.
- The desktop app extracts the
tokenfrom the deep link and exchanges it for a long-livedsessionTokenby calling a Rust Tauri command (bypassing CORS):POST ${BACKEND_URL}/auth/desktop-exchangewith{ token }
- The desktop app stores
sessionToken(and optionaluser) and navigates into onboarding.
Where this is implemented (current code)
1) Desktop UI entry point
The Telegram button in src/components/TelegramLoginButton.tsx opens the backend URL in the user’s system browser (via a Tauri command on desktop):
await startTelegramLoginWithUrl(BACKEND_URL);
The backend base URL is configured here (src/utils/config.ts):
export const BACKEND_URL =
import.meta.env.VITE_BACKEND_URL || 'https://2937933edf8a.ngrok-free.app';
2) Deep link registration (Tauri config + Rust)
The URL scheme is declared in src-tauri/tauri.conf.json:
{ "plugins": { "deep-link": { "desktop": { "schemes": ["openhuman"] } } } }
The deep-link plugin is initialized in src-tauri/src/lib.rs:
pub fn run() {
tauri::Builder::default()
.plugin(tauri_plugin_opener::init())
.plugin(tauri_plugin_deep_link::init())
.setup(|app| {
#[cfg(any(windows, target_os = "linux"))]
{
app.deep_link().register_all()?;
}
Ok(())
})
.invoke_handler(tauri::generate_handler![greet, exchange_token])
.run(tauri::generate_context!())
.expect("error while running tauri application");
}
3) Desktop deep link listener (frontend)
The listener is lazy-loaded in src/main.tsx:
import('./utils/desktopDeepLinkListener').then(m => {
m.setupDesktopDeepLinkListener().catch(err => {
console.error('[DeepLink] setup error:', err);
});
});
The deep link handler:
- Accepts only the
openhuman:scheme - Requires
openhuman://auth?token=... - Calls the Rust command
exchange_token - Stores
sessionTokenin Redux auth state - Redirects to
#/onboarding(HashRouter)
const handleDeepLinkUrls = async (urls: string[] | null | undefined) => {
if (!urls || urls.length === 0) return;
const url = urls[0];
try {
const parsed = new URL(url);
if (parsed.protocol !== 'openhuman:') return;
if (parsed.hostname !== 'auth') return;
const token = parsed.searchParams.get("token");
if (!token) return;
const data = await invoke("exchange_token", {
backendUrl: BACKEND_URL,
token,
});
// ... store sessionToken + user ...
window.location.hash = "/onboarding";
} catch (error) {
console.error("[DeepLink] Failed to handle deep link URL:", url, error);
}
};
4) Token exchange happens in Rust (CORS-safe)
The command exchange_token posts to the backend and returns the JSON body:
#[tauri::command]
async fn exchange_token(backend_url: String, token: String) -> Result<serde_json::Value, String> {
let client = reqwest::Client::new();
let url = format!("{}/auth/desktop-exchange", backend_url);
let response = client
.post(&url)
.header("Content-Type", "application/json")
.json(&serde_json::json!({ "token": token }))
.send()
.await
.map_err(|e| format!("Request failed: {}", e))?;
// ... status handling ...
Ok(body)
}
Backend contract (required for Telegram login to work)
Your backend must implement both:
A) GET /auth/telegram-widget?redirect=openhuman://auth
- Purpose: start Telegram auth in the user’s browser.
- On success:
- create/find user
- mint a short-lived
loginToken(single-use, recommended TTL (\le 5) minutes) - redirect to:
openhuman://auth?token=<loginToken>
B) POST /auth/desktop-exchange
- Purpose: exchange
loginTokenfor a long-lived desktop session token. - Request:
{ "token": "loginToken-from-deeplink" }
- Response (200):
{
"sessionToken": "long-lived-session-token",
"user": { "id": "uuid", "username": "string", "firstName": "string" }
}
Platform notes (important for “it works on my machine” issues)
- macOS: deep links do not work reliably in
tauri devbecause there’s no.appbundle/Info.plist. You generally need a built.appbundle (debug build is fine). - Windows/Linux: deep link scheme registration is done at runtime via
register_all()and works in dev more easily.
“Required code changes” checklist (to make Telegram login work properly)
Backend (required)
- Implement
GET /auth/telegram?platform=desktopand ensure it redirects toopenhuman://auth?token=...on success. - Implement
POST /auth/desktop-exchangeto exchange the login token for a session token. - Enforce security:
loginTokenis single-use- short TTL (recommended (\le 5) minutes)
- reject expired/reused tokens
Desktop app (required for reliable behavior)
- Ensure the deep-link plugin is configured and permitted:
src-tauri/tauri.conf.jsonincludes"schemes": ["openhuman"]src-tauri/capabilities/default.jsonincludes"deep-link:default"
- Use a real backend URL:
- set
VITE_BACKEND_URLfor dev/prod soLogin.tsxopens the correct domain
- set
Desktop app (recommended hardening / cleanup)
- Validate the deep link target more strictly in
src/utils/desktopDeepLinkListener.ts:- today it checks only
parsed.protocol === 'openhuman:' - recommended: also require
parsed.hostname === 'auth'(and optionally a known path)
- today it checks only
- Don’t skip Telegram auth in onboarding:
src/pages/onboarding/Step1Phone.tsxcurrently has a “Continue with Telegram” button that only navigates and does not authenticate.
- Remove sensitive Telegram secrets from frontend env:
- any
VITE_*variables are bundled into the frontend; don’t place bot tokens / api hashes there. - the desktop app typically only needs
VITE_BACKEND_URL; Telegram verification secrets should live on the backend.
- any