mirror of
https://github.com/tinyhumansai/openhuman.git
synced 2026-07-30 23:14:37 +00:00
+16
Mega MindGitHubYellowSnnowmannSteven Enamakelgithub-actions[bot] <github-actions[bot]@users.noreply.github.com>Cyrus GrayHorst1993CursorJames GentesSamSami RusanioxoxDevMuhammad IsmailClaude Fable 5nb213binyangzhu000-sudoSteven EnamakelCodeGhost21sanil-23M3gA-MindoxoxDevmysma-9403mwakidenisNgoQuocViet2001viet.ngoMaciej Myszkiewicz
2e5b5e7b23
Mega MindGitHubYellowSnnowmannSteven Enamakelgithub-actions[bot] <github-actions[bot]@users.noreply.github.com>Cyrus GrayHorst1993CursorJames GentesSamSami RusanioxoxDevMuhammad IsmailClaude Fable 5nb213binyangzhu000-sudoSteven EnamakelCodeGhost21sanil-23M3gA-MindoxoxDevmysma-9403mwakidenisNgoQuocViet2001viet.ngoMaciej MyszkiewiczCo-authored-by: YellowSnnowmann <167776381+YellowSnnowmann@users.noreply.github.com> Co-authored-by: Steven Enamakel <31011319+senamakel@users.noreply.github.com> Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> Co-authored-by: Cyrus Gray <144336577+graycyrus@users.noreply.github.com> Co-authored-by: Horst1993 <horst.w@gmicloud.ai> Co-authored-by: Cursor <cursoragent@cursor.com> Co-authored-by: James Gentes <jgentes@users.noreply.github.com> Co-authored-by: Sam <samrusani@users.noreply.github.com> Co-authored-by: Sami Rusani <14844597+samrusani@users.noreply.github.com> Co-authored-by: oxoxDev <164490987+oxoxDev@users.noreply.github.com> Co-authored-by: Muhammad Ismail <78064250+myi1@users.noreply.github.com> Co-authored-by: Claude Fable 5 <noreply@anthropic.com> Co-authored-by: nb213 <binyangzhu000@gmail.com> Co-authored-by: binyangzhu000-sudo <224954946+binyangzhu000-sudo@users.noreply.github.com> Co-authored-by: Steven Enamakel <enamakel@tinyhumans.ai> Co-authored-by: CodeGhost21 <164498022+CodeGhost21@users.noreply.github.com> Co-authored-by: sanil-23 <sanil@tinyhumans.ai> Co-authored-by: M3gA-Mind <elvin@mahadao.com> Co-authored-by: oxoxDev <oxoxdev@users.noreply.github.com> Co-authored-by: mysma-9403 <64923976+mysma-9403@users.noreply.github.com> Co-authored-by: mwakidenis <mwakidenice@gmail.com> Co-authored-by: NgoQuocViet2001 <123613986+NgoQuocViet2001@users.noreply.github.com> Co-authored-by: viet.ngo <viet.ngo@sotatek.com> Co-authored-by: Maciej Myszkiewicz <mmyszkiewicz@bwcoders.com>
33 lines
1.4 KiB
Markdown
33 lines
1.4 KiB
Markdown
---
|
|
description: Open URLs, inspect DOM snapshots, click, type, and move the mouse - natively.
|
|
icon: display
|
|
---
|
|
|
|
# Browser & Computer Control
|
|
|
|
When the agent needs to *use* your machine the way a person would - open a page, inspect its DOM snapshot, click a button, type a phrase - these tools are how it does it.
|
|
|
|
## Browser
|
|
|
|
* **Open** a URL in an embedded webview the agent can read back from.
|
|
* **Snapshot** the current page's accessibility/DOM structure, including stable element references for later actions.
|
|
|
|
The browser surface runs through CEF (Chromium Embedded Framework) and includes a security layer that scopes what pages can do. See [Chromium Embedded Framework](../../developing/cef.md) for the platform details.
|
|
|
|
## Computer (mouse + keyboard)
|
|
|
|
* **Mouse** - move, click, drag.
|
|
* **Keyboard** - type text, send key chords.
|
|
* **Human path** - moves and clicks follow human-like trajectories rather than teleporting, so they don't trip naive bot detection.
|
|
|
|
## What it's good for
|
|
|
|
* Driving sites that don't have an API or a [native integration](../integrations/README.md).
|
|
* Multi-step UI flows where an interactive DOM snapshot provides the next actionable element.
|
|
* Automating local apps from inside a chat.
|
|
|
|
## See also
|
|
|
|
* [Web Scraper](web-scraper.md) - when you only need the article, not the whole page.
|
|
* [Chromium Embedded Framework](../../developing/cef.md) - the runtime browser layer.
|