computer-use
GitHub通过 Orca CLI 驱动本地应用 GUI,支持点击、输入及截图。优先使用程序化接口,仅在需要可见窗口控制时使用。
Trigger Scenarios
Install
npx skills add stablyai/orca --skill computer-use -g -y
SKILL.md
Frontmatter
{
"name": "computer-use",
"description": "Drives the GUI of a visible local app window through `orca computer`: accessibility tree, clicks, typing, menus, dialogs, and screenshots in native apps and external browser windows (Chrome, Edge, Safari) or webviews. Prefer a programmatic path (shell, filesystem, git, HTTP, existing CLIs) whenever it can complete the task. Use only when a visible window needs GUI control those cannot reach. Do not use for Orca's embedded browser (`orca-cli`)."
}
Computer Use
This discovery stub loads the version-matched guide from the Orca executable used for this session.
Resolve the CLI for this session
Choose the executable once and reuse it for every later command:
- If the
ORCA_CLI_COMMANDenvironment variable is set, use its value. Orca exports this for managed WSL sessions. - Otherwise, in a dev checkout whose session exposes
ORCA_DEV_REPO_ROOT, useorca-dev. - Otherwise, on Linux outside an Orca-managed terminal, use
orca-ide. Never run bareorcathere — outside Orca's terminals it normally resolves to the GNOME Orca screen reader (/usr/bin/orca) and starts speech on the user's machine. - Otherwise, use
orca.
Below, ORCA is a placeholder for the executable you resolved. Substitute it before
running anything; do not create a shell variable or run ORCA literally. This works the
same way in POSIX shells, PowerShell, and cmd.exe.
If the selected executable cannot run, report its exact error and stop. Do not fall through to another executable, which could silently target a different Orca build.
Load the version-matched guide before running Orca commands
ORCA skills get computer-use
Prefer --json. Use the selected executable's --help for commands or flags the guide does
not cover. If a command reports that Orca is not running, start it with ORCA open --json
and retry. If it fails with runtime_access_denied, your sandbox blocked the connection:
re-run it with escalated permissions, and do not run ORCA open or restart Orca. If
skills get is unknown, explain that updating Orca restores the guide; use --help for
read-only discovery and do not guess unsupported commands.
Version History
-
27b823f
Current 2026-09-27 19:54
修复沙箱环境下运行时连接被拒时错误报告问题,明确提示提升权限而非重启应用
-
15472cd
2026-09-22 08:05
修复触发范围,排除文件系统和 Shell 任务;明确优先使用程序化路径;移除编排和 orca-cli 中的不当路由指引。
-
6108ce6
2026-09-09 02:31
重写非编排指南,优化 CLI 解析逻辑,修复文档缺陷并增强安全性约束。
-
f19a860
2026-09-03 04:04
修复技能发现边界,明确区分计算机使用与页面自动化场景,移除格式噪声。
- eab721e 2026-07-24 11:46


