open-computer-use

open-computer-use is an open-source Computer Use service wrapped as an MCP server, maintained by iFurySt on GitHub under the MIT license. Any AI agent or MCP client can use it to run Computer Use on macOS, Linux, and Windows. The README says it was inspired by OpenAI's Codex Computer Use and built on top of Accessibility.

What It Is

It is a desktop automation layer for AI agents. It exposes native Computer Use tools over the Model Context Protocol, so a client such as Codex, Claude Code, Gemini CLI, or opencode can list apps, read app state, press keys, and otherwise operate GUI applications. It is installed as an npm package that provides the open-computer-use command and the short ocu alias.

Setup and Client Integration

After a global npm install, users add it to an agent either with a manual MCP JSON config or with built-in install commands. These commands cover Codex (config and plugin), Claude Code, Gemini CLI (project or user scope), opencode, and DeepSeek Harness. On macOS 14.0 or later, the first run requires granting Accessibility and Screen Recording permissions; the README says Windows and Linux do not need this step. A skill for Codex and Claude Code can also be installed through npx skills.

Command-Line Tooling

The CLI can call a single tool (such as list_apps or get_app_state), run a sequence of calls in one process so element indexes can be reused, and run JavaScript evaluations with ocu js or a session-persistent ocu repl. ocu doctor checks permissions, with JSON output on macOS, and ocu capabilities reports runtime availability. On macOS a targeted query feature finds controls by text or role without taking a screenshot. Persistent settings, such as the screenshot image format, are managed with ocu config. Smoke and stress test targets are available from a source checkout.

Cursor Motion

The project also includes Cursor Motion, an open-source cursor motion system for macOS based on public information shared by members of the Software.Inc team. It is distributed as an app on the Releases page.