GhostDesk
YV17labs/GhostDesk
MCP server that gives AI agents a full desktop they can see, click and type on
GhostDesk is a Rust MCP server that lets AI agents see the screen, move the mouse, type, launch apps and run shell commands on a sandboxed virtual Linux desktop or on a real Mac or Windows PC. The README lists Hermes Agent among the MCP clients it works with.
What GhostDesk does
One binary exposes one MCP endpoint over Streamable HTTP, and the same tools, such as mouse_click and app_launch, work on all three desktops. On Linux it runs as a Docker container with a virtual desktop inside the image, a disposable and sandboxed setup driven through zwlr_virtual_pointer_v1, Sway IPC and grim. On macOS and Windows it runs as a native binary against the machine in front of you, with no sandbox. The default image ships Firefox, the foot terminal, mousepad and galculator, and the agent user has passwordless sudo.
To connect Hermes Agent, point its MCP client config at http://localhost:3000/mcp. The README gives the same URL for Claude Code, Claude Desktop and OpenCode, with no headers needed in the demo posture. A secure local run adds TLS and authentication, the README covers running many agents, and a custom image can be built on a base image with other apps. Its demo prompt asks the agent to open Firefox, visit Google News and report the technology headlines.
Key features
- MCP server over Streamable HTTP with screen, mouse, keyboard, app launch and shell tools
- Sandboxed virtual Linux desktop in a Docker container
- Native binaries for macOS and Windows that drive the real desktop
- Default image with Firefox, foot, mousepad and galculator
- Secure local run with TLS and authentication
- Custom image support for other application sets
When to use it
- Automate legacy software or internal tools that have no API
- Let a Hermes agent browse a website in a disposable desktop
- Run QA flows through a real browser driven by an agent
Who it is for: Developers who want an AI agent, including Hermes Agent, to operate graphical applications.
How it fits with Hermes Agent
Hermes Agent is named as an MCP client that can use the same endpoint URL; the server is a general tool for any MCP-compatible agent.
How to install GhostDesk
These commands are copied from the project's README. Check the repository for the latest steps before you run them.
docker run -d --name ghostdesk-demo --shm-size 2g -p 3000:3000 -p 6080:6080 ghcr.io/yv17labs/ghostdesk:latestRequirements: Docker for the Linux container route; macOS and Windows use a native binary instead.
Note: The quick-start container runs over plain HTTP with every auth gate disarmed, which the README says is not fit for anything beyond a trusted laptop.
FAQ
What is GhostDesk?
GhostDesk is an MCP server that gives an AI agent a desktop to operate. The agent can see the screen, move the mouse, type, launch apps and run shell commands.
Does GhostDesk work with Hermes Agent?
Yes. The README lists Hermes Agent as an MCP client that connects to http://localhost:3000/mcp, the same URL used for Claude Code and OpenCode.
How do I install GhostDesk?
On Linux, run the Docker container from ghcr.io/yv17labs/ghostdesk:latest, publishing ports 3000 and 6080. On macOS and Windows the README describes running a native binary instead.
Similar mcp & tools for Hermes Agent
All mcp & toolsMCP server that lets Hermes control your real, logged-in Chrome with CDP, screenshots and physical input
asimons81 hermes-gptLocal-first MCP sidecar that exposes selected Hermes Agent capabilities to trusted MCP clients
sandbaseai SandBase CLILocal MCP bridge that connects 25 AI clients, including Hermes Agent, to SandBase models and APIs
agenticros AgenticROSROS 2 interface layer that lets AI agents, Hermes Agent included, control robots over MCP
aresyn Codex Control Plane MCPMCP server that turns Codex Desktop into a durable worker for long-running tasks
Cassette-Editor Oh My CassetteChat-driven AI video editing plugin and MCP server for Claude Code, Codex and Hermes
Related guides: What is Hermes Agent? · How to run Hermes Agent securely