Hermes Phone Agent: plugin for Hermes Agent

Two Hermes plugins and an Android helper APK that let Hermes control and react to a virtual phone

What Hermes Phone Agent does

Hermes Phone Agent has three parts. phone_use is a Hermes tool plugin that lets the agent control the phone: tap, swipe, type, screenshot and launch apps through ADB, with an optional Appium hybrid backend for Unicode text and WebView. phone_events is a platform plugin that lets the phone trigger the agent, reporting notifications, app switches and UI changes. A helper APK runs on the device and forwards rich events to the host.

How much the agent may do alone is set in phone-policy.yaml, copied to ~/.hermes/phone-policy.yaml, with the details in POLICY.md. The backend is chosen with HERMES_PHONE_BACKEND: adb is the default, hybrid adds Appium, and noop is for testing. Notification reports are redacted and truncated by default. From the configured owner chat in Telegram, /phone pause closes the phone gate and /phone resume reopens it. The README also describes an experimental WeChat quoted-reply feature that is pending device validation.

Key features

phone_use tool plugin: tap, swipe, type, screenshot and app launch through ADB
phone_events platform plugin that turns notifications and UI changes into agent triggers
Android helper APK that captures rich events on the device
Policy file phone-policy.yaml that separates autonomous actions from those needing approval
Backends: adb, hybrid with Appium, and noop
Telegram /phone pause, resume and status commands for the owner chat

When to use it

Letting Hermes operate apps on an Android emulator
Getting a Telegram report when a phone notification arrives
Pausing all phone control from Telegram when something looks wrong

Who it is for: Hermes Agent users who want an agent to operate or monitor an Android emulator.

How it fits with Hermes Agent

Built for Hermes Agent as two installable plugins, one tool plugin and one platform plugin, configured in ~/.hermes/config.yaml.

How to install Hermes Phone Agent

These commands are copied from the project's README. Check the repository for the latest steps before you run them.

hermes plugins install Ctrl-Creeper/hermes-phone-agent/plugins/phone_use
hermes plugins install Ctrl-Creeper/hermes-phone-agent/plugins/phone_events
hermes plugins enable phone_use
hermes plugins enable phone_events

Requirements: Hermes Agent, Android SDK Platform Tools with adb on PATH, and a running Android emulator; Appium is optional for the hybrid backend

Note: The WeChat quoted-reply feature is described as experimental, with device validation pending.

FAQ

What is Hermes Phone Agent?

Hermes Phone Agent is two Hermes plugins plus an Android helper APK. Together they let Hermes control a virtual Android phone and react to what happens on it.

How do I install Hermes Phone Agent?

Install both plugins with hermes plugins install, enable them with hermes plugins enable, and run ./setup.sh from a clone to install the helper APK on a running emulator and grant permissions.

Is Hermes Phone Agent free and open source?

Yes. The repository is released under the AGPL-3.0 license.