waifu-sprites: plugin for Hermes Agent

Hermes dashboard plugin with a video companion that reacts to agent state and detected emotion

What waifu-sprites does

waifu-sprites is a Hermes Agent dashboard plugin that shows a video-based anime companion reacting to the agent's state in real time. Agent hooks such as pre_tool and post_llm write a state.json file. A FastAPI backend in dashboard/plugin_api.py reads that file and serves the matching MP4 clip, and a React front end plays it.

States include idle, listening, speaking, thinking, typing and searching, each mapped to a clip in the videos directory, where 1.mp4 is the idle clip. The plugin also detects emotions from the agent's responses and switches to matching clips, such as a happy one. The interface offers a floating draggable overlay, a sidebar widget and a full settings dashboard, and the backend exposes /status, /video/{key} and /config endpoints. The README describes the stack as a pure Python backend with a React front end built on the Hermes plugin SDK, and it lists hermes-agent and Python 3.8 or newer as prerequisites.

Key features

Real-time state tracking for idle, listening, speaking, thinking, typing and searching
Emotion detection from agent responses that switches to matching video clips
Floating draggable overlay, sidebar widget and settings dashboard
FastAPI backend with /status, /video/{key} and /config endpoints
Agent hooks that write state to state.json
React front end built on the Hermes plugin SDK

When to use it

Adding an animated companion to the Hermes dashboard
Seeing at a glance whether the agent is idle, thinking or editing files
Reading the plugin as an example of a Hermes dashboard plugin with hooks, a backend and a front end

Who it is for: Hermes Agent users who want an animated companion in their dashboard.

How it fits with Hermes Agent

Built for Hermes Agent as a dashboard plugin that uses agent hooks and the Hermes plugin SDK.

How to install waifu-sprites

These commands are copied from the project's README. Check the repository for the latest steps before you run them.

cd ~/.hermes/plugins
curl http://127.0.0.1:9119/api/dashboard/plugins/rescan

Requirements: hermes-agent installed and Python 3.8+

FAQ

What is waifu-sprites?

waifu-sprites is a dashboard plugin for Hermes Agent that displays a video companion. The companion changes clips as the agent idles, thinks, types or searches.

How do I install waifu-sprites?

Clone the repository into ~/.hermes/plugins, then rescan plugins from the Hermes dashboard or with the curl rescan command shown above. It needs hermes-agent and Python 3.8 or newer.

Is waifu-sprites free and open source?

Yes, the repository is released under the MIT-0 license, a permissive license that does not require attribution.