grafana-agento11y-hermes

What grafana-agento11y-hermes does

grafana-agento11y-hermes is an unofficial plugin that connects Hermes Agent to Grafana Agent Observability. It records LLM calls and tool executions as generations and emits OpenTelemetry traces and metrics to a Grafana Cloud stack. The setup values come from one page in the stack: create a token, copy it as environment variables, and place the block in the environment Hermes starts from, including AGENTO11Y_ENDPOINT and OTEL_EXPORTER_OTLP_ENDPOINT.

By default the plugin records full content, so the system prompt, tool definitions, prompts, replies, tool arguments and tool results all leave the machine. Setting AGENTO11Y_CONTENT_CAPTURE_MODE=metadata_only keeps recording every call without sending prompts, responses or tool input and output. The plugin is enabled by editing plugins.enabled in ~/.hermes/config.yaml, because hermes plugins enable and hermes plugins list do not see pip-installed plugins. The repository is archived, and the README says the project has moved to grafana/agento11y/plugins/hermes. It replaces the earlier hermes-plugin-sigil package, whose SIGIL_* variables were renamed to AGENTO11Y_*.

Key features

• Records LLM calls and tool executions as generations
• Emits OpenTelemetry traces and metrics to Grafana Cloud
• Metadata-only mode that keeps prompts and tool I/O on the machine
• Setup through a single page in the Grafana stack that generates environment variables
• AGENTO11Y_DEBUG logging to confirm the tracer is installed
• Migration steps from the earlier hermes-plugin-sigil package

When to use it

• Tracing which model calls and tools a Hermes Agent run used
• Monitoring Hermes Agent activity alongside other services in Grafana
• Sending only call metadata to Grafana when prompts must stay local

Who it is for: Hermes Agent users with a Grafana Cloud stack who want observability data on their agent runs.

How it fits with Hermes Agent

A plugin for Hermes Agent, installed into the same Python environment Hermes runs from and enabled under plugins.enabled in config.yaml.

How to install grafana-agento11y-hermes

These commands are copied from the project's README. Check the repository for the latest steps before you run them.

pip install grafana-agento11y-hermes

Requirements: A Grafana Cloud account (the README says the free tier is enough) with credentials from the Agent Observability setup page, installed in the same Python environment as Hermes.

Note: The repository is archived, and the README says the project has moved to grafana/agento11y/plugins/hermes.

FAQ