BitGN ECOM Agent
ohikava/ecom-agent
Hermes-based agent for the BitGN E-commerce benchmark, locked to one MCP tool channel
BitGN ECOM Agent is an entry for the BitGN Agent Challenge: E-commerce benchmark, built on the Hermes CLI agent loop. It runs Hermes headless with every built-in toolset disabled and a single sandboxed MCP server as its only way to act.
What BitGN ECOM Agent does
BitGN ECOM Agent is built for the BitGN Agent Challenge: E-commerce benchmark, a simulated commercial environment where an agent handles product discovery, cart and checkout, payment-failure recovery, fraud defense, merchant operations, shipping, returns and support while staying inside business and security constraints. It uses the Hermes CLI agent loop: main.py runs the benchmark with parallel workers, per-task model routing and scoring, and hermes_agent.py bootstraps task context, builds the prompt, spawns hermes -z as a subprocess and parses the answer and references.
The agent is sandboxed to one tool channel, a custom bitgn-ecom MCP server that talks gRPC to each task's ECOM VM. Every built-in Hermes toolset, including terminal, filesystem, web, browser and code execution, is disabled, and Hermes runs from an isolated HERMES_HOME with no ~/.hermes fallback. Behavior is steered by an engineered operations prompt and three skills for fraud forensics, OCR receipt re-pricing and catalogue reporting. Inference goes through OpenRouter with a cheap default model, and only a hard cluster of tasks is routed to a stronger one.
Key features
- Runs Hermes headless with hermes -z inside an isolated HERMES_HOME
- Single bitgn-ecom MCP server as the only tool channel, with all built-in toolsets disabled
- Three domain skills: fraud forensics, OCR receipt re-pricing and catalogue reporting
- Cost-aware model routing over OpenRouter, with a stronger model only for hard task clusters
- Parallel workers, scoring and a JSONL debug trace writer
When to use it
- Studying how to run Hermes as a locked-down benchmark agent
- Reusing the isolated Hermes home and single MCP channel pattern for another sandboxed task
- Adapting the cheap-default, strong-fallback model routing to other agent evaluations
Who it is for: Developers entering agent benchmarks or looking for a worked example of Hermes in a single-tool-channel sandbox.
How it fits with Hermes Agent
Built on the Hermes CLI loop, called as a subprocess with an isolated Hermes home and all built-in toolsets replaced by one MCP server and three skills.
Requirements: Python 3.11+, an OpenRouter API key, a BitGN API key with access to the ECOM benchmark, and the hermes CLI
Note: It is written for the BitGN ECOM benchmark and needs BitGN access and an OpenRouter key to run.
FAQ
What is BitGN ECOM Agent?
BitGN ECOM Agent is an AI agent for the BitGN Agent Challenge: E-commerce benchmark. It is built on the Hermes CLI loop and uses a custom MCP server as its only tool channel.
Does BitGN ECOM Agent work with Hermes Agent?
Yes, it is built on Hermes. It spawns hermes -z in a subprocess with an isolated HERMES_HOME and disables every built-in Hermes toolset, so the model can only act through the MCP server.
What do I need to run BitGN ECOM Agent?
You need Python 3.11 or newer, an OpenRouter API key, a BitGN API key with access to the ECOM benchmark, and the hermes CLI.
Similar research for Hermes Agent
All researchPipeline that reads emotions from Hermes-4.3-36B hidden states and renders them as a live WebGL visual
ctala AI Benchmarks AlternativosOpen Spanish-language benchmark of LLMs for business and agent use, scored by an independent Phi-4 judge
stevibe HermesAgent-20BenchLocal benchmark of 20 scenarios scoring models as controllers of a real Hermes Agent runtime
CardSorting Raiden (Sky Circuit)Benchmark repository for long-horizon agentic development with Hermes, JoyZoning and JSDP
Ondemand-OSS Agentic Harness ArenaBlind arena that compares agent harnesses, including Hermes, on the same task and model, ranked by Elo
teknium1 Hermes and Jev Play MinecraftHermes Agent plans, Jev picks bounded actions and Mineflayer executes in Minecraft
Related guides: What is Hermes Agent?