mirror of
https://github.com/NousResearch/hermes-agent.git
synced 2026-05-02 08:47:26 +08:00
Broad drift audit against origin/main (b52b63396).
Reference pages (most user-visible drift):
- slash-commands: add /busy, /curator, /footer, /indicator, /redraw, /steer
that were missing; drop non-existent /terminal-setup; fix /q footnote
(resolves to /queue, not /quit); extend CLI-only list with all 24
CLI-only commands in the registry
- cli-commands: add dedicated sections for hermes curator / fallback /
hooks (new subcommands not previously documented); remove stale
hermes honcho standalone section (the plugin registers dynamically
via hermes memory); list curator/fallback/hooks in top-level table;
fix completion to include fish
- toolsets-reference: document the real 52-toolset count; split browser
vs browser-cdp; add discord / discord_admin / spotify / yuanbao;
correct hermes-cli tool count from 36 to 38; fix misleading claim
that hermes-homeassistant adds tools (it's identical to hermes-cli)
- tools-reference: bump tool count 55 -> 68; add 7 Spotify, 5 Yuanbao,
2 Discord toolsets; move browser_cdp/browser_dialog to their own
browser-cdp toolset section
- environment-variables: add 40+ user-facing HERMES_* vars that were
undocumented (--yolo, --accept-hooks, --ignore-*, inference model
override, agent/stream/checkpoint timeouts, OAuth trace, per-platform
batch tuning for Telegram/Discord/Matrix/Feishu/WeCom, cron knobs,
gateway restart/connect timeouts); dedupe the Cron Scheduler section;
replace stale QQ_SANDBOX with QQ_PORTAL_HOST
User-guide (top level):
- cli.md: compression preserves last 20 turns, not 4 (protect_last_n: 20)
- configuration.md: display.platforms is the canonical per-platform
override key; tool_progress_overrides is deprecated and auto-migrated
- profiles.md: model.default is the config key, not model.model
- sessions.md: CLI/TUI session IDs use 6-char hex, gateway uses 8
- checkpoints-and-rollback.md: destructive-command list now matches
_DESTRUCTIVE_PATTERNS (adds rmdir, cp, install, dd)
- docker.md: the container runs as non-root hermes (UID 10000) via
gosu; fix install command (uv pip); add missing --insecure on the
dashboard compose example (required for non-loopback bind)
- security.md: systemctl danger pattern also matches 'restart'
- index.md: built-in tool count 47 -> 68
- integrations/index.md: 6 STT providers, 8 memory providers
- integrations/providers.md: drop fictional dashscope/qwen aliases
Features:
- overview.md: 9 image models (not 8), 9 TTS providers (not 5),
8 memory providers (Supermemory was missing)
- tool-gateway.md: 9 image models
- tools.md: extend common-toolsets list with search / messaging /
spotify / discord / debugging / safe
- fallback-providers.md: add 6 real providers from PROVIDER_REGISTRY
(lmstudio, kimi-coding-cn, stepfun, alibaba-coding-plan,
tencent-tokenhub, azure-foundry)
- plugins.md: Available Hooks table now includes on_session_finalize,
on_session_reset, subagent_stop
- built-in-plugins.md: add the 7 bundled plugins the page didn't
mention (spotify, google_meet, three image_gen providers, two
dashboard examples)
- web-dashboard.md: add --insecure and --tui flags
- cron.md: hermes cron create takes positional schedule/prompt, not
flags
Messaging:
- telegram.md: TELEGRAM_WEBHOOK_SECRET is now REQUIRED when
TELEGRAM_WEBHOOK_URL is set (gateway refuses to start without it
per GHSA-3vpc-7q5r-276h). Biggest user-visible drift in the batch.
- discord.md: HERMES_DISCORD_TEXT_BATCH_SPLIT_DELAY_SECONDS default
is 2.0, not 0.1
- dingtalk.md: document DINGTALK_REQUIRE_MENTION /
FREE_RESPONSE_CHATS / MENTION_PATTERNS / HOME_CHANNEL /
ALLOW_ALL_USERS that the adapter supports
- bluebubbles.md: drop fictional BLUEBUBBLES_SEND_READ_RECEIPTS env
var; the setting lives in platforms.bluebubbles.extra only
- qqbot.md: drop dead QQ_SANDBOX; add real QQ_PORTAL_HOST and
QQ_GROUP_ALLOWED_USERS
- wecom-callback.md: replace 'hermes gateway start' (service-only)
with 'hermes gateway' for first-time setup
Developer-guide:
- architecture.md: refresh tool/toolset counts (61/52), terminal
backend count (7), line counts for run_agent.py (~13.7k), cli.py
(~11.5k), main.py (~10.4k), setup.py (~3.5k), gateway/run.py
(~12.2k), mcp_tool.py (~3.1k); add yuanbao adapter, bump platform
adapter count 18 -> 20
- agent-loop.md: run_agent.py line count 10.7k -> 13.7k
- tools-runtime.md: add vercel_sandbox backend
- adding-tools.md: remove stale 'Discovery import added to
model_tools.py' checklist item (registry auto-discovery)
- adding-platform-adapters.md: mark send_typing / get_chat_info as
concrete base methods; only connect/disconnect/send are abstract
- acp-internals.md: ACP sessions now persist to SessionDB
(~/.hermes/state.db); acp.run_agent call uses
use_unstable_protocol=True
- cron-internals.md: gateway runs scheduler in a dedicated background
thread via _start_cron_ticker, not on a maintenance cycle; locking
is cross-process via fcntl.flock (Unix) / msvcrt.locking (Windows)
- gateway-internals.md: gateway/run.py ~12k lines
- provider-runtime.md: cron DOES support fallback (run_job reads
fallback_providers from config)
- session-storage.md: SCHEMA_VERSION = 11 (not 9); add migrations
10 and 11 (trigram FTS, inline-mode FTS5 re-index); add
api_call_count column to Sessions DDL; document messages_fts_trigram
and state_meta in the architecture tree
- context-compression-and-caching.md: remove the obsolete 'context
pressure warnings' section (warnings were removed for causing
models to give up early)
- context-engine-plugin.md: compress() signature now includes
focus_topic param
- extending-the-cli.md: _build_tui_layout_children signature now
includes model_picker_widget; add to default layout
Also fixed three pre-existing broken links/anchors the build warned
about (docker.md -> api-server.md, yuanbao.md -> cron-jobs.md and
tips#background-tasks, nix-setup.md -> #container-aware-cli).
Regenerated per-skill pages via website/scripts/generate-skill-docs.py
so catalog tables and sidebar are consistent with current SKILL.md
frontmatter.
docusaurus build: clean, no broken links or anchors.
235 lines
9.9 KiB
Markdown
235 lines
9.9 KiB
Markdown
---
|
|
sidebar_position: 9
|
|
title: "Tools Runtime"
|
|
description: "Runtime behavior of the tool registry, toolsets, dispatch, and terminal environments"
|
|
---
|
|
|
|
# Tools Runtime
|
|
|
|
Hermes tools are self-registering functions grouped into toolsets and executed through a central registry/dispatch system.
|
|
|
|
Primary files:
|
|
|
|
- `tools/registry.py`
|
|
- `model_tools.py`
|
|
- `toolsets.py`
|
|
- `tools/terminal_tool.py`
|
|
- `tools/environments/*`
|
|
|
|
## Tool registration model
|
|
|
|
Each tool module calls `registry.register(...)` at import time.
|
|
|
|
`model_tools.py` is responsible for importing/discovering tool modules and building the schema list used by the model.
|
|
|
|
### How `registry.register()` works
|
|
|
|
Every tool file in `tools/` calls `registry.register()` at module level to declare itself. The function signature is:
|
|
|
|
```python
|
|
registry.register(
|
|
name="terminal", # Unique tool name (used in API schemas)
|
|
toolset="terminal", # Toolset this tool belongs to
|
|
schema={...}, # OpenAI function-calling schema (description, parameters)
|
|
handler=handle_terminal, # The function that executes when the tool is called
|
|
check_fn=check_terminal, # Optional: returns True/False for availability
|
|
requires_env=["SOME_VAR"], # Optional: env vars needed (for UI display)
|
|
is_async=False, # Whether the handler is an async coroutine
|
|
description="Run commands", # Human-readable description
|
|
emoji="💻", # Emoji for spinner/progress display
|
|
)
|
|
```
|
|
|
|
Each call creates a `ToolEntry` stored in the singleton `ToolRegistry._tools` dict keyed by tool name. If a name collision occurs across toolsets, a warning is logged and the later registration wins.
|
|
|
|
### Discovery: `discover_builtin_tools()`
|
|
|
|
When `model_tools.py` is imported, it calls `discover_builtin_tools()` from `tools/registry.py`. This function scans every `tools/*.py` file using AST parsing to find modules that contain top-level `registry.register()` calls, then imports them:
|
|
|
|
```python
|
|
# tools/registry.py (simplified)
|
|
def discover_builtin_tools(tools_dir=None):
|
|
tools_path = Path(tools_dir) if tools_dir else Path(__file__).parent
|
|
for path in sorted(tools_path.glob("*.py")):
|
|
if path.name in {"__init__.py", "registry.py", "mcp_tool.py"}:
|
|
continue
|
|
if _module_registers_tools(path): # AST check for top-level registry.register()
|
|
importlib.import_module(f"tools.{path.stem}")
|
|
```
|
|
|
|
This auto-discovery means new tool files are picked up automatically — no manual list to maintain. The AST check only matches top-level `registry.register()` calls (not calls inside functions), so helper modules in `tools/` are not imported.
|
|
|
|
Each import triggers the module's `registry.register()` calls. Errors in optional tools (e.g., missing `fal_client` for image generation) are caught and logged — they don't prevent other tools from loading.
|
|
|
|
After core tool discovery, MCP tools and plugin tools are also discovered:
|
|
|
|
1. **MCP tools** — `tools.mcp_tool.discover_mcp_tools()` reads MCP server config and registers tools from external servers.
|
|
2. **Plugin tools** — `hermes_cli.plugins.discover_plugins()` loads user/project/pip plugins that may register additional tools.
|
|
|
|
## Tool availability checking (`check_fn`)
|
|
|
|
Each tool can optionally provide a `check_fn` — a callable that returns `True` when the tool is available and `False` otherwise. Typical checks include:
|
|
|
|
- **API key present** — e.g., `lambda: bool(os.environ.get("SERP_API_KEY"))` for web search
|
|
- **Service running** — e.g., checking if the Honcho server is configured
|
|
- **Binary installed** — e.g., verifying `playwright` is available for browser tools
|
|
|
|
When `registry.get_definitions()` builds the schema list for the model, it runs each tool's `check_fn()`:
|
|
|
|
```python
|
|
# Simplified from registry.py
|
|
if entry.check_fn:
|
|
try:
|
|
available = bool(entry.check_fn())
|
|
except Exception:
|
|
available = False # Exceptions = unavailable
|
|
if not available:
|
|
continue # Skip this tool entirely
|
|
```
|
|
|
|
Key behaviors:
|
|
- Check results are **cached per-call** — if multiple tools share the same `check_fn`, it only runs once.
|
|
- Exceptions in `check_fn()` are treated as "unavailable" (fail-safe).
|
|
- The `is_toolset_available()` method checks whether a toolset's `check_fn` passes, used for UI display and toolset resolution.
|
|
|
|
## Toolset resolution
|
|
|
|
Toolsets are named bundles of tools. Hermes resolves them through:
|
|
|
|
- explicit enabled/disabled toolset lists
|
|
- platform presets (`hermes-cli`, `hermes-telegram`, etc.)
|
|
- dynamic MCP toolsets
|
|
- curated special-purpose sets like `hermes-acp`
|
|
|
|
### How `get_tool_definitions()` filters tools
|
|
|
|
The main entry point is `model_tools.get_tool_definitions(enabled_toolsets, disabled_toolsets, quiet_mode)`:
|
|
|
|
1. **If `enabled_toolsets` is provided** — only tools from those toolsets are included. Each toolset name is resolved via `resolve_toolset()` which expands composite toolsets into individual tool names.
|
|
|
|
2. **If `disabled_toolsets` is provided** — start with ALL toolsets, then subtract the disabled ones.
|
|
|
|
3. **If neither** — include all known toolsets.
|
|
|
|
4. **Registry filtering** — the resolved tool name set is passed to `registry.get_definitions()`, which applies `check_fn` filtering and returns OpenAI-format schemas.
|
|
|
|
5. **Dynamic schema patching** — after filtering, `execute_code` and `browser_navigate` schemas are dynamically adjusted to only reference tools that actually passed filtering (prevents model hallucination of unavailable tools).
|
|
|
|
### Legacy toolset names
|
|
|
|
Old toolset names with `_tools` suffixes (e.g., `web_tools`, `terminal_tools`) are mapped to their modern tool names via `_LEGACY_TOOLSET_MAP` for backward compatibility.
|
|
|
|
## Dispatch
|
|
|
|
At runtime, tools are dispatched through the central registry, with agent-loop exceptions for some agent-level tools such as memory/todo/session-search handling.
|
|
|
|
### Dispatch flow: model tool_call → handler execution
|
|
|
|
When the model returns a `tool_call`, the flow is:
|
|
|
|
```
|
|
Model response with tool_call
|
|
↓
|
|
run_agent.py agent loop
|
|
↓
|
|
model_tools.handle_function_call(name, args, task_id, user_task)
|
|
↓
|
|
[Agent-loop tools?] → handled directly by agent loop (todo, memory, session_search, delegate_task)
|
|
↓
|
|
[Plugin pre-hook] → invoke_hook("pre_tool_call", ...)
|
|
↓
|
|
registry.dispatch(name, args, **kwargs)
|
|
↓
|
|
Look up ToolEntry by name
|
|
↓
|
|
[Async handler?] → bridge via _run_async()
|
|
[Sync handler?] → call directly
|
|
↓
|
|
Return result string (or JSON error)
|
|
↓
|
|
[Plugin post-hook] → invoke_hook("post_tool_call", ...)
|
|
```
|
|
|
|
### Error wrapping
|
|
|
|
All tool execution is wrapped in error handling at two levels:
|
|
|
|
1. **`registry.dispatch()`** — catches any exception from the handler and returns `{"error": "Tool execution failed: ExceptionType: message"}` as JSON.
|
|
|
|
2. **`handle_function_call()`** — wraps the entire dispatch in a secondary try/except that returns `{"error": "Error executing tool_name: message"}`.
|
|
|
|
This ensures the model always receives a well-formed JSON string, never an unhandled exception.
|
|
|
|
### Agent-loop tools
|
|
|
|
Four tools are intercepted before registry dispatch because they need agent-level state (TodoStore, MemoryStore, etc.):
|
|
|
|
- `todo` — planning/task tracking
|
|
- `memory` — persistent memory writes
|
|
- `session_search` — cross-session recall
|
|
- `delegate_task` — spawns subagent sessions
|
|
|
|
These tools' schemas are still registered in the registry (for `get_tool_definitions`), but their handlers return a stub error if dispatch somehow reaches them directly.
|
|
|
|
### Async bridging
|
|
|
|
When a tool handler is async, `_run_async()` bridges it to the sync dispatch path:
|
|
|
|
- **CLI path (no running loop)** — uses a persistent event loop to keep cached async clients alive
|
|
- **Gateway path (running loop)** — spins up a disposable thread with `asyncio.run()`
|
|
- **Worker threads (parallel tools)** — uses per-thread persistent loops stored in thread-local storage
|
|
|
|
## The DANGEROUS_PATTERNS approval flow
|
|
|
|
The terminal tool integrates a dangerous-command approval system defined in `tools/approval.py`:
|
|
|
|
1. **Pattern detection** — `DANGEROUS_PATTERNS` is a list of `(regex, description)` tuples covering destructive operations:
|
|
- Recursive deletes (`rm -rf`)
|
|
- Filesystem formatting (`mkfs`, `dd`)
|
|
- SQL destructive operations (`DROP TABLE`, `DELETE FROM` without `WHERE`)
|
|
- System config overwrites (`> /etc/`)
|
|
- Service manipulation (`systemctl stop`)
|
|
- Remote code execution (`curl | sh`)
|
|
- Fork bombs, process kills, etc.
|
|
|
|
2. **Detection** — before executing any terminal command, `detect_dangerous_command(command)` checks against all patterns.
|
|
|
|
3. **Approval prompt** — if a match is found:
|
|
- **CLI mode** — an interactive prompt asks the user to approve, deny, or allow permanently
|
|
- **Gateway mode** — an async approval callback sends the request to the messaging platform
|
|
- **Smart approval** — optionally, an auxiliary LLM can auto-approve low-risk commands that match patterns (e.g., `rm -rf node_modules/` is safe but matches "recursive delete")
|
|
|
|
4. **Session state** — approvals are tracked per-session. Once you approve "recursive delete" for a session, subsequent `rm -rf` commands don't re-prompt.
|
|
|
|
5. **Permanent allowlist** — the "allow permanently" option writes the pattern to `config.yaml`'s `command_allowlist`, persisting across sessions.
|
|
|
|
## Terminal/runtime environments
|
|
|
|
The terminal system supports multiple backends:
|
|
|
|
- local
|
|
- docker
|
|
- ssh
|
|
- singularity
|
|
- modal
|
|
- daytona
|
|
- vercel_sandbox
|
|
|
|
It also supports:
|
|
|
|
- per-task cwd overrides
|
|
- background process management
|
|
- PTY mode
|
|
- approval callbacks for dangerous commands
|
|
|
|
## Concurrency
|
|
|
|
Tool calls may execute sequentially or concurrently depending on the tool mix and interaction requirements.
|
|
|
|
## Related docs
|
|
|
|
- [Toolsets Reference](../reference/toolsets-reference.md)
|
|
- [Built-in Tools Reference](../reference/tools-reference.md)
|
|
- [Agent Loop Internals](./agent-loop.md)
|
|
- [ACP Internals](./acp-internals.md)
|