← back to HERMES

README.md

54 lines

# HERMES

NousResearch Hermes 3 (Llama-3.1-8B) running via local Ollama on Mac2.

## What's installed

- **Model:** `hermes3:8b` (Q4_K_M, ~4.7GB) pulled into Ollama at `http://127.0.0.1:11434`.
- **Source:** [NousResearch/Hermes-3-Llama-3.1-8B](https://huggingface.co/NousResearch/Hermes-3-Llama-3.1-8B)
- **License:** Llama 3.1 Community License (permissive for research + most commercial use; check before redistribution).

## Quick start

```bash
# one-shot
./scripts/ask.sh "Summarize the difference between Hermes 3 and Llama 3.1 base."

# interactive REPL
./scripts/chat.sh

# smoke test (verifies model is loaded + responsive)
./scripts/smoke.sh
```

## HTTP API

Ollama exposes a local OpenAI-compatible endpoint:

```bash
curl http://127.0.0.1:11434/api/chat -d '{
  "model": "hermes3:8b",
  "messages": [{"role":"user","content":"hello"}],
  "stream": false
}'
```

## Slot in to Steve's stack

- **Debate team / idea-loop:** Hermes 3 can replace or augment qwen3:14b as a panelist. It's stronger on instruction-following and function-calling.
- **Tool-calling:** Hermes 3 supports structured tool calls — useful for the dw-* skill panelists.

## File layout

```
~/Projects/HERMES/
├── README.md
├── .gitignore
├── scripts/
│   ├── ask.sh      # one-shot prompt → stdout
│   ├── chat.sh     # interactive ollama run
│   └── smoke.sh    # 1-prompt liveness test
└── docs/
    └── (notes go here)
```