← Leaderboard

GLM-4.7-Flash with Hermes Agent

Q4_K_M (GGUF) on llama.cpp. Not tested yet

Task completion
Not tested yet
Tool-call success
Not tested yet
Decode tok/s
Not tested yet
Prefill tok/s
Not tested yet
Server memory
Not tested yet
Avg turns
Not tested yet

Setup

Model
GLM-4.7-Flash
Family / maker
GLM · Z.ai
Parameters
To be confirmed
Architecture
MoE
Weights
Exact repo confirmed at test time
Quant
Q4_K_M (GGUF)
Engine
llama.cpp (version recorded at test time)
Hermes Agent
Version recorded at test time
Tested
Not yet
Context
64K (planned)
Memory tier
≤24 GB (estimate)

Parameter count and memory tier to be confirmed from the model card.

Per-task results

Results for each of the 10 benchmark tasks will be listed here once tested.

Copy-paste config

The exact llama.cpp launch command will be published once it has been verified in testing. We only publish configs we have run.

Point Hermes Agent at it

# Point Hermes Agent at a local OpenAI-compatible server
hermes config set model.provider custom
hermes config set model.base_url http://localhost:8000/v1
hermes config set model.default <served-model-id>
hermes -z "Reply exactly HERMES_OK"

Generic Hermes Agent setup for any local OpenAI-compatible endpoint (from the Hermes Agent docs). Replace <served-model-id> with the id from curl -s http://localhost:8000/v1/models.