…Download

Community performance summary

GLM 4 9B

2 GPU configurations measured with this model. Compare hardware differences, quantizations and every recorded result.

4 signed runs · 0 verified · 1 tester
Median prompt313tok/s · 247.23 to 528.49
Median generation29.29tok/s · 17.15 to 55.39
Configurations1Q4_K_M
Last observedJul 20GCN / Vega + RDNA 2 · RDNA 2

What the results show

One clear view.
Every recorded run.

Measurements from comparable hardware and models are presented together. Medians show typical performance, while every signed run remains available below for inspection and sharing.

Hardware tested2 groups
AMD Radeon Vega ×4 + AMD Radeon PRO W6800X Duo ×33 runs→AMD Radeon PRO W6800X Duo ×21 run→
macOS

macOS 26.5 Tahoe

Recorded evidence

Inspect every run.

Open any result to review its exact hardware, model configuration, measurements and submission details.

1 to 8 of 4 configurations

Verified benchmark Community submission
Model / quantHardwareArchitecturePromptGenerationSource
GLM 4 9BQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison
AMD Radeon PRO W6800X Duo ×2127.94 GB VRAM
RDNA 2
528.49tok/s
55.39tok/s
Flint Ironstag✓Jul 18, 2026
GLM 4 9BQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison
AMD Radeon Vega ×4 + AMD Radeon PRO W6800X Duo ×3191.88 GB VRAM
GCN / Vega + RDNA 2
252.37tok/s
31.39tok/s
Flint Ironstag✓Jul 20, 2026
GLM 4 9BQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison
AMD Radeon Vega ×4 + AMD Radeon PRO W6800X Duo ×3191.88 GB VRAM
GCN / Vega + RDNA 2
373.62tok/s
27.19tok/s
Flint Ironstag✓Jul 20, 2026
GLM 4 9BQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison
AMD Radeon Vega ×4 + AMD Radeon PRO W6800X Duo ×3191.88 GB VRAM
GCN / Vega + RDNA 2
247.23tok/s
17.15tok/s
Flint Ironstag✓Jul 20, 2026