…Download

Community performance summary

AMD Radeon Vega

7 local models measured on this GPU configuration. Compare quantizations, configurations and the full observed performance range.

12 signed runs · 0 verified · 3 testers
Median prompt360.11tok/s · 230.23 to 1179.97
Median generation33.84tok/s · 20.89 to 60.54
Configurations3Q4_0 · Q4_K_M · UD-Q4_K_XL
Last observedOct 7GCN / Vega

What the results show

One clear view.
Every recorded run.

Measurements from comparable hardware and models are presented together. Medians show typical performance, while every signed run remains available below for inspection and sharing.

Models on this GPU7 groups
Hf 26B4 runs→Gemma 3 4B1 run→Gemma 4 12B3 runs→Qwen3 4B1 run→Meta Llama 3.1 8B1 run→Qwen3 8B1 run→GLM 4 9B1 run→
macOS

macOS 15.7.9 Sequoia · macOS 15.8.1 Sequoia · macOS 26.5 Tahoe

Recorded evidence

Inspect every run.

Open any result to review its exact hardware, model configuration, measurements and submission details.

1 to 8 of 12 configurations

Verified benchmark Community submission
Model / quantHardwareArchitecturePromptGenerationSource
Gemma 3 4BQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison
AMD Radeon Vega15.98 GB VRAM
GCN / Vega
1179.97tok/s
60.54tok/s
めろんSep 7, 2026
Hf 26BQ4_0 · MoE · Signed ToshLLM app · amd-gpu · Metal · comparison
AMD Radeon Vega15.98 GB VRAM
GCN / Vega
800.89tok/s
49.62tok/s
めろんOct 7, 2026
Qwen3 4BQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison
AMD Radeon Vega15.98 GB VRAM
GCN / Vega
552.59tok/s
48.8tok/s
ToshLLM community✓Jul 20, 2026
Hf 26BQ4_0 · MoE · Signed ToshLLM app · amd-gpu · Metal · comparison
AMD Radeon Vega15.98 GB VRAM
GCN / Vega
436.19tok/s
48.71tok/s
めろんSep 4, 2026
Gemma 4 12BUD-Q4_K_XL · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison
AMD Radeon Vega15.98 GB VRAM
GCN / Vega
368.27tok/s
35.05tok/s
めろんSep 4, 2026
Meta Llama 3.1 8BQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison
AMD Radeon Vega15.98 GB VRAM
GCN / Vega
277.72tok/s
34.4tok/s
ToshLLM community✓Jul 20, 2026
Qwen3 8BQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison
AMD Radeon Vega15.98 GB VRAM
GCN / Vega
266.06tok/s
33.27tok/s
ToshLLM community✓Jul 20, 2026
GLM 4 9BQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison
AMD Radeon Vega15.98 GB VRAM
GCN / Vega
252.37tok/s
31.39tok/s
Flint Ironstag✓Jul 20, 2026
Hf 26BQ4_0 · MoE · Signed ToshLLM app · ncmoe 2 · amd-gpu · Metal · comparison
AMD Radeon Vega15.98 GB VRAM
GCN / Vega
393.64tok/s
29.91tok/s
めろんSep 4, 2026
Hf 26BQ4_0 · MoE · Signed ToshLLM app · ncmoe 4 · amd-gpu · Metal · comparison
AMD Radeon Vega15.98 GB VRAM
GCN / Vega
351.94tok/s
23.83tok/s
めろんSep 11, 2026
Gemma 4 12BQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison
AMD Radeon Vega15.98 GB VRAM
GCN / Vega
232.37tok/s
20.94tok/s
ToshLLM community✓Jul 20, 2026
Gemma 4 12BQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison
AMD Radeon Vega15.98 GB VRAM
GCN / Vega
230.23tok/s
20.89tok/s
Flint Ironstag✓Jul 20, 2026