Community performance summary

AMD Radeon RX 580

17 local models measured on this GPU configuration. Compare quantizations, configurations and the full observed performance range.

20 signed runs · 0 verified · 3 testers
Median prompt273.78tok/s · 105.04 to 640.27
Median generation38.08tok/s · 1.09 to 65.23
Configurations8BF16 · K-quant · Q1_0
Last observedSep 14GCN / Vega

What the results show

One clear view.
Every recorded run.

Measurements from comparable hardware and models are presented together. Medians show typical performance, while every signed run remains available below for inspection and sharing.

Recorded evidence

Inspect every run.

Open any result to review its exact hardware, model configuration, measurements and submission details.

1 to 8 of 20 configurations

Verified benchmark Community submission
Model / quantHardwareArchitecturePromptGenerationSource
Qwen2.5 Coder 1.5BQ8_0 · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison
GCN / Vega
640.27tok/s
65.23tok/s
cloudphreniaSep 10, 2026
LFM2.5 VL 3BQ8_0 · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison
GCN / Vega
352.07tok/s
51.65tok/s
cloudphreniaSep 14, 2026
Qwen K-quantK-quant · Dense · Wave64 path; model details pending verification · comparison
RX 5808 GB VRAM
GCN / Vega
285tok/s
51tok/s
Community testerJul 11, 2026
MiniCPM5 2.6BQ8_0 · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison
GCN / Vega
395.82tok/s
47.27tok/s
cloudphreniaSep 10, 2026
LFM2.5 8B-A1BQ4_K_M · MoE · Signed ToshLLM app · ncmoe 4 · amd-gpu · Metal · comparison
GCN / Vega
374.39tok/s
44.37tok/s
cloudphreniaSep 14, 2026
Nanbeige4.1 3BQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison
GCN / Vega
292.99tok/s
43.63tok/s
cloudphreniaSep 14, 2026
Smollm3 3BQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison
GCN / Vega
315.9tok/s
43.32tok/s
cloudphreniaSep 14, 2026
Nanbeige4.1 3BQ8_0 · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison
GCN / Vega
276.21tok/s
39.57tok/s
cloudphreniaSep 14, 2026
Gemma 4 E2BQ4_K · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison
GCN / Vega
421.41tok/s
38.44tok/s
cloudphreniaSep 10, 2026
Phi 4 Mini InstructQ8_0 · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison
GCN / Vega
264.77tok/s
38.43tok/s
cloudphreniaSep 14, 2026
Qwen3 4BQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison
GCN / Vega
271.35tok/s
37.72tok/s
htweedieSep 5, 2026
Bonsai 8BQ1_0 · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison
GCN / Vega
133.93tok/s
36.05tok/s
cloudphreniaSep 14, 2026
Granite 4.2 3BQ8_0 · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison
GCN / Vega
232.69tok/s
34.13tok/s
cloudphreniaSep 14, 2026
Qwen2.5 Coder 7BQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison
GCN / Vega
138.96tok/s
30.07tok/s
cloudphreniaSep 10, 2026
Smollm3 3BBF16 · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison
GCN / Vega
383.9tok/s
28.55tok/s
cloudphreniaSep 14, 2026
Granite 4.2 3BBF16 · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison
GCN / Vega
259.3tok/s
24.26tok/s
cloudphreniaSep 14, 2026
Mistralai Mistral 7BQ8_0 · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison
GCN / Vega
122.26tok/s
22.62tok/s
cloudphreniaSep 14, 2026
Ornith 1.5 9BQ6_K · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison
GCN / Vega
105.04tok/s
22.5tok/s
cloudphreniaSep 14, 2026
Gemma 4 26B-A4BUD-Q4_K_M · MoE · Signed ToshLLM app · ncmoe 45 · amd-gpu · Metal · comparison
GCN / Vega
138.58tok/s
1.61tok/s
htweedieSep 8, 2026
Qwen3 Coder 30B-A3BQ4_K_M · MoE · Signed ToshLLM app · ncmoe 44 · amd-gpu · Metal · comparison
GCN / Vega
135.45tok/s
1.09tok/s
htweedieSep 8, 2026