Community performance summary

AMD Radeon Pro 560X

10 local models measured on this GPU configuration. Compare quantizations, configurations and the full observed performance range.

19 signed runs · 0 verified · 2 testers
Median prompt92.48tok/s · 40.64 to 2195.09
Median generation12.39tok/s · 2.91 to 179.48
Configurations5IQ2_XS · Q2_K · Q3_K_M
Last observedSep 29GCN / Vega

What the results show

One clear view.
Every recorded run.

Measurements from comparable hardware and models are presented together. Medians show typical performance, while every signed run remains available below for inspection and sharing.

Recorded evidence

Inspect every run.

Open any result to review its exact hardware, model configuration, measurements and submission details.

1 to 8 of 19 configurations

Verified benchmark Community submission
Model / quantHardwareArchitecturePromptGenerationSource
Nomic Embed Text V2 MoEQ8_0 · MoE · Signed ToshLLM app · amd-gpu · Metal · comparison
GCN / Vega
2195.09tok/s
179.48tok/s
mitchdeSep 29, 2026
Nomic Embed Text V2 MoEQ8_0 · MoE · Signed ToshLLM app · amd-gpu · Metal · comparison
GCN / Vega
1378.77tok/s
167.97tok/s
mitchdeSep 11, 2026
Nomic Embed Text V2 MoEQ8_0 · MoE · Signed ToshLLM app · ncmoe 1 · amd-gpu · Metal · comparison
GCN / Vega
2188.48tok/s
165.08tok/s
mitchdeSep 25, 2026
Qwen2.5 1.5BQ8_0 · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison
GCN / Vega
255.5tok/s
33.67tok/s
mitchdeSep 12, 2026
Qwen2.5 Coder 1.5BQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison
GCN / Vega
266.32tok/s
31.63tok/s
mitchdeSep 12, 2026
Qwen3 VL 2BQ3_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison
GCN / Vega
229.37tok/s
27.52tok/s
mitchdeSep 11, 2026
Qwen2.5 3BQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison
GCN / Vega
127.77tok/s
21.04tok/s
ToshLLM communitySep 1, 2026
DeepSeek Coder V2 Lite InstructIQ2_XS · MoE · Signed ToshLLM app · ncmoe 16 · amd-gpu · Metal · comparison
GCN / Vega
111.72tok/s
16.37tok/s
mitchdeSep 24, 2026
DeepSeek Coder V2 Lite InstructIQ2_XS · MoE · Signed ToshLLM app · ncmoe 16 · amd-gpu · Metal · comparison
GCN / Vega
111.55tok/s
13.52tok/s
mitchdeSep 25, 2026
Qwen3 Coder 30B-A3BQ2_K · MoE · Signed ToshLLM app · ncmoe 42 · amd-gpu · Metal · comparison
GCN / Vega
82.07tok/s
12.39tok/s
mitchdeSep 29, 2026
Deepseek Ai Coder 6.7BQ3_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison
GCN / Vega
40.69tok/s
11.08tok/s
mitchdeSep 18, 2026
Qwen3 Coder 30B-A3BQ2_K · MoE · Signed ToshLLM app · ncmoe 43 · amd-gpu · Metal · comparison
GCN / Vega
82.3tok/s
10.4tok/s
mitchdeSep 25, 2026
DeepSeek Coder V2 Lite InstructIQ2_XS · MoE · Signed ToshLLM app · ncmoe 50 · amd-gpu · Metal · comparison
GCN / Vega
92.48tok/s
7.56tok/s
mitchdeSep 18, 2026
Qwen3 Coder 30B-A3BQ2_K · MoE · Signed ToshLLM app · ncmoe 48 · amd-gpu · Metal · comparison
GCN / Vega
79.58tok/s
5.24tok/s
mitchdeSep 24, 2026
Qwen3 Coder 30B-A3BQ2_K · MoE · Signed ToshLLM app · ncmoe 48 · amd-gpu · Metal · comparison
GCN / Vega
82.22tok/s
4.75tok/s
mitchdeSep 25, 2026
Qwen2.5 Coder 7BQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison
GCN / Vega
48.27tok/s
3.55tok/s
mitchdeSep 11, 2026
28bbf2fca3be77b1b80b7548f08c80cfe1bfbe08 8BQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison
GCN / Vega
40.64tok/s
2.91tok/s
mitchdeSep 12, 2026
28bbf2fca3be77b1b80b7548f08c80cfe1bfbe08 8BQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison
GCN / Vega
46.54tok/s
2.91tok/s
mitchdeSep 12, 2026
28bbf2fca3be77b1b80b7548f08c80cfe1bfbe08 8BQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison
GCN / Vega
46.12tok/s
2.91tok/s
mitchdeSep 11, 2026