…Download

Community performance summary

AMD Radeon Pro 5600M

11 local models measured on this GPU configuration. Compare quantizations, configurations and the full observed performance range.

23 signed runs · 0 verified · 1 tester
Median prompt157.18tok/s · 99.37 to 1516.84
Median generation12.82tok/s · 8.93 to 93.53
Configurations7Q4_K_M · Q6_K · Q8_0
Last observedSep 10RDNA 1

What the results show

One clear view.
Every recorded run.

Measurements from comparable hardware and models are presented together. Medians show typical performance, while every signed run remains available below for inspection and sharing.

Models on this GPU11 groups
Qwen3.6 35B-A3B3 runs→Gemma 4 E4B1 run→Gemma 4 12B1 run→Gemma4 26B-A4B1 run→Gemma 4 26B-A4B7 runs→Qwen3 VL 2B1 run→Qwen3 4B1 run→Gemma 3 4B1 run→Qwen3 8B1 run→Qwen3 30B-A3B1 run→Hy MT2 30B5 runs→
macOS

macOS 15.7.7 Sequoia · macOS 15.7.9 Sequoia · macOS 26.6.2 Tahoe

Recorded evidence

Inspect every run.

Open any result to review its exact hardware, model configuration, measurements and submission details.

1 to 8 of 23 configurations

Verified benchmark Community submission
Model / quantHardwareArchitecturePromptGenerationSource
Qwen3 VL 2BQ8_0 · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison
AMD Radeon Pro 5600M7.98 GB VRAM
RDNA 1
1516.84tok/s
93.53tok/s
ToshLLM communitySep 3, 2026
Qwen3 4BQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison
AMD Radeon Pro 5600M7.98 GB VRAM
RDNA 1
587.58tok/s
55.42tok/s
ToshLLM communitySep 3, 2026
Gemma 3 4BQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison
AMD Radeon Pro 5600M7.98 GB VRAM
RDNA 1
687.55tok/s
55.06tok/s
ToshLLM communitySep 3, 2026
Gemma 4 E4BUD-Q4_K_XL · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison
AMD Radeon Pro 5600M7.98 GB VRAM
RDNA 1
558.48tok/s
51.25tok/s
ToshLLM communitySep 8, 2026
Qwen3 8BQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison
AMD Radeon Pro 5600M7.98 GB VRAM
RDNA 1
315.13tok/s
31.78tok/s
ToshLLM communitySep 3, 2026
Gemma 4 12BUD-Q4_K_XL · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison
AMD Radeon Pro 5600M7.98 GB VRAM
RDNA 1
222.53tok/s
25.36tok/s
ToshLLM communitySep 8, 2026
Qwen3 30B-A3BQ4_K_M · MoE · Signed ToshLLM app · ncmoe 40 · amd-gpu · Metal · comparison
AMD Radeon Pro 5600M7.98 GB VRAM
RDNA 1
170.51tok/s
17.11tok/s
ToshLLM communitySep 3, 2026
Qwen3.6 35B-A3BUD-Q2_K_XL · MoE · Signed ToshLLM app · ncmoe 23 · amd-gpu · Metal · comparison
AMD Radeon Pro 5600M7.98 GB VRAM
RDNA 1
287.01tok/s
16.88tok/s
ToshLLM communitySep 7, 2026
Qwen3.6 35B-A3BUD-Q4_K_M · MoE · Signed ToshLLM app · ncmoe 35 · amd-gpu · Metal · comparison
AMD Radeon Pro 5600M7.98 GB VRAM
RDNA 1
141.93tok/s
15.79tok/s
ToshLLM communitySep 10, 2026
Gemma4 26B-A4BQ4_K_M · MoE · Signed ToshLLM app · ncmoe 20 · amd-gpu · Metal · comparison
AMD Radeon Pro 5600M7.98 GB VRAM
RDNA 1
152.43tok/s
14.95tok/s
ToshLLM communitySep 8, 2026
Qwen3.6 35B-A3BUD-Q4_K_M · MoE · Signed ToshLLM app · ncmoe 35 · amd-gpu · Metal · comparison
AMD Radeon Pro 5600M7.98 GB VRAM
RDNA 1
141.58tok/s
13.96tok/s
ToshLLM communitySep 10, 2026
Gemma 4 26B-A4BUD-Q4_K_M · MoE · Signed ToshLLM app · ncmoe 40 · amd-gpu · Metal · comparison
AMD Radeon Pro 5600M7.98 GB VRAM
RDNA 1
175.87tok/s
12.82tok/s
ToshLLM communitySep 3, 2026
Hy MT2 30BQ6_K · MoE · Signed ToshLLM app · ncmoe 38 · amd-gpu · Metal · comparison
AMD Radeon Pro 5600M7.98 GB VRAM
RDNA 1
114.59tok/s
11.81tok/s
ToshLLM communitySep 1, 2026
Gemma 4 26B-A4BUD-Q4_K_M · MoE · Signed ToshLLM app · ncmoe 38 · amd-gpu · Metal · comparison
AMD Radeon Pro 5600M7.98 GB VRAM
RDNA 1
167.09tok/s
11.78tok/s
ToshLLM communityJul 24, 2026
Gemma 4 26B-A4BUD-Q4_K_M · MoE · Signed ToshLLM app · ncmoe 40 · amd-gpu · Metal · comparison
AMD Radeon Pro 5600M7.98 GB VRAM
RDNA 1
157.18tok/s
11.59tok/s
ToshLLM communitySep 1, 2026
Hy MT2 30BQ6_K · MoE · Signed ToshLLM app · ncmoe 40 · amd-gpu · Metal · comparison
AMD Radeon Pro 5600M7.98 GB VRAM
RDNA 1
109.04tok/s
11.53tok/s
ToshLLM communitySep 1, 2026
Gemma 4 26B-A4BUD-Q4_K_M · MoE · Signed ToshLLM app · ncmoe 40 · amd-gpu · Metal · comparison
AMD Radeon Pro 5600M7.98 GB VRAM
RDNA 1
174.36tok/s
11.17tok/s
ToshLLM communitySep 2, 2026
Hy MT2 30BQ6_K · MoE · Signed ToshLLM app · ncmoe 43 · amd-gpu · Metal · comparison
AMD Radeon Pro 5600M7.98 GB VRAM
RDNA 1
103.56tok/s
10.88tok/s
ToshLLM communityAug 31, 2026
Hy MT2 30BQ6_K · MoE · Signed ToshLLM app · ncmoe 43 · amd-gpu · Metal · comparison
AMD Radeon Pro 5600M7.98 GB VRAM
RDNA 1
99.65tok/s
10.83tok/s
ToshLLM communitySep 1, 2026
Gemma 4 26B-A4BUD-Q4_K_M · MoE · Signed ToshLLM app · ncmoe 37 · amd-gpu · Metal · comparison
AMD Radeon Pro 5600M7.98 GB VRAM
RDNA 1
105.03tok/s
10.6tok/s
ToshLLM communitySep 4, 2026
Gemma 4 26B-A4BUD-Q6_K · MoE · Signed ToshLLM app · ncmoe 40 · amd-gpu · Metal · comparison
AMD Radeon Pro 5600M7.98 GB VRAM
RDNA 1
113.05tok/s
10.19tok/s
ToshLLM communitySep 2, 2026
Gemma 4 26B-A4BUD-Q6_K · MoE · Signed ToshLLM app · ncmoe 40 · amd-gpu · Metal · comparison
AMD Radeon Pro 5600M7.98 GB VRAM
RDNA 1
99.85tok/s
9.88tok/s
ToshLLM communitySep 1, 2026
Hy MT2 30BQ6_K · MoE · Signed ToshLLM app · ncmoe 43 · amd-gpu · Metal · comparison
AMD Radeon Pro 5600M7.98 GB VRAM
RDNA 1
99.37tok/s
8.93tok/s
ToshLLM communityAug 31, 2026