…Download

Community performance summary

Vega ×4 + W6800X Duo ×3

6 local models measured on this GPU configuration. Compare quantizations, configurations and the full observed performance range.

19 signed runs · 0 verified · 2 testers
Median prompt277.72tok/s · 228.36 to 794.46
Median generation23.49tok/s · 13.3 to 48.8
Configurations2Q4_K_M · UD-Q4_K_S
Last observedJul 20GCN / Vega + RDNA 2

What the results show

One clear view.
Every recorded run.

Measurements from comparable hardware and models are presented together. Medians show typical performance, while every signed run remains available below for inspection and sharing.

Models on this GPU6 groups
Qwen3 4B4 runs→Meta Llama 3.1 8B3 runs→Qwen3 8B3 runs→GLM 4 9B3 runs→Qwen3.6 35B-A3B2 runs→Gemma 4 12B4 runs→
macOS

macOS 26.5 Tahoe

Recorded evidence

Inspect every run.

Open any result to review its exact hardware, model configuration, measurements and submission details.

1 to 8 of 19 configurations

Verified benchmark Community submission
Model / quantHardwareArchitecturePromptGenerationSource
Qwen3 4BQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison
AMD Radeon Vega ×4 + AMD Radeon PRO W6800X Duo ×3191.88 GB VRAM
GCN / Vega + RDNA 2
552.59tok/s
48.8tok/s
ToshLLM community✓Jul 20, 2026
Qwen3 4BQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison
AMD Radeon Vega ×4 + AMD Radeon PRO W6800X Duo ×3191.88 GB VRAM
GCN / Vega + RDNA 2
794.46tok/s
41.07tok/s
Flint Ironstag✓Jul 20, 2026
Meta Llama 3.1 8BQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison
AMD Radeon Vega ×4 + AMD Radeon PRO W6800X Duo ×3191.88 GB VRAM
GCN / Vega + RDNA 2
277.72tok/s
34.4tok/s
ToshLLM community✓Jul 20, 2026
Qwen3 8BQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison
AMD Radeon Vega ×4 + AMD Radeon PRO W6800X Duo ×3191.88 GB VRAM
GCN / Vega + RDNA 2
266.06tok/s
33.27tok/s
ToshLLM community✓Jul 20, 2026
GLM 4 9BQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison
AMD Radeon Vega ×4 + AMD Radeon PRO W6800X Duo ×3191.88 GB VRAM
GCN / Vega + RDNA 2
252.37tok/s
31.39tok/s
Flint Ironstag✓Jul 20, 2026
Qwen3.6 35B-A3BUD-Q4_K_S · MoE · Signed ToshLLM app · amd-gpu · Metal · comparison
AMD Radeon Vega ×4 + AMD Radeon PRO W6800X Duo ×3191.88 GB VRAM
GCN / Vega + RDNA 2
426.35tok/s
31.28tok/s
Flint Ironstag✓Jul 20, 2026
Meta Llama 3.1 8BQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison
AMD Radeon Vega ×4 + AMD Radeon PRO W6800X Duo ×3191.88 GB VRAM
GCN / Vega + RDNA 2
408.46tok/s
30.83tok/s
Flint Ironstag✓Jul 20, 2026
Qwen3 8BQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison
AMD Radeon Vega ×4 + AMD Radeon PRO W6800X Duo ×3191.88 GB VRAM
GCN / Vega + RDNA 2
396.42tok/s
29.41tok/s
Flint Ironstag✓Jul 20, 2026
GLM 4 9BQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison
AMD Radeon Vega ×4 + AMD Radeon PRO W6800X Duo ×3191.88 GB VRAM
GCN / Vega + RDNA 2
373.62tok/s
27.19tok/s
Flint Ironstag✓Jul 20, 2026
Qwen3 4BQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison
AMD Radeon Vega ×4 + AMD Radeon PRO W6800X Duo ×3191.88 GB VRAM
GCN / Vega + RDNA 2
532.51tok/s
23.49tok/s
ToshLLM community✓Jul 20, 2026
Qwen3 4BQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison
AMD Radeon Vega ×4 + AMD Radeon PRO W6800X Duo ×3191.88 GB VRAM
GCN / Vega + RDNA 2
532.87tok/s
23.48tok/s
Flint Ironstag✓Jul 20, 2026
Gemma 4 12BQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison
AMD Radeon Vega ×4 + AMD Radeon PRO W6800X Duo ×3191.88 GB VRAM
GCN / Vega + RDNA 2
232.37tok/s
20.94tok/s
ToshLLM community✓Jul 20, 2026
Gemma 4 12BQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison
AMD Radeon Vega ×4 + AMD Radeon PRO W6800X Duo ×3191.88 GB VRAM
GCN / Vega + RDNA 2
230.23tok/s
20.89tok/s
Flint Ironstag✓Jul 20, 2026
Qwen3.6 35B-A3BUD-Q4_K_S · MoE · Signed ToshLLM app · amd-gpu · Metal · comparison
AMD Radeon Vega ×4 + AMD Radeon PRO W6800X Duo ×3191.88 GB VRAM
GCN / Vega + RDNA 2
237.43tok/s
20.22tok/s
Flint Ironstag✓Jul 20, 2026
Gemma 4 12BQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison
AMD Radeon Vega ×4 + AMD Radeon PRO W6800X Duo ×3191.88 GB VRAM
GCN / Vega + RDNA 2
328.49tok/s
19.1tok/s
Flint Ironstag✓Jul 20, 2026
Meta Llama 3.1 8BQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison
AMD Radeon Vega ×4 + AMD Radeon PRO W6800X Duo ×3191.88 GB VRAM
GCN / Vega + RDNA 2
271.81tok/s
17.97tok/s
Flint Ironstag✓Jul 20, 2026
Qwen3 8BQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison
AMD Radeon Vega ×4 + AMD Radeon PRO W6800X Duo ×3191.88 GB VRAM
GCN / Vega + RDNA 2
262.11tok/s
17.59tok/s
Flint Ironstag✓Jul 20, 2026
GLM 4 9BQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison
AMD Radeon Vega ×4 + AMD Radeon PRO W6800X Duo ×3191.88 GB VRAM
GCN / Vega + RDNA 2
247.23tok/s
17.15tok/s
Flint Ironstag✓Jul 20, 2026
Gemma 4 12BQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison
AMD Radeon Vega ×4 + AMD Radeon PRO W6800X Duo ×3191.88 GB VRAM
GCN / Vega + RDNA 2
228.36tok/s
13.3tok/s
Flint Ironstag✓Jul 20, 2026