Community performance summary

AMD Radeon Pro W5700X

3 local models measured on this GPU configuration. Compare quantizations, configurations and the full observed performance range.

3 signed runs · 0 verified · 2 testers
Median prompt528.85tok/s · 148.95 to 705.92
Median generation47.54tok/s · 16.16 to 73.3
Configurations3MXFP4 · Q4_K_M · UD-IQ3_S
Last observedOct 5RDNA 1

What the results show

One clear view.
Every recorded run.

Measurements from comparable hardware and models are presented together. Medians show typical performance, while every signed run remains available below for inspection and sharing.

Models on this GPU3 groups
GLM 4 9B1 run→Qwen3.8 27B1 run→GPT OSS 20B1 run→
macOS

macOS 15.8.1 Sequoia · macOS 26.5.2 Tahoe

Recorded evidence

Inspect every run.

Open any result to review its exact hardware, model configuration, measurements and submission details.

1 to 8 of 3 configurations

Verified benchmark Community submission
Model / quantHardwareArchitecturePromptGenerationSource
GPT OSS 20BMXFP4 · MoE · Signed ToshLLM app · amd-gpu · Metal · comparison
RDNA 1
705.92tok/s
73.3tok/s
ToshLLM communityJul 18, 2026
GLM 4 9BQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison
RDNA 1
528.85tok/s
47.54tok/s
alifeinbinaryOct 5, 2026
Qwen3.8 27BUD-IQ3_S · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison
RDNA 1
148.95tok/s
16.16tok/s
alifeinbinaryOct 1, 2026