Community performance summary

AMD Radeon Pro 5700 XT

9 local models measured on this GPU configuration. Compare quantizations, configurations and the full observed performance range.

13 signed runs · 0 verified · 3 testers

Median prompt384.95tok/s · 194.85 to 1046.58

Median generation33.5tok/s · 21.9 to 75.93

Configurations4MXFP4 · Q4_K_M · UD-Q4_K_M

Last observedOct 2RDNA 1

What the results show

One clear view.
Every recorded run.

Measurements from comparable hardware and models are presented together. Medians show typical performance, while every signed run remains available below for inspection and sharing.

Models on this GPU9 groups

Qwen3 4B1 run→GPT OSS 20B1 run→Qwen3 8B1 run→Gemma 4 12B2 runs→Gemma 3 4B1 run→Meta Llama 3.1 8B1 run→GLM 4 9B1 run→Qwen3.6 35B-A3B4 runs→Gemma 4 26B-A4B1 run→

Recorded evidence

Inspect every run.

Open any result to review its exact hardware, model configuration, measurements and submission details.

ModelAppSort

1 to 8 of 13 configurations

Verified benchmark Community submission

Model / quant	Hardware	Architecture	Prompt	Generation	Source
Qwen3 4BQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison	AMD Radeon Pro 5700 XT15.98 GB VRAM	RDNA 1	945.19tok/s	75.93tok/s	ToshLLM communityOct 2, 2026
Gemma 3 4BQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison	AMD Radeon Pro 5700 XT15.98 GB VRAM	RDNA 1	1046.58tok/s	71.54tok/s	ToshLLM communitySep 11, 2026
GPT OSS 20BMXFP4 · MoE · Signed ToshLLM app · ncmoe 3 · amd-gpu · Metal · comparison	AMD Radeon Pro 5700 XT15.98 GB VRAM	RDNA 1	653.17tok/s	51.35tok/s	ToshLLM communityOct 2, 2026
Qwen3 8BQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison	AMD Radeon Pro 5700 XT15.98 GB VRAM	RDNA 1	488.41tok/s	47.44tok/s	ToshLLM communityOct 2, 2026
Meta Llama 3.1 8BQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison	AMD Radeon Pro 5700 XT15.98 GB VRAM	RDNA 1	436.77tok/s	46.46tok/s	Aaron.CAug 11, 2026
GLM 4 9BQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison	AMD Radeon Pro 5700 XT15.98 GB VRAM	RDNA 1	384.95tok/s	38.71tok/s	Aaron.CAug 11, 2026
Qwen3.6 35B-A3BUD-Q4_K_S · MoE · Signed ToshLLM app · ncmoe 10 · amd-gpu · Metal · comparison	AMD Radeon Pro 5700 XT15.98 GB VRAM	RDNA 1	194.85tok/s	33.5tok/s	tmnJul 18, 2026
Gemma 4 12BQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison	AMD Radeon Pro 5700 XT15.98 GB VRAM	RDNA 1	311.61tok/s	30.01tok/s	ToshLLM communitySep 11, 2026
Gemma 4 12BQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison	AMD Radeon Pro 5700 XT15.98 GB VRAM	RDNA 1	313.59tok/s	29.46tok/s	ToshLLM communityOct 2, 2026
Qwen3.6 35B-A3BUD-Q4_K_S · MoE · Signed ToshLLM app · ncmoe 17 · amd-gpu · Metal · comparison	AMD Radeon Pro 5700 XT15.98 GB VRAM	RDNA 1	341.07tok/s	29.09tok/s	tmnJul 18, 2026
Qwen3.6 35B-A3BUD-Q4_K_S · MoE · Signed ToshLLM app · ncmoe 16 · amd-gpu · Metal · comparison	AMD Radeon Pro 5700 XT15.98 GB VRAM	RDNA 1	348.2tok/s	29.06tok/s	tmnJul 18, 2026
Qwen3.6 35B-A3BUD-Q4_K_S · MoE · Signed ToshLLM app · ncmoe 16 · amd-gpu · Metal · comparison	AMD Radeon Pro 5700 XT15.98 GB VRAM	RDNA 1	368.16tok/s	27.49tok/s	Aaron.CAug 11, 2026
Gemma 4 26B-A4BUD-Q4_K_M · MoE · Signed ToshLLM app · ncmoe 16 · amd-gpu · Metal · comparison	AMD Radeon Pro 5700 XT15.98 GB VRAM	RDNA 1	424.08tok/s	21.9tok/s	Aaron.CAug 11, 2026

AMD Radeon Pro 5700 XT

One clear view.Every recorded run.

Inspect every run.

No matching runs

One clear view.
Every recorded run.