Community performance summary

Gemma 4 26B A4B

13 GPU configurations measured with this model. Compare hardware differences, quantizations and every recorded result.

28 signed runs · 1 verified · 14 testers
Median prompt327.97tok/s · 99.85 to 1425.95
Median generation21.95tok/s · 1.61 to 73.54
Configurations7MXFP4 · Q4_K_M · Q8_0
Last observedOct 8Apple Silicon · GCN / Vega · GCN / Vega + RDNA 2 · RDNA 1 · RDNA 2 · Unknown

What the results show

One clear view.
Every recorded run.

Measurements from comparable hardware and models are presented together. Medians show typical performance, while every signed run remains available below for inspection and sharing.

Recorded evidence

Inspect every run.

Open any result to review its exact hardware, model configuration, measurements and submission details.

1 to 8 of 28 configurations

Verified benchmark Community submission
Model / quantHardwareArchitecturePromptGenerationSource
Gemma 4 26B-A4BUD-Q4_K_M · MoE · Signed ToshLLM app · amd-gpu · Metal · comparison
RDNA 2
1318.81tok/s
73.54tok/s
gervaiscoquil✓Jul 22, 2026
Gemma 4 26B-A4BUD-Q4_K_M · MoE · Signed ToshLLM app · amd-gpu · Metal · comparison
RDNA 2
1318.13tok/s
73.29tok/s
ToshLLM community✓Jul 22, 2026
Gemma 4 26B-A4BQ8_0 · MoE · Signed ToshLLM app · amd-gpu · Metal · comparison
GCN / Vega
765.81tok/s
65.41tok/s
warriordr7Oct 8, 2026
Gemma 4 26B-A4BUD-Q4_K_M · MoE · Signed ToshLLM app · amd-gpu · Metal · comparison
GCN / Vega + RDNA 2
1425.95tok/s
64.29tok/s
threadedSep 16, 2026
Gemma 4 26B-A4BUD-Q4_K_M · MoE · Signed ToshLLM app · amd-gpu · Metal · comparison
GCN / Vega + RDNA 2
904.07tok/s
57.49tok/s
threadedSep 16, 2026
Gemma 4 26B-A4BUD-Q4_K_M · MoE · Signed ToshLLM app · amd-gpu · Metal · comparison
GCN / Vega + RDNA 2
945.34tok/s
57.36tok/s
threadedSep 16, 2026
Gemma 4 26B-A4BUD-Q4_K_M · MoE · Signed ToshLLM app · amd-gpu · Metal · comparison
GCN / Vega + RDNA 2
948.35tok/s
57.33tok/s
threadedSep 16, 2026
Gemma 4 26B-A4BUD-Q4_K_M · MoE · Signed ToshLLM app · amd-gpu · Metal · comparison
GCN / Vega + RDNA 2
905.89tok/s
57.2tok/s
threadedSep 16, 2026
Gemma 4 26B-A4BUD-Q4_K_M · MoE · Signed ToshLLM app · amd-gpu · Metal · comparison
GCN / Vega + RDNA 2
904.81tok/s
55.83tok/s
threadedSep 15, 2026
Gemma 4 26B-A4BUD-Q4_K_M · MoE · Signed ToshLLM app · amd-gpu · Metal · comparison
GCN / Vega
484.84tok/s
48.18tok/s
gervaiscoquil✓Jul 18, 2026
GCN / Vega
190.3tok/s
47.9tok/s
Mac Pro communityJul 16, 2026
Gemma 4 26B-A4BUD-Q4_K_M · MoE · Signed ToshLLM app · amd-gpu · Metal · comparison
GCN / Vega
483.53tok/s
47.63tok/s
ButterChickenJul 20, 2026
Gemma 4 26B-A4BUD-Q4_K_M · MoE · Signed ToshLLM app · amd-gpu · Metal · comparison
Apple M1 Max51.84 GB VRAM
Apple Silicon
645.73tok/s
43.04tok/s
simmc303Sep 22, 2026
Gemma 4 26B A4BMXFP4 · MoE · CPU expert offload · comparison
RX 6700 XT12 GB VRAM
RDNA 2
552tok/s
22tok/s
ToshLLM LabJul 15, 2026
Gemma 4 26B-A4BUD-Q4_K_M · MoE · Signed ToshLLM app · ncmoe 16 · amd-gpu · Metal · comparison
RDNA 1
424.08tok/s
21.9tok/s
Aaron.CAug 11, 2026
Gemma 4 26B-A4BUD-Q4_K_XL · MoE · Signed ToshLLM app · ncmoe 3 · amd-gpu · Metal · comparison
GCN / Vega
108.98tok/s
20.1tok/s
めろんAug 25, 2026
Gemma 4 26B-A4BUD-Q4_K_M · MoE · Signed ToshLLM app · ncmoe 22 · amd-gpu · Metal · comparison
RDNA 2
231.85tok/s
17.29tok/s
ArdentwheelJul 20, 2026
Gemma 4 26B-A4BUD-Q4_K_M · MoE · Signed ToshLLM app · ncmoe 40 · amd-gpu · Metal · comparison
RDNA 1
175.87tok/s
12.82tok/s
ToshLLM communitySep 3, 2026
Gemma 4 26B-A4BUD-Q4_K_M · MoE · Signed ToshLLM app · ncmoe 38 · amd-gpu · Metal · comparison
RDNA 1
167.09tok/s
11.78tok/s
ToshLLM communityJul 24, 2026
Gemma 4 26B-A4BUD-Q4_K_M · MoE · Signed ToshLLM app · ncmoe 40 · amd-gpu · Metal · comparison
RDNA 1
157.18tok/s
11.59tok/s
ToshLLM communitySep 1, 2026
Gemma 4 26B-A4BUD-Q4_K_XL · MoE · Signed ToshLLM app · ncmoe 22 · amd-gpu · Metal · comparison
RDNA 1
207.43tok/s
11.19tok/s
mnerdJul 30, 2026
Gemma 4 26B-A4BUD-Q4_K_M · MoE · Signed ToshLLM app · ncmoe 40 · amd-gpu · Metal · comparison
RDNA 1
174.36tok/s
11.17tok/s
ToshLLM communitySep 2, 2026
Gemma 4 26B-A4BUD-Q4_K_M · MoE · Signed ToshLLM app · ncmoe 37 · amd-gpu · Metal · comparison
RDNA 1
105.03tok/s
10.6tok/s
ToshLLM communitySep 4, 2026
Gemma 4 26B-A4BUD-Q6_K · MoE · Signed ToshLLM app · ncmoe 40 · amd-gpu · Metal · comparison
RDNA 1
113.05tok/s
10.19tok/s
ToshLLM communitySep 2, 2026
Gemma 4 26B-A4BUD-Q6_K · MoE · Signed ToshLLM app · ncmoe 40 · amd-gpu · Metal · comparison
RDNA 1
99.85tok/s
9.88tok/s
ToshLLM communitySep 1, 2026
Gemma 4 26B-A4BUD-Q4_K_XL · MoE · Signed ToshLLM app · ncmoe 35 · amd-gpu · Metal · comparison
RDNA 1
150.24tok/s
9.71tok/s
mnerdJul 30, 2026
Gemma 4 26B-A4BUD-IQ3_S · MoE · Signed ToshLLM app · ncmoe 3 · amd-gpu · Metal · comparison
Unknown
116.33tok/s
7.48tok/s
1252er✓Aug 2, 2026
Gemma 4 26B-A4BUD-Q4_K_M · MoE · Signed ToshLLM app · ncmoe 45 · amd-gpu · Metal · comparison
GCN / Vega
138.58tok/s
1.61tok/s
htweedieSep 8, 2026