Community performance summary
Gemma 4 12B
16 GPU configurations measured with this model. Compare hardware differences, quantizations and every recorded result.
22 signed runs · 2 verified · 7 testersWhat the results show
One clear view.
Every recorded run.
Measurements from comparable hardware and models are presented together. Medians show typical performance, while every signed run remains available below for inspection and sharing.
AMD Radeon Pro 5700 XT2 runs→Apple M1 Max1 run→AMD Radeon Pro 5600M1 run→AMD Radeon Vega3 runs→AMD Radeon RX Vega 561 run→AMD Radeon RX Vega 56 + AMD Radeon Pro WX 51001 run→AMD Radeon Pro WX 51001 run→AMD Radeon RX 6900 XT3 runs→AMD Radeon GFX10, 16 GB1 run→AMD Radeon Vega ×21 run→AMD Radeon Vega ×4 + AMD Radeon PRO W6800X Duo ×21 run→AMD Radeon Vega ×41 run→
Recorded evidence
Inspect every run.
Open any result to review its exact hardware, model configuration, measurements and submission details.
| Model / quant | Hardware | Architecture | Prompt | Generation | Source |
|---|---|---|---|---|---|
Gemma 4 12BQ4_K_M · Dense · comparison | RX 6950 XT16 GB VRAM | RDNA 2 | 595.7tok/s | 53.4tok/s | Community testerJul 16, 2026 |
Gemma 4 12BQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon RX 6900 XT15.98 GB VRAM | RDNA 2 | 757.14tok/s | 48.49tok/s | Dolphins1972Jul 23, 2026 |
Gemma 4 12BUD-Q4_K_XL · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon GFX10, 16 GB15.98 GB VRAM | RDNA | 825.73tok/s | 48.46tok/s | ToshLLM communityJul 24, 2026 |
Gemma 4 12BQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon RX 6900 XT15.98 GB VRAM | RDNA 2 | 800.04tok/s | 47.1tok/s | ToshLLM communityAug 1, 2026 |
Gemma 4 12BQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon RX 6900 XT ×231.97 GB VRAM | RDNA 2 | 585.78tok/s | 46.89tok/s | Dolphins1972Jul 18, 2026 |
Gemma 4 12BQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon PRO W6800X Duo ×2127.94 GB VRAM | RDNA 2 | 429.66tok/s | 40.3tok/s | Flint Ironstag✓Jul 18, 2026 |
Gemma 4 12BUD-Q4_K_XL · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon Vega15.98 GB VRAM | GCN / Vega | 368.27tok/s | 35.05tok/s | めろんSep 4, 2026 |
Gemma 4 12BUD-Q4_K_XL · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon RX 6700 XT11.98 GB VRAM | RDNA 2 | 337.18tok/s | 34.66tok/s | ToshLLM LabJul 18, 2026 |
Gemma 4 12BQ4_K_XL · Dense · comparison | RX 6700 XT12 GB VRAM | RDNA 2 | 342tok/s | 34tok/s | ToshLLM LabJul 15, 2026 |
Gemma 4 12BQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon RX 6900 XT15.98 GB VRAM | RDNA 2 | 763.1tok/s | 30.98tok/s | ToshLLM communityAug 10, 2026 |
Gemma 4 12BQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon Pro 5700 XT15.98 GB VRAM | RDNA 1 | 311.61tok/s | 30.01tok/s | ToshLLM communitySep 11, 2026 |
Gemma 4 12BQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon Pro 5700 XT15.98 GB VRAM | RDNA 1 | 313.59tok/s | 29.46tok/s | ToshLLM communityOct 2, 2026 |
Gemma 4 12BQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison | Apple M1 Max51.84 GB VRAM | Apple Silicon | 248.83tok/s | 26.31tok/s | simmc303Sep 22, 2026 |
Gemma 4 12BUD-Q4_K_XL · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon Pro 5600M7.98 GB VRAM | RDNA 1 | 222.53tok/s | 25.36tok/s | ToshLLM communitySep 8, 2026 |
Gemma 4 12BUD-Q4_K_XL · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon RX Vega 567.98 GB VRAM | GCN / Vega | 258.72tok/s | 24.24tok/s | めろんAug 25, 2026 |
Gemma 4 12BQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon Vega15.98 GB VRAM | GCN / Vega | 232.37tok/s | 20.94tok/s | ToshLLM community✓Jul 20, 2026 |
Gemma 4 12BQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon Vega15.98 GB VRAM | GCN / Vega | 230.23tok/s | 20.89tok/s | Flint Ironstag✓Jul 20, 2026 |
Gemma 4 12BQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon Vega ×4 + AMD Radeon PRO W6800X Duo ×2191.88 GB VRAM | GCN / Vega + RDNA 2 | 328.49tok/s | 19.1tok/s | Flint Ironstag✓Jul 20, 2026 |
Gemma 4 12BQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon Vega ×231.97 GB VRAM | GCN / Vega | 319.02tok/s | 14.86tok/s | ToshLLM communityJul 23, 2026 |
Gemma 4 12BUD-Q4_K_XL · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon RX Vega 56 + AMD Radeon Pro WX 510015.98 GB VRAM | GCN / Vega | 58.75tok/s | 13.41tok/s | めろんAug 25, 2026 |
Gemma 4 12BQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon Vega ×463.94 GB VRAM | GCN / Vega | 228.36tok/s | 13.3tok/s | Flint Ironstag✓Jul 20, 2026 |
Gemma 4 12BUD-Q4_K_XL · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon Pro WX 51008 GB VRAM | Unknown | 32.05tok/s | 7.68tok/s | めろんAug 25, 2026 |
∅
No matching runs
Try another model, GPU, or filter.