Community performance index
Real hardware.
Real numbers.
A living map of what local models can do on AMD-powered Macs. Standardized runs, honest context, and community data you can reproduce.
Submit your benchmark ↗Runs available197and growing
Models tested44Dense + MoE
GPU families38RDNA + GCN
Fastest generation297.01tokens / sec
| Model / quant | Hardware | Architecture | Prompt | Generation | Source |
|---|---|---|---|---|---|
Llama 3.2 1BQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon RX 6900 XT15.98 GB VRAM | RDNA 2 | 8088.69tok/s | 297.01tok/s | Dolphins1972Jul 23, 2026 |
Llama 3.2 1BQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon PRO W6800X31.98 GB VRAM | RDNA 2 | 5655.79tok/s | 288.64tok/s | BirdsLikeWiresJul 22, 2026 |
Llama 3.2 1BQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon RX 6900 XT ×231.97 GB VRAM | RDNA 2 | 5476.18tok/s | 268.45tok/s | Dolphins1972Jul 18, 2026 |
Llama 3.2 1BQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon RX 6900 XT ×231.97 GB VRAM | RDNA 2 | 8153.51tok/s | 266.14tok/s | Dolphins1972Jul 23, 2026 |
Llama 3.2 1BQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon RX 6900 XT ×231.97 GB VRAM | RDNA 2 | 8077.28tok/s | 265.52tok/s | Dolphins1972Jul 23, 2026 |
Llama 3.2 1BQ4_K_M · Dense · comparison | RX 6700 XT12 GB VRAM | RDNA 2 | 2994tok/s | 250tok/s | ToshLLM LabJul 15, 2026 |
Llama 3.2 1BQ8_0 · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon PRO W6800X31.98 GB VRAM | RDNA 2 | 5805.79tok/s | 233.02tok/s | BirdsLikeWiresJul 22, 2026 |
Llama 3.2 1BQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon RX 6900 XT15.98 GB VRAM | RDNA 2 | 6224.67tok/s | 206.18tok/s | ToshLLM communityAug 10, 2026 |
Qwen3 VL 2BQ8_0 · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon RX 6900 XT15.98 GB VRAM | RDNA 2 | 5211.36tok/s | 157.49tok/s | Dolphins1972Jul 23, 2026 |
Qwen3 VL 2BQ8_0 · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon PRO W6800X Duo31.98 GB VRAM | RDNA 2 | 4591.79tok/s | 151.79tok/s | PixlaAug 29, 2026 |
Qwen3 VL 2BQ8_0 · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon RX 6900 XT ×231.97 GB VRAM | RDNA 2 | 4478.11tok/s | 142.67tok/s | Dolphins1972Jul 18, 2026 |
Qwen3 VL 2BQ8_0 · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon RX 6900 XT15.98 GB VRAM | RDNA 2 | 6342.45tok/s | 129.18tok/s | ToshLLM communityAug 21, 2026 |
GPT OSS 20BQ4_K_M · MoE · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon RX 6900 XT15.98 GB VRAM | RDNA 2 | 1652.01tok/s | 118.87tok/s | Dolphins1972Jul 23, 2026 |
Qwen3 VL 2BQ8_0 · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon Pro Vega II Duo31.98 GB VRAM | GCN / Vega | 2269.3tok/s | 114.01tok/s | chafeyAug 27, 2026 |
Llama 3.2 1BQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon RX 6900 XT + AMD Radeon Vega31.97 GB VRAM | RDNA 2 + GCN / Vega | 3047.25tok/s | 113.04tok/s | ToshLLM communityAug 10, 2026 |
Qwen3 VL 2BQ8_0 · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon PRO W6800X Duo ×2127.94 GB VRAM | RDNA 2 | 3730.57tok/s | 110.75tok/s | ToshLLM communityJul 31, 2026 |
GPT OSS 20BQ4_K_M · MoE · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon PRO W6800X31.98 GB VRAM | RDNA 2 | 1334.01tok/s | 110.45tok/s | gervaiscoquil✓Jul 27, 2026 |
GPT OSS 20BQ4_K_M · MoE · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon RX 6900 XT ×231.97 GB VRAM | RDNA 2 | 1623.43tok/s | 106.16tok/s | Dolphins1972Jul 18, 2026 |
LLaMA V2 7BQ4_0 · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon GFX10, 16 GB15.98 GB VRAM | RDNA | 1508.5tok/s | 105.77tok/s | ToshLLM communityAug 6, 2026 |
MiniCPM5 1BQ8_0 · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon Pro 5500M7.98 GB VRAM | RDNA 1 | 2089.32tok/s | 105.13tok/s | ToshLLM communityAug 4, 2026 |
Llama 3.2 1BQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon Pro 5500M7.98 GB VRAM | RDNA 1 | 1602.61tok/s | 103.89tok/s | mnerdAug 31, 2026 |
Gemma 4 19BQ4_K_M · MoE · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon GFX10, 16 GB15.98 GB VRAM | RDNA | 1881.52tok/s | 99.11tok/s | ToshLLM communityAug 6, 2026 |
Qwen3 4BQ4_K_M · Dense · comparison | RX 6900 XT16 GB VRAM | RDNA 2 | 291.4tok/s | 97.5tok/s | Community testerJul 16, 2026 |
Qwen3 VL 2BQ8_0 · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon Pro Vega II31.98 GB VRAM | GCN / Vega | 2275.38tok/s | 96.88tok/s | simmc303Aug 26, 2026 |
GPT OSS 20BQ4_K_M · MoE · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon RX 6700 XT11.98 GB VRAM | RDNA 2 | 1083.66tok/s | 94.99tok/s | ToshLLM LabJul 27, 2026 |
Qwen3 Coder 30B-A3BQ4_K_M · MoE · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon PRO W6800X31.98 GB VRAM | RDNA 2 | 1293.17tok/s | 94.98tok/s | gervaiscoquil✓Jul 22, 2026 |
GLM 4.7 Flash 23B-A3BQ4_K_M · MoE · Signed ToshLLM app · ncmoe 1 · amd-gpu · Metal · comparison | AMD Radeon GFX10, 16 GB15.98 GB VRAM | RDNA | 1341.71tok/s | 94.83tok/s | ToshLLM communityAug 6, 2026 |
GPT OSS 20BQ4_K_M · MoE · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon RX 6700 XT11.98 GB VRAM | RDNA 2 | 1038.29tok/s | 94.59tok/s | ToshLLM LabJul 24, 2026 |
Gemma 4 A4B 98e V6 Coder ItQ4_K_M · MoE · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon GFX10, 16 GB15.98 GB VRAM | RDNA | 1773.77tok/s | 94.17tok/s | ToshLLM communityAug 6, 2026 |
Qwen3 4BQ4_K_M · Dense · comparison | RX 6700 XT12 GB VRAM | RDNA 2 | 1005tok/s | 94tok/s | ToshLLM LabJul 15, 2026 |
gpt-oss 20BQ4_K_M · MoE · Full VRAM · comparison | RX 6700 XT12 GB VRAM | RDNA 2 | 972tok/s | 93tok/s | ToshLLM LabJul 15, 2026 |
GPT OSS 20BQ4_K_M · MoE · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon RX 6700 XT11.98 GB VRAM | RDNA 2 | 1037.06tok/s | 92.94tok/s | ToshLLM LabJul 22, 2026 |
Gemma 3 4BQ4_K_M · Dense · comparison | RX 6700 XT12 GB VRAM | RDNA 2 | 1168tok/s | 90tok/s | ToshLLM LabJul 15, 2026 |
Qwen3 4BQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon PRO W6800X Duo ×2127.94 GB VRAM | RDNA 2 | 1271.9tok/s | 89.97tok/s | Flint Ironstag✓Jul 18, 2026 |
Qwen3 VL 2BQ8_0 · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon RX 6600 XT7.98 GB VRAM | RDNA 2 | 1971.4tok/s | 89.79tok/s | ardentwheelJul 20, 2026 |
Gemma 3 4BQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon RX 6700 XT11.98 GB VRAM | RDNA 2 | 1146.18tok/s | 87.63tok/s | ToshLLM LabJul 17, 2026 |
Llama 3.2 1BUD-Q5_K_XL · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon Pro 5500M7.98 GB VRAM | RDNA 1 | 1388.43tok/s | 85.26tok/s | mnerdJul 31, 2026 |
Liquid LFM2 8BQ4_K_M · MoE · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon Pro 5500M7.98 GB VRAM | RDNA 1 | 791.04tok/s | 85.01tok/s | mnerdAug 29, 2026 |
Qwen3 4BQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon RX 6900 XT15.98 GB VRAM | RDNA 2 | 2143.87tok/s | 81.82tok/s | ToshLLM communityAug 10, 2026 |
Meta Llama 3.1 8BQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon RX 6900 XT ×231.97 GB VRAM | RDNA 2 | 828.51tok/s | 77.02tok/s | Dolphins1972Jul 18, 2026 |
Feb5E04Da4910Dd56D33F0Cd03747Ff298C1E801 8B-A1BQ4_K_M · MoE · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon Pro 5500M7.98 GB VRAM | RDNA 1 | 787.47tok/s | 76.28tok/s | mnerdAug 29, 2026 |
Gemma 4 26B-A4BUD-Q4_K_M · MoE · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon PRO W6800X31.98 GB VRAM | RDNA 2 | 1318.81tok/s | 73.54tok/s | gervaiscoquil✓Jul 22, 2026 |
GPT OSS 20BMXFP4 · MoE · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon Pro W5700X15.98 GB VRAM | RDNA 1 | 705.92tok/s | 73.3tok/s | ToshLLM communityJul 18, 2026 |
Gemma 4 26B-A4BUD-Q4_K_M · MoE · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon PRO W6800X31.98 GB VRAM | RDNA 2 | 1318.13tok/s | 73.29tok/s | ToshLLM community✓Jul 22, 2026 |
LLaMA V2 7BQ4_0 · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon RX 6700 XT11.98 GB VRAM | RDNA 2 | 655.45tok/s | 72.73tok/s | ToshLLM LabJul 20, 2026 |
Models Zai Org GLM 4.6V FlashQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon GFX10, 16 GB15.98 GB VRAM | RDNA | 1131.82tok/s | 72.12tok/s | ToshLLM communityAug 6, 2026 |
Qwen3.6 35B-A3BUD-Q4_K_S · MoE · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon PRO W6800X Duo31.98 GB VRAM | RDNA 2 | 1253.18tok/s | 71.02tok/s | chafeyAug 25, 2026 |
Qwen3.6 35B-A3BUD-Q4_K_S · MoE · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon PRO W6800X Duo31.98 GB VRAM | RDNA 2 | 1262.58tok/s | 70.86tok/s | PixlaAug 29, 2026 |
Qwen3.6 35B-A3BUD-Q4_K_S · MoE · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon PRO W6800X Duo31.98 GB VRAM | RDNA 2 | 1254.93tok/s | 70.69tok/s | chafeyAug 23, 2026 |
Qwen3 4BQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon Pro Vega II31.98 GB VRAM | GCN / Vega | 1199.09tok/s | 69.2tok/s | simmc303Aug 26, 2026 |
Meta Llama 3.1 8BQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon PRO W6800X Duo ×2127.94 GB VRAM | RDNA 2 | 612.88tok/s | 67tok/s | Flint Ironstag✓Jul 18, 2026 |
Meta Llama 3.1 8BQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon PRO W6800X Duo ×2127.94 GB VRAM | RDNA 2 | 611.58tok/s | 66.87tok/s | ToshLLM community✓Jul 18, 2026 |
Qwen3 8BQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon PRO W6800X Duo ×2127.94 GB VRAM | RDNA 2 | 601.17tok/s | 65.24tok/s | Flint Ironstag✓Jul 18, 2026 |
Qwen3.6 35B-A3BUD-Q4_K_S · MoE · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon PRO W6800X31.98 GB VRAM | RDNA 2 | 1082.36tok/s | 63.55tok/s | BirdsLikeWiresJul 22, 2026 |
Qwen3.6 35B-A3BUD-Q4_K_S · MoE · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon PRO W6800X Duo31.98 GB VRAM | RDNA 2 | 1143.21tok/s | 63.38tok/s | PixlaAug 2, 2026 |
Qwen3.6 35B-A3BUD-Q4_K_S · MoE · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon PRO W6800X31.98 GB VRAM | RDNA 2 | 1156.32tok/s | 63.26tok/s | XanthousJul 28, 2026 |
Qwen3.6 35B-A3BUD-Q4_K_S · MoE · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon PRO W6800X Duo ×2127.94 GB VRAM | RDNA 2 | 1139.23tok/s | 63.14tok/s | Flint Ironstag✓Aug 22, 2026 |
Qwen3.6 35B-A3BUD-Q4_K_S · MoE · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon PRO W6800X Duo ×2127.94 GB VRAM | RDNA 2 | 1171.32tok/s | 62.94tok/s | Flint Ironstag✓Aug 22, 2026 |
Gemma 3 4BQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon RX 6600 XT7.98 GB VRAM | RDNA 2 | 899.15tok/s | 62.76tok/s | ArdentwheelJul 20, 2026 |
Qwen3 8BQ4_K_M · Dense · comparison | RX 6700 XT12 GB VRAM | RDNA 2 | 476tok/s | 60tok/s | ToshLLM LabJul 15, 2026 |
Qwen3 VL 2BQ8_0 · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon Pro 5500M7.98 GB VRAM | RDNA 1 | 963.76tok/s | 57.57tok/s | mnerdJul 31, 2026 |
Qwen3.6 14B A3BQ5_K_M · MoE · Full VRAM · comparison | RX 6700 XT12 GB VRAM | RDNA 2 | 736tok/s | 56tok/s | ToshLLM LabJul 15, 2026 |
Qwen3.6 35B-A3BUD-Q4_K_S · MoE · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon PRO W6800X Duo ×2127.94 GB VRAM | RDNA 2 | 1086.98tok/s | 55.79tok/s | PixlaAug 2, 2026 |
Qwen3.6 35B-A3BUD-Q4_K_S · MoE · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon PRO W6800X Duo ×2127.94 GB VRAM | RDNA 2 | 1102.7tok/s | 55.75tok/s | Flint Ironstag✓Aug 11, 2026 |
GLM 4 9BQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon PRO W6800X Duo ×2127.94 GB VRAM | RDNA 2 | 528.49tok/s | 55.39tok/s | Flint Ironstag✓Jul 18, 2026 |
Gemma 4 E4BUD-Q4_K_XL · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon VII15.98 GB VRAM | GCN / Vega | 825.1tok/s | 54.97tok/s | 1252er✓Jul 21, 2026 |
Qwen3 Coder 30B-A3BQ4_K_M · MoE · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon Pro Vega II31.98 GB VRAM | GCN / Vega | 617.65tok/s | 54.89tok/s | simmc303Aug 28, 2026 |
Qwen3.6 35B-A3BUD-Q4_K_S · MoE · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon PRO W6800X Duo ×2127.94 GB VRAM | RDNA 2 | 952.42tok/s | 54.76tok/s | Flint Ironstag✓Jul 18, 2026 |
Qwen3.6 35B-A3BUD-Q4_K_S · MoE · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon PRO W6800X Duo ×2127.94 GB VRAM | RDNA 2 | 940.75tok/s | 54.54tok/s | Flint Ironstag✓Jul 18, 2026 |
Gemma 4 12BQ4_K_M · Dense · comparison | RX 6950 XT16 GB VRAM | RDNA 2 | 595.7tok/s | 53.4tok/s | Community testerJul 16, 2026 |
Qwen3 Coder 30B-A3BQ4_K_M · MoE · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon Pro Vega II31.98 GB VRAM | GCN / Vega | 346.78tok/s | 53.32tok/s | gervaiscoquil✓Jul 18, 2026 |
Qwen3.6 12BQ5_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon GFX10, 16 GB15.98 GB VRAM | RDNA | 855.26tok/s | 52.83tok/s | ToshLLM communityAug 6, 2026 |
Qwen2.5 Coder 7BQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon RX 5700 XT7.98 GB VRAM | RDNA 1 | 495.6tok/s | 52.31tok/s | blacklizardJul 31, 2026 |
Qwen3 4BQ4_K_M · Dense · comparison | RX 5600 XT6 GB VRAM | RDNA 1 | 100tok/s | 52.1tok/s | Community testerJul 16, 2026 |
Qwen3.8 9BQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon RX 6700 XT11.98 GB VRAM | RDNA 2 | 756.54tok/s | 52.03tok/s | ToshLLM LabAug 21, 2026 |
Qwen K-quantK-quant · Dense · Wave64 path; model details pending verification · comparison | RX 5808 GB VRAM | GCN / Vega | 285tok/s | 51tok/s | Community testerJul 11, 2026 |
Gemma4 V2 Merged 12BFP16 · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon GFX10, 16 GB15.98 GB VRAM | RDNA | 833tok/s | 50.83tok/s | ToshLLM communityAug 6, 2026 |
Ornith 1.0 35BQ4_K_M · MoE · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon Pro W5700X ×231.97 GB VRAM | RDNA 1 | 703.09tok/s | 49.49tok/s | HypabolicAug 12, 2026 |
Qwen3 4BQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon Vega15.98 GB VRAM | GCN / Vega | 552.59tok/s | 48.8tok/s | ToshLLM community✓Jul 20, 2026 |
Gemma 4 12BQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon RX 6900 XT15.98 GB VRAM | RDNA 2 | 757.14tok/s | 48.49tok/s | Dolphins1972Jul 23, 2026 |
Gemma 4 12BUD-Q4_K_XL · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon GFX10, 16 GB15.98 GB VRAM | RDNA | 825.73tok/s | 48.46tok/s | ToshLLM communityJul 24, 2026 |
Qwen3.5 9BQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon RX 6700 XT11.98 GB VRAM | RDNA 2 | 650.88tok/s | 48.38tok/s | ToshLLM LabJul 27, 2026 |
Gemma 4 26B-A4BUD-Q4_K_M · MoE · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon Pro Vega II31.98 GB VRAM | GCN / Vega | 484.84tok/s | 48.18tok/s | gervaiscoquil✓Jul 18, 2026 |
Gemma 4 26B A4BQ4_K_M · MoE · comparison | Radeon Pro Vega II32 GB VRAM | GCN / Vega | 190.3tok/s | 47.9tok/s | Mac Pro communityJul 16, 2026 |
Qwen3-Coder 30B A3BQ4_K_M · MoE · ncmoe 23 · comparison | RX 6950 XT16 GB VRAM | RDNA 2 | 587.3tok/s | 47.8tok/s | Community testerJul 16, 2026 |
Gemma 4 26B-A4BUD-Q4_K_M · MoE · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon Pro Vega II31.98 GB VRAM | GCN / Vega | 483.53tok/s | 47.63tok/s | ButterChickenJul 20, 2026 |
Gemma 4 12BQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon RX 6900 XT15.98 GB VRAM | RDNA 2 | 800.04tok/s | 47.1tok/s | ToshLLM communityAug 1, 2026 |
Gemma 4 12BQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon RX 6900 XT ×231.97 GB VRAM | RDNA 2 | 585.78tok/s | 46.89tok/s | Dolphins1972Jul 18, 2026 |
Qwen3 14BQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon PRO W6800X Duo31.98 GB VRAM | RDNA 2 | 552.39tok/s | 46.56tok/s | chafeyAug 23, 2026 |
Qwen3.6 35B-A3BUD-Q4_K_M · MoE · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon Pro W5700X ×231.97 GB VRAM | RDNA 1 | 704.73tok/s | 46.53tok/s | HypabolicAug 12, 2026 |
Meta Llama 3.1 8BQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon Pro 5700 XT15.98 GB VRAM | RDNA 1 | 436.77tok/s | 46.46tok/s | Aaron.CAug 11, 2026 |
Qwen3.5 9BQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon RX 6700 XT11.98 GB VRAM | RDNA 2 | 414.37tok/s | 46.46tok/s | ToshLLM LabJul 17, 2026 |
Gemma4 V2 MergedQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon RX 6900 XT15.98 GB VRAM | RDNA 2 | 799.02tok/s | 45.89tok/s | ToshLLM communityAug 1, 2026 |
UncensoredLM DeepSeek R1 Qwen 13.5BQ5_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon GFX10, 16 GB15.98 GB VRAM | RDNA | 720.61tok/s | 45.53tok/s | ToshLLM communityAug 6, 2026 |
Qwen3.5 9BQ4_K_M · Dense · comparison | RX 6700 XT12 GB VRAM | RDNA 2 | 411tok/s | 45tok/s | ToshLLM LabJul 15, 2026 |
GPT OSS 20BF16 · MoE · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon RX 6900 XT + AMD Radeon Vega31.97 GB VRAM | RDNA 2 + GCN / Vega | 802.94tok/s | 43.92tok/s | ToshLLM communityAug 11, 2026 |
Qwen3 4BQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon RX 6900 XT + AMD Radeon Vega31.97 GB VRAM | RDNA 2 + GCN / Vega | 1216.76tok/s | 42.52tok/s | ToshLLM communityAug 10, 2026 |
Qwen3.6 35B-A3BUD-Q4_K_S · MoE · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon Pro Vega II31.98 GB VRAM | GCN / Vega | 280.34tok/s | 42.24tok/s | gervaiscoquil✓Jul 18, 2026 |
Qwen3.6 35B A3BQ4_K_S · MoE · All experts in VRAM · comparison | Radeon Pro Vega II32 GB VRAM | GCN / Vega | 284.7tok/s | 42.1tok/s | Mac Pro communityJul 16, 2026 |
Qwen3 8BQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon RX 6600 XT7.98 GB VRAM | RDNA 2 | 570.26tok/s | 42.02tok/s | ardentwheelAug 1, 2026 |
Qwen3.6 35B-A3BUD-Q4_K_S · MoE · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon Pro Vega II31.98 GB VRAM | GCN / Vega | 432.42tok/s | 41.97tok/s | ToshLLM communityAug 4, 2026 |
Qwen3.6 35B-A3BUD-Q8_K_XL · MoE · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon Pro Vega II Duo63.97 GB VRAM | GCN / Vega | 320.65tok/s | 41.94tok/s | ToshLLM communityAug 5, 2026 |
Qwen3.5 9BQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon RX 5700 XT7.98 GB VRAM | RDNA 1 | 432.01tok/s | 41.46tok/s | blacklizardJul 31, 2026 |
Qwen3 4BQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon Vega ×4 + AMD Radeon PRO W6800X Duo ×2191.88 GB VRAM | GCN / Vega + RDNA 2 | 794.46tok/s | 41.07tok/s | Flint Ironstag✓Jul 20, 2026 |
Hf E4BQ4_0 · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon RX Vega 567.98 GB VRAM | GCN / Vega | 644.1tok/s | 40.54tok/s | めろんAug 25, 2026 |
Gemma 4 12BQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon PRO W6800X Duo ×2127.94 GB VRAM | RDNA 2 | 429.66tok/s | 40.3tok/s | Flint Ironstag✓Jul 18, 2026 |
GLM 4 9BQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon Pro 5700 XT15.98 GB VRAM | RDNA 1 | 384.95tok/s | 38.71tok/s | Aaron.CAug 11, 2026 |
Qwen3 30B-A3BQ4_K_M · MoE · Signed ToshLLM app · ncmoe 16 · amd-gpu · Metal · comparison | AMD Radeon RX 6900 XT15.98 GB VRAM | RDNA 2 | 157.92tok/s | 35.84tok/s | ToshLLM communityAug 21, 2026 |
Gemma 4 E4BUD-Q4_K_XL · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon Pro 5500M7.98 GB VRAM | RDNA 1 | 334.86tok/s | 34.86tok/s | mnerdJul 30, 2026 |
Gemma 4 12BUD-Q4_K_XL · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon RX 6700 XT11.98 GB VRAM | RDNA 2 | 337.18tok/s | 34.66tok/s | ToshLLM LabJul 18, 2026 |
Llama 3.2 3BUD-Q6_K_XL · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon Pro 5500M7.98 GB VRAM | RDNA 1 | 473.51tok/s | 34.65tok/s | mnerdJul 31, 2026 |
Meta Llama 3.1 8BQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon Vega15.98 GB VRAM | GCN / Vega | 277.72tok/s | 34.4tok/s | ToshLLM community✓Jul 20, 2026 |
Gemma 4 12BQ4_K_XL · Dense · comparison | RX 6700 XT12 GB VRAM | RDNA 2 | 342tok/s | 34tok/s | ToshLLM LabJul 15, 2026 |
Qwen3.6 35B-A3BUD-Q4_K_S · MoE · Signed ToshLLM app · ncmoe 10 · amd-gpu · Metal · comparison | AMD Radeon Pro 5700 XT15.98 GB VRAM | RDNA 1 | 194.85tok/s | 33.5tok/s | tmnJul 18, 2026 |
Qwen3 8BQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon Vega15.98 GB VRAM | GCN / Vega | 266.06tok/s | 33.27tok/s | ToshLLM community✓Jul 20, 2026 |
Qwen3 Coder 30B-A3BQ4_K_M · MoE · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon RX 6900 XT + AMD Radeon Vega31.97 GB VRAM | RDNA 2 + GCN / Vega | 807.25tok/s | 33.2tok/s | ToshLLM communityAug 10, 2026 |
GLM 4.7 Flash 23B-A3BQ4_K_M · MoE · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon GFX10, 16 GB + AMD Radeon RX 5600 XT21.97 GB VRAM | RDNA + RDNA 1 | 925.86tok/s | 32.66tok/s | ToshLLM communityAug 7, 2026 |
GLM 4 9BQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon Vega15.98 GB VRAM | GCN / Vega | 252.37tok/s | 31.39tok/s | Flint Ironstag✓Jul 20, 2026 |
Qwen3.6 35B-A3BUD-Q4_K_S · MoE · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon Vega ×4 + AMD Radeon PRO W6800X Duo ×2191.88 GB VRAM | GCN / Vega + RDNA 2 | 426.35tok/s | 31.28tok/s | Flint Ironstag✓Jul 20, 2026 |
Gemma 4 12BQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon RX 6900 XT15.98 GB VRAM | RDNA 2 | 763.1tok/s | 30.98tok/s | ToshLLM communityAug 10, 2026 |
Meta Llama 3.1 8BQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon Vega ×4 + AMD Radeon PRO W6800X Duo ×2191.88 GB VRAM | GCN / Vega + RDNA 2 | 408.46tok/s | 30.83tok/s | Flint Ironstag✓Jul 20, 2026 |
Gemma4 26B-A4BQ4_K_M · MoE · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon RX 6900 XT + AMD Radeon Vega31.97 GB VRAM | RDNA 2 + GCN / Vega | 883.21tok/s | 30.44tok/s | ToshLLM communityAug 21, 2026 |
Qwen3 8BQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon Vega ×4 + AMD Radeon PRO W6800X Duo ×2191.88 GB VRAM | GCN / Vega + RDNA 2 | 396.42tok/s | 29.41tok/s | Flint Ironstag✓Jul 20, 2026 |
Qwen3.6 35B-A3BUD-Q4_K_S · MoE · Signed ToshLLM app · ncmoe 17 · amd-gpu · Metal · comparison | AMD Radeon Pro 5700 XT15.98 GB VRAM | RDNA 1 | 341.07tok/s | 29.09tok/s | tmnJul 18, 2026 |
Qwen3.6 35B-A3BUD-Q4_K_S · MoE · Signed ToshLLM app · ncmoe 16 · amd-gpu · Metal · comparison | AMD Radeon Pro 5700 XT15.98 GB VRAM | RDNA 1 | 348.2tok/s | 29.06tok/s | tmnJul 18, 2026 |
Qwen3.6 35B-A3BUD-Q4_K_S · MoE · Signed ToshLLM app · ncmoe 16 · amd-gpu · Metal · comparison | AMD Radeon Pro 5700 XT15.98 GB VRAM | RDNA 1 | 368.16tok/s | 27.49tok/s | Aaron.CAug 11, 2026 |
Gemma4 V2 MergedQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon RX 6900 XT + AMD Radeon Pro W5700X31.97 GB VRAM | RDNA 2 + RDNA 1 | 466.28tok/s | 27.44tok/s | ToshLLM communityAug 1, 2026 |
Qwen3 4BQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon Vega ×231.97 GB VRAM | GCN / Vega | 793.59tok/s | 27.24tok/s | ToshLLM communityJul 23, 2026 |
GLM 4 9BQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon Vega ×4 + AMD Radeon PRO W6800X Duo ×2191.88 GB VRAM | GCN / Vega + RDNA 2 | 373.62tok/s | 27.19tok/s | Flint Ironstag✓Jul 20, 2026 |
Qwen3.5 122B A10BQ5_K_M · MoE · Four-GPU split · comparison | 4× W6800X128 GB VRAM | RDNA 2 | 226.5tok/s | 26.1tok/s | Basten7Jul 15, 2026 |
Gemma 4 E4BUD-Q4_K_XL · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon RX Ellesmere Prototype8 GB VRAM | Unknown | 216.37tok/s | 25.27tok/s | 1252er✓Aug 2, 2026 |
Gemma 4 E4BUD-Q4_K_XL · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon RX Ellesmere Prototype8 GB VRAM | Unknown | 210.8tok/s | 25.12tok/s | 1252er✓Jul 21, 2026 |
Qwen3.6 35B A3BQ4_K_S · MoE · CPU expert offload · comparison | RX 6700 XT12 GB VRAM | RDNA 2 | 434tok/s | 25tok/s | ToshLLM LabJul 15, 2026 |
Gemma 4 12BUD-Q4_K_XL · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon RX Vega 567.98 GB VRAM | GCN / Vega | 258.72tok/s | 24.24tok/s | めろんAug 25, 2026 |
Qwen3 Coder 30B-A3BQ4_K_M · MoE · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon Vega ×231.97 GB VRAM | GCN / Vega | 427.04tok/s | 23.94tok/s | ToshLLM communityJul 23, 2026 |
Qwen3 4BQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon Vega ×463.94 GB VRAM | GCN / Vega | 532.51tok/s | 23.49tok/s | ToshLLM community✓Jul 20, 2026 |
Qwen3 4BQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon Vega ×463.94 GB VRAM | GCN / Vega | 532.87tok/s | 23.48tok/s | Flint Ironstag✓Jul 20, 2026 |
Qwen3.8 27BQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon PRO W6800X Duo31.98 GB VRAM | RDNA 2 | 280.26tok/s | 23.45tok/s | PixlaAug 29, 2026 |
Qwen3 8BQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon Pro 5500M7.98 GB VRAM | RDNA 1 | 229.68tok/s | 22.98tok/s | ToshLLM communityAug 30, 2026 |
Gemma 4 26B A4BMXFP4 · MoE · CPU expert offload · comparison | RX 6700 XT12 GB VRAM | RDNA 2 | 552tok/s | 22tok/s | ToshLLM LabJul 15, 2026 |
Gemma 4 26B-A4BUD-Q4_K_M · MoE · Signed ToshLLM app · ncmoe 16 · amd-gpu · Metal · comparison | AMD Radeon Pro 5700 XT15.98 GB VRAM | RDNA 1 | 424.08tok/s | 21.9tok/s | Aaron.CAug 11, 2026 |
Gemma 4 12BQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon Vega15.98 GB VRAM | GCN / Vega | 232.37tok/s | 20.94tok/s | ToshLLM community✓Jul 20, 2026 |
Gemma 4 12BQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon Vega15.98 GB VRAM | GCN / Vega | 230.23tok/s | 20.89tok/s | Flint Ironstag✓Jul 20, 2026 |
Qwen3.6 35B-A3BUD-Q4_K_S · MoE · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon Vega ×463.94 GB VRAM | GCN / Vega | 237.43tok/s | 20.22tok/s | Flint Ironstag✓Jul 20, 2026 |
Qwen3.8 9BQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon Pro 5500M7.98 GB VRAM | RDNA 1 | 167.97tok/s | 20.18tok/s | mnerdAug 26, 2026 |
Gemma 4 26B-A4BUD-Q4_K_XL · MoE · Signed ToshLLM app · ncmoe 3 · amd-gpu · Metal · comparison | AMD Radeon RX Vega 56 + AMD Radeon Pro WX 510015.98 GB VRAM | GCN / Vega | 108.98tok/s | 20.1tok/s | めろんAug 25, 2026 |
Hf 26BQ4_0 · MoE · Signed ToshLLM app · ncmoe 2 · amd-gpu · Metal · comparison | AMD Radeon RX Vega 56 + AMD Radeon Pro WX 510015.98 GB VRAM | GCN / Vega | 111.45tok/s | 20.09tok/s | めろんAug 25, 2026 |
Qwen3.6 35B-A3BUD-Q4_K_S · MoE · Signed ToshLLM app · ncmoe 32 · amd-gpu · Metal · comparison | AMD Radeon RX 6600 XT7.98 GB VRAM | RDNA 2 | 167.83tok/s | 20.06tok/s | test1-Henbury-DIsableJul 20, 2026 |
Hf 26BQ4_0 · MoE · Signed ToshLLM app · ncmoe 2 · amd-gpu · Metal · comparison | AMD Radeon RX Vega 56 + AMD Radeon Pro WX 510015.98 GB VRAM | GCN / Vega | 111.01tok/s | 19.99tok/s | めろんAug 25, 2026 |
Qwen3Vl 4BQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon Pro 5808 GB VRAM | GCN / Vega | 239.43tok/s | 19.86tok/s | ToshLLM communityAug 3, 2026 |
Qwen3.6 35B-A3BUD-Q4_K_S · MoE · Signed ToshLLM app · ncmoe 32 · amd-gpu · Metal · comparison | AMD Radeon RX 6600 XT7.98 GB VRAM | RDNA 2 | 164.3tok/s | 19.86tok/s | ardentwheelJul 19, 2026 |
Qwen3.6 35B-A3BUD-Q4_K_S · MoE · Signed ToshLLM app · ncmoe 32 · amd-gpu · Metal · comparison | AMD Radeon RX 6600 XT7.98 GB VRAM | RDNA 2 | 166.97tok/s | 19.51tok/s | test0-Henbury-DIsableJul 20, 2026 |
Qwen3.6 35B-A3BUD-Q4_K_S · MoE · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon PRO W6800X Duo ×2127.94 GB VRAM | RDNA 2 | 1438.6tok/s | 19.48tok/s | PixlaAug 29, 2026 |
Gemma 4 12BQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon Vega ×4 + AMD Radeon PRO W6800X Duo ×2191.88 GB VRAM | GCN / Vega + RDNA 2 | 328.49tok/s | 19.1tok/s | Flint Ironstag✓Jul 20, 2026 |
Hf 26BQ4_0 · MoE · Signed ToshLLM app · ncmoe 3 · amd-gpu · Metal · comparison | AMD Radeon RX Vega 56 + AMD Radeon Pro WX 510015.98 GB VRAM | GCN / Vega | 126.13tok/s | 18.23tok/s | めろんAug 12, 2026 |
Meta Llama 3.1 8BQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon Vega ×463.94 GB VRAM | GCN / Vega | 271.81tok/s | 17.97tok/s | Flint Ironstag✓Jul 20, 2026 |
Qwen3 8BQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon Vega ×463.94 GB VRAM | GCN / Vega | 262.11tok/s | 17.59tok/s | Flint Ironstag✓Jul 20, 2026 |
Gemma 4 26B-A4BUD-Q4_K_M · MoE · Signed ToshLLM app · ncmoe 22 · amd-gpu · Metal · comparison | AMD Radeon RX 6600 XT7.98 GB VRAM | RDNA 2 | 231.85tok/s | 17.29tok/s | ArdentwheelJul 20, 2026 |
GLM 4 9BQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon Vega ×463.94 GB VRAM | GCN / Vega | 247.23tok/s | 17.15tok/s | Flint Ironstag✓Jul 20, 2026 |
Qwen3.8 27BUD-Q4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon Pro Vega II31.98 GB VRAM | GCN / Vega | 143.86tok/s | 17.11tok/s | simmc303Aug 25, 2026 |
Gemma 4 12BQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon Vega ×231.97 GB VRAM | GCN / Vega | 319.02tok/s | 14.86tok/s | ToshLLM communityJul 23, 2026 |
Qwen2.5 Coder 7BQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon Pro 5808 GB VRAM | GCN / Vega | 144.55tok/s | 14.75tok/s | ToshLLM communityAug 3, 2026 |
Carnice Qwen3.6 MoE 35BQ3_K_M · MoE · Signed ToshLLM app · ncmoe 30 · amd-gpu · Metal · comparison | AMD Radeon RX Ellesmere Prototype8 GB VRAM | Unknown | 99.63tok/s | 14.52tok/s | 1252er✓Aug 2, 2026 |
Qwen3.6 27BIQ4 · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon Pro W5700X ×231.97 GB VRAM | RDNA 1 | 127.25tok/s | 14.25tok/s | malzzzJul 23, 2026 |
GPT OSS 20BMXFP4 · MoE · Signed ToshLLM app · ncmoe 15 · amd-gpu · Metal · comparison | AMD Radeon Pro 5500M7.98 GB VRAM | RDNA 1 | 188.97tok/s | 14.22tok/s | mnerdJul 31, 2026 |
Qwen3.8 27BQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon Pro Vega II Duo ×2127.94 GB VRAM | GCN / Vega | 142.67tok/s | 14.11tok/s | ToshLLM communityAug 24, 2026 |
Qwen3.6 35B-A3BUD-Q4_K_S · MoE · Signed ToshLLM app · ncmoe 32 · amd-gpu · Metal · comparison | AMD Radeon RX 6600 XT7.98 GB VRAM | RDNA 2 | 164.7tok/s | 14.07tok/s | ardentwheelJul 18, 2026 |
Qwen3.6 35B-A3BUD-Q4_K_S · MoE · Signed ToshLLM app · ncmoe 32 · amd-gpu · Metal · comparison | AMD Radeon RX 6600 XT7.98 GB VRAM | RDNA 2 | 164.44tok/s | 14.03tok/s | test1-Henbury-EnableJul 20, 2026 |
Qwen3.6 35B-A3BUD-Q4_K_S · MoE · Signed ToshLLM app · ncmoe 32 · amd-gpu · Metal · comparison | AMD Radeon RX 6600 XT7.98 GB VRAM | RDNA 2 | 164.13tok/s | 13.97tok/s | test0-Henbury-EnableJul 20, 2026 |
Gemma 4 12BUD-Q4_K_XL · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon RX Vega 56 + AMD Radeon Pro WX 510015.98 GB VRAM | GCN / Vega | 58.75tok/s | 13.41tok/s | めろんAug 25, 2026 |
Gemma 4 12BQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon Vega ×463.94 GB VRAM | GCN / Vega | 228.36tok/s | 13.3tok/s | Flint Ironstag✓Jul 20, 2026 |
GLM 4 9BQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon RX Ellesmere Prototype8 GB VRAM | Unknown | 106.9tok/s | 13.2tok/s | 1252er✓Aug 2, 2026 |
LLaMA V2 7BQ4_0 · Dense · Signed ToshLLM app · standard-auto · Metal · comparison | Apple M111.84 GB VRAM | Apple Silicon | 128.09tok/s | 12.75tok/s | bastenJul 18, 2026 |
Qwen3.8 27BQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon PRO W6800X Duo ×2127.94 GB VRAM | RDNA 2 | 620.65tok/s | 12.12tok/s | PixlaAug 29, 2026 |
Qwen3.6 35B-A3BUD-Q4_K_S · MoE · Signed ToshLLM app · ncmoe 16 · amd-gpu · Metal · comparison | AMD Radeon PRO W6800X Duo ×2127.94 GB VRAM | RDNA 2 | 471.86tok/s | 11.84tok/s | ToshLLM communityAug 22, 2026 |
Gemma 4 26B-A4BUD-Q4_K_M · MoE · Signed ToshLLM app · ncmoe 38 · amd-gpu · Metal · comparison | AMD Radeon Pro 5600M7.98 GB VRAM | RDNA 1 | 167.09tok/s | 11.78tok/s | ToshLLM communityJul 24, 2026 |
Qwen3.6 35B-A3BUD-Q4_K_S · MoE · Signed ToshLLM app · ncmoe 32 · amd-gpu · Metal · comparison | AMD Radeon Pro 5500M7.98 GB VRAM | RDNA 1 | 140.53tok/s | 11.7tok/s | mnerdAug 26, 2026 |
Qwen3 30B-A3BQ4_K_M · MoE · Signed ToshLLM app · ncmoe 35 · amd-gpu · Metal · comparison | AMD Radeon Pro 5500M7.98 GB VRAM | RDNA 1 | 154.45tok/s | 11.55tok/s | mnerdJul 31, 2026 |
Gemma 4 26B-A4BUD-Q4_K_XL · MoE · Signed ToshLLM app · ncmoe 22 · amd-gpu · Metal · comparison | AMD Radeon Pro 5500M7.98 GB VRAM | RDNA 1 | 207.43tok/s | 11.19tok/s | mnerdJul 30, 2026 |
Hy MT2 30BQ6_K · MoE · Signed ToshLLM app · ncmoe 43 · amd-gpu · Metal · comparison | AMD Radeon Pro 5600M7.98 GB VRAM | RDNA 1 | 103.56tok/s | 10.88tok/s | ToshLLM communityAug 31, 2026 |
Qwen3.6 35B-A3BUD-IQ4_XS · MoE · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon VII15.98 GB VRAM | GCN / Vega | 26.84tok/s | 10.63tok/s | 1252er✓Jul 21, 2026 |
Qwen3.8 27BUD-Q8_K_XL · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon Pro Vega II Duo31.98 GB VRAM | GCN / Vega | 126.88tok/s | 10.48tok/s | sedtamensum redditAug 25, 2026 |
Qwen3.6 35B-A3BUD-IQ4_XS · MoE · Signed ToshLLM app · ncmoe 10 · amd-gpu · Metal · comparison | AMD Radeon RX Ellesmere Prototype8 GB VRAM | Unknown | 25.65tok/s | 10.31tok/s | 1252er✓Jul 21, 2026 |
Qwen3.6 35B-A3BUD-IQ4_XS · MoE · Signed ToshLLM app · ncmoe 6 · amd-gpu · Metal · comparison | AMD Radeon RX Ellesmere Prototype8 GB VRAM | Unknown | 24.35tok/s | 10.23tok/s | 1252er✓Aug 2, 2026 |
Qwen3.6 35B-A3BUD-Q4_K_S · MoE · Signed ToshLLM app · ncmoe 33 · amd-gpu · Metal · comparison | AMD Radeon Pro 5500M7.98 GB VRAM | RDNA 1 | 132.78tok/s | 10.14tok/s | mnerdJul 30, 2026 |
Qwen3 Coder 30B-A3BQ4_K_M · MoE · Signed ToshLLM app · ncmoe 35 · amd-gpu · Metal · comparison | AMD Radeon Pro 5808 GB VRAM | GCN / Vega | 71.18tok/s | 9.83tok/s | ToshLLM communityAug 10, 2026 |
Gemma 4 26B-A4BUD-Q4_K_XL · MoE · Signed ToshLLM app · ncmoe 35 · amd-gpu · Metal · comparison | AMD Radeon Pro 5500M7.98 GB VRAM | RDNA 1 | 150.24tok/s | 9.71tok/s | mnerdJul 30, 2026 |
Hy MT2 30BQ6_K · MoE · Signed ToshLLM app · ncmoe 43 · amd-gpu · Metal · comparison | AMD Radeon Pro 5600M7.98 GB VRAM | RDNA 1 | 99.37tok/s | 8.93tok/s | ToshLLM communityAug 31, 2026 |
Llama 3.3 70BUD-IQ1_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon PRO W6800X Duo ×2127.94 GB VRAM | RDNA 2 | 291.49tok/s | 8.6tok/s | walrunsAug 22, 2026 |
Qwen3.6 35B-A3BUD-IQ4_XS · MoE · Signed ToshLLM app · ncmoe 25 · amd-gpu · Metal · comparison | AMD Radeon RX Ellesmere Prototype8 GB VRAM | Unknown | 74.01tok/s | 7.85tok/s | 1252er✓Aug 2, 2026 |
Gemma 4 12BUD-Q4_K_XL · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon Pro WX 51008 GB VRAM | Unknown | 32.05tok/s | 7.68tok/s | めろんAug 25, 2026 |
Qwen3.8 27BUD-IQ1_S · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon Pro 5500M7.98 GB VRAM | RDNA 1 | 36.3tok/s | 7.48tok/s | mnerdAug 25, 2026 |
Gemma 4 26B-A4BUD-IQ3_S · MoE · Signed ToshLLM app · ncmoe 3 · amd-gpu · Metal · comparison | AMD Radeon RX Ellesmere Prototype8 GB VRAM | Unknown | 116.33tok/s | 7.48tok/s | 1252er✓Aug 2, 2026 |
Carnice Qwen3.6 MoE 35BQ3_K_M · MoE · Signed ToshLLM app · ncmoe 3 · amd-gpu · Metal · comparison | AMD Radeon RX Ellesmere Prototype8 GB VRAM | Unknown | 72.63tok/s | 5.05tok/s | 1252er✓Aug 2, 2026 |
Qwen3 8BQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon Pro Vega 203.98 GB VRAM | GCN / Vega | 115.63tok/s | 3.27tok/s | ToshLLM communityAug 30, 2026 |
Qwen3 8BQ4_K_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison | AMD Radeon Pro 5300M3.98 GB VRAM | RDNA 1 | 153.52tok/s | 3.15tok/s | SpidlaDevJul 21, 2026 |
Qwen3.8 27BQ4_K_M · Dense · Signed ToshLLM app · off · Metal · comparison | AMD Radeon Pro W5500X7.98 GB VRAM | RDNA 1 | 17.54tok/s | 1.07tok/s | ToshLLM communityAug 23, 2026 |
∅
No matching runs
Try another model, GPU, or filter.
Performance comparisons
Compare real-world
performance.
Explore results by GPU and model, with medians, performance ranges and every signed run available for inspection.
By GPU
AMD Radeon RX 6700 XT19 runs250 tok/s →AMD Radeon PRO W6800X Duo ×217 runs110.75 tok/s →AMD Radeon Pro 5500M17 runs105.13 tok/s →AMD Radeon RX 6900 XT12 runs297.01 tok/s →AMD Radeon Pro Vega II11 runs96.88 tok/s →AMD Radeon RX 6600 XT10 runs89.79 tok/s →AMD Radeon GFX10, 16 GB9 runs105.77 tok/s →AMD Radeon RX Ellesmere Prototype9 runs25.27 tok/s →Reproduction protocol
Same test.
Useful comparison.
01
Control the context
Prompt processing uses 512 tokens; generation uses 128. Run three repetitions after a warm-up.
02
Record the machine
GPU, VRAM, quantization, model hash, ToshLLM version and offload settings travel with every result.
03
Preserve provenance
App-signed runs remain labeled as community data. Internally inconsistent or extreme results wait for manual review.
Standard llama-bench command
TOSH_FA_AMD=1 GGML_METAL_CONCURRENCY_DISABLE=1 GGML_SCHED_PREFETCH_EXPERTS=1 GGML_CPU_NO_REPACK=1 ./llama-bench -m MODEL.gguf -ngl 99 --mmap 0 -fa auto -p 512 -n 128 -r 3 --progressMeasurement note: the environment flags match ToshLLM's AMD and MoE runtime. MTP speculative decoding is not supported by llama-bench; measure it with real generation through llama-server. Read the benchmark guide.