V2.1 27B-A18B 27B-A18B

Q4_K_S running on AMD Radeon Pro Vega II with macOS 15.7.7 Sequoia

PERFORMANCE / TOKENS PER SECONDGCN / Vega

Prompt processing224.55tok/s

#237 in index

Token generation22.23tok/s

#240 in index

Run fingerprint

Enough context to make the number useful.

ModelV2.1 27B-A18B 27B-A18BMoE architecture

QuantizationQ4_K_SExact submitted variant

GPUAMD Radeon Pro Vega II31.98 GB VRAM

GPU architectureGCN / VegaMetal backend

Test context512prompt tokens

Model familyMoESigned ToshLLM app · amd-gpu · Metal

ToshLLM versionv0.87.7App version used to capture and sign this run

Prompt processing and generation are reported separately so memory bandwidth and decode behavior stay visible.

Quantization, GPU family, VRAM and context travel with the result instead of being hidden behind one score.

This result remains explicitly labeled as a community submission.