Qwen2.5 Coder 7B

Q2_K running on AMD Radeon VII with macOS 15.8.1 Sequoia

PERFORMANCE / TOKENS PER SECONDGCN / Vega

Prompt processing695.08tok/s

#122 in index

Token generation56.33tok/s

#104 in index

Run fingerprint

Enough context to make the number useful.

ModelQwen2.5 Coder 7BDense architecture

QuantizationQ2_KExact submitted variant

GPUAMD Radeon VII15.98 GB VRAM

GPU architectureGCN / VegaMetal backend

Test context512prompt tokens

Model familyDenseSigned ToshLLM app · amd-gpu · Metal

ToshLLM versionv0.87.26App version used to capture and sign this run

Prompt processing and generation are reported separately so memory bandwidth and decode behavior stay visible.

Quantization, GPU family, VRAM and context travel with the result instead of being hidden behind one score.

This result remains explicitly labeled as a community submission.