Hf 27B

PQ2_0 running on AMD Radeon RX 6700 XT with macOS 26.7 Tahoe

PERFORMANCE / TOKENS PER SECONDRDNA 2

Prompt processing255.55tok/s

#219 in index

Token generation33.5tok/s

#182 in index

Run fingerprint

Enough context to make the number useful.

ModelHf 27BDense architecture

QuantizationPQ2_0Exact submitted variant

GPUAMD Radeon RX 6700 XT11.98 GB VRAM

GPU architectureRDNA 2Metal backend

Test context512prompt tokens

Model familyDenseSigned ToshLLM app · amd-gpu · Metal

ToshLLM versionv0.87.8App version used to capture and sign this run

Prompt processing and generation are reported separately so memory bandwidth and decode behavior stay visible.

Quantization, GPU family, VRAM and context travel with the result instead of being hidden behind one score.

This run was reproduced by ToshLLM Lab.