Qwen3 VL 2B

Q8_0 running on AMD Radeon Pro 5500 XT with macOS 14.8.7 Sonoma

PERFORMANCE / TOKENS PER SECONDRDNA 1

Prompt processing1300.69tok/s

#45 in index

Token generation76.92tok/s

#53 in index

Run fingerprint

Enough context to make the number useful.

ModelQwen3 VL 2BDense architecture

QuantizationQ8_0Exact submitted variant

GPUAMD Radeon Pro 5500 XT7.98 GB VRAM

GPU architectureRDNA 1Metal backend

Test context512prompt tokens

Model familyDenseSigned ToshLLM app · amd-gpu · Metal

ToshLLM versionv0.87.19App version used to capture and sign this run

Prompt processing and generation are reported separately so memory bandwidth and decode behavior stay visible.

Quantization, GPU family, VRAM and context travel with the result instead of being hidden behind one score.

This result remains explicitly labeled as a community submission.