Meta Llama 3.1 8B

Q4_K_M running on AMD Radeon Pro 5700 XT with macOS 15.6.1 Sequoia

PERFORMANCE / TOKENS PER SECONDRDNA 1

Prompt processing436.77tok/s

#106 in index

Token generation46.46tok/s

#91 in index

Run fingerprint

Enough context to make the number useful.

ModelMeta Llama 3.1 8BDense architecture

QuantizationQ4_K_MExact submitted variant

GPUAMD Radeon Pro 5700 XT15.98 GB VRAM

GPU architectureRDNA 1Metal backend

Test context512prompt tokens

Model familyDenseSigned ToshLLM app · amd-gpu · Metal

ToshLLM versionv0.83.17App version used to capture and sign this run

Prompt processing and generation are reported separately so memory bandwidth and decode behavior stay visible.

Quantization, GPU family, VRAM and context travel with the result instead of being hidden behind one score.

This result remains explicitly labeled as a community submission.