Community submission

Performance record · Dense

Meta Llama 3.1 8B

Q4_K_M running on AMD Radeon Vega + AMD Radeon Vega + AMD Radeon Vega + AMD Radeon Vega + AMD Radeon PRO W6800X Duo + AMD Radeon PRO W6800X Duo + AMD Radeon PRO W6800X Duo + AMD

PERFORMANCE / TOKENS PER SECONDGCN / Vega + RDNA 2
Prompt processing408.46tok/s
#38 in index
Token generation30.83tok/s
#47 in index

Run fingerprint

Enough context to make the number useful.

ModelMeta Llama 3.1 8BDense architecture
QuantizationQ4_K_MExact submitted variant
GPUAMD Radeon Vega + AMD Radeon Vega + AMD Radeon Vega + AMD Radeon Vega + AMD Radeon PRO W6800X Duo + AMD Radeon PRO W6800X Duo + AMD Radeon PRO W6800X Duo + AMD 191.88 GB VRAM
GPU architectureGCN / Vega + RDNA 2Metal backend
Test context512prompt tokens
Model familyDenseSigned ToshLLM app · amd-gpu · Metal
01

Standard workload

Prompt processing and generation are reported separately so memory bandwidth and decode behavior stay visible.

02

Configuration attached

Quantization, GPU family, VRAM and context travel with the result instead of being hidden behind one score.

03

Provenance preserved

This result remains explicitly labeled as a community submission.