Nomic Embed Text V2 MoE

Q8_0 running on AMD Radeon Pro 560X with macOS 15.7.9 Sequoia

PERFORMANCE / TOKENS PER SECONDGCN / Vega

Prompt processing1378.77tok/s

#34 in index

Token generation167.97tok/s

#10 in index

Run fingerprint

Enough context to make the number useful.

ModelNomic Embed Text V2 MoEMoE architecture

QuantizationQ8_0Exact submitted variant

GPUAMD Radeon Pro 560X4 GB VRAM

GPU architectureGCN / VegaMetal backend

Test context512prompt tokens

Model familyMoESigned ToshLLM app · amd-gpu · Metal

ToshLLM versionv0.87.1App version used to capture and sign this run

Prompt processing and generation are reported separately so memory bandwidth and decode behavior stay visible.

Quantization, GPU family, VRAM and context travel with the result instead of being hidden behind one score.

This result remains explicitly labeled as a community submission.