Community performance summary

Nomic Embed Text V2 MoE × AMD Radeon Pro 560X

3 signed observations in one performance comparison. Open any run below to inspect its exact configuration and provenance.

3 signed runs · 0 verified · 1 tester
Median prompt2188.48tok/s · 1378.77 to 2195.09
Median generation167.97tok/s · 165.08 to 179.48
Configurations1Q8_0
Last observedSep 29GCN / Vega

What the results show

One clear view.
Every recorded run.

Measurements from comparable hardware and models are presented together. Medians show typical performance, while every signed run remains available below for inspection and sharing.

Quantizations observed1 groups
Q8_03 runs
macOS

macOS 15.7.9 Sequoia · macOS 15.8 Sequoia · macOS 15.8.1 Sequoia

Recorded evidence

Inspect every run.

Open any result to review its exact hardware, model configuration, measurements and submission details.

1 to 8 of 3 configurations

Verified benchmark Community submission
Model / quantHardwareArchitecturePromptGenerationSource
Nomic Embed Text V2 MoEQ8_0 · MoE · Signed ToshLLM app · amd-gpu · Metal · comparison
GCN / Vega
2195.09tok/s
179.48tok/s
mitchdeSep 29, 2026
Nomic Embed Text V2 MoEQ8_0 · MoE · Signed ToshLLM app · amd-gpu · Metal · comparison
GCN / Vega
1378.77tok/s
167.97tok/s
mitchdeSep 11, 2026
Nomic Embed Text V2 MoEQ8_0 · MoE · Signed ToshLLM app · ncmoe 1 · amd-gpu · Metal · comparison
GCN / Vega
2188.48tok/s
165.08tok/s
mitchdeSep 25, 2026