Community performance summary

Mistral 7B × AMD Radeon VII

1 signed observations in one performance comparison. Open any run below to inspect its exact configuration and provenance.

1 signed run · 0 verified · 1 tester
Median prompt555.59tok/s · 555.59 to 555.59
Median generation46.66tok/s · 46.66 to 46.66
Configurations1IQ3_M
Last observedOct 19GCN / Vega

What the results show

One clear view.
Every recorded run.

Measurements from comparable hardware and models are presented together. Medians show typical performance, while every signed run remains available below for inspection and sharing.

Quantizations observed1 groups
IQ3_M1 runs
macOS

macOS 15.8.1 Sequoia

Recorded evidence

Inspect every run.

Open any result to review its exact hardware, model configuration, measurements and submission details.

1 to 8 of 1 configurations

Verified benchmark Community submission
Model / quantHardwareArchitecturePromptGenerationSource
Mistral 7BIQ3_M · Dense · Signed ToshLLM app · amd-gpu · Metal · comparison
AMD Radeon VII15.98 GB VRAM
GCN / Vega
555.59tok/s
46.66tok/s
ToshLLM communityOct 19, 2026