speed-bench: add M5 Max (Q2+Q4) results#587
Conversation
Apple M5 Max, 128 GB unified memory, macOS (Metal backend), mixed Q2+Q4 DeepSeek V4 Flash GGUF. Canonical sweep from the README: ctx 2048..65536 step 2048, 128 greedy decode tokens per frontier.
…nt vs antirez#584 Renames the M5 Max CSV/SVG to encode the Q2+Q4 quant mix so this run can coexist with the pure-IQ2XXS M5 Max results in antirez#584 rather than colliding on the shared m5_max.* filename. Content unchanged; SVG name follows the plot_speed.py _ts.svg convention derived from the CSV basename.
|
Heads-up that this overlaps with #584, which also adds M5 Max results at the same two paths ( They're not redundant, though: #584 is pure IQ2XXS full-residency, this PR is a mixed Q2+Q4 GGUF. The I've renamed mine to Methodology note for comparability: these are steady-state numbers (the |
Benchmark results for Apple M5 Max (128 GB unified memory), Metal backend, mixed Q2+Q4 DeepSeek V4 Flash GGUF, at commit efdadd4.
Canonical sweep from the speed-bench README: ctx 2048..65536, step 2048, 128 greedy decode tokens per frontier. Headlines: 485 t/s prefill / 39 t/s gen @2k, 238 t/s prefill / 21.5 t/s gen @65k.
CSV is in the current ds4-bench output format (includes the gen_first_ms / steady-state columns); plot_speed.py renders it as-is.