Feature/support dflash2 - #175

Merged

zhongkaifu merged 20 commits into

mainfrom

feature/support_dflash2

Aug 28, 2026

Commits on Aug 26, 2026

support DFlash2 speculative decoding

zhongkaifu
and
claude
committed
c005e34
Keep the Qwen 3.x recurrent state on the device for one-row steps too

zhongkaifu
and
claude
committed
94234f4
Fold the MTP catch-up into the first draft step

zhongkaifu
and
claude
committed
6ac9e7e
Add a governor kill switch and record the like-for-like llama.cpp numbers

zhongkaifu
and
claude
committed
a637d26
Make the server's --draft-model reach the DFlash drafters

zhongkaifu
and
claude
committed
a60a5f7
Add Qwen3.8-Flash-Next (qwen4exp) and optimize its prefill and decode

zhongkaifu
and
claude
committed
de2a7b5

Commits on Aug 27, 2026

qwen4exp: fuse each layer's two halves into single GGML graphs

zhongkaifu
and
claude
committed
945aec8
qwen4exp: fuse the attention half too

zhongkaifu
and
claude
committed
43a31db
qwen4exp: cheaper graph replays (decode 57.1 -> 59.0)

zhongkaifu
and
claude
committed
8de2c6d
qwen4exp: fix the attention mask pin, and what a padded KV window costs

zhongkaifu
and
claude
committed
69a30f3
qwen4exp: flash attention in the fused attention half

zhongkaifu
and
claude
committed
dde2598
qwen4exp: bisect the device-resident residual, and a uid kill switch

zhongkaifu
and
claude
committed
11c787f
qwen4exp: one-graph token spans (opt-in), shared node builders, four real fixes

zhongkaifu
and
claude
committed
5579c41
qwen4exp: the token graph ships - decode 98 t/s vs llama.cpp 92

zhongkaifu
and
claude
committed
f30d4aa
qwen4exp: PLE rides the graph - prefill 3376 vs llama.cpp 2903, decode 103.6

zhongkaifu
and
claude
committed
3b34c6e
qwen4exp: vision - the Qwen3.5 tower, IMRoPE in the span, PLE untouched

zhongkaifu
and
claude
committed
a55bd23
qwen4exp: multi-image prompts and multi-turn image sessions

zhongkaifu
and
claude
committed
7304268
support GLM 5.3 flash model
zhongkaifu
committed
f1d7f39

Commits on Aug 28, 2026

bug fix
zhongkaifu
committed
ee16c08
update documents
zhongkaifu
committed
d236459