baseline_tq
n_max0
decode9.347 tok/s
wall9.109 tok/s
accepted/generated—
acceptance—
Qwen/Qwopus3.6 27B Q6_K with Qwen3.6-27B-DFlash Q8_0 produced 0% draft-token acceptance across n_max=2/4/8/12. Every DFlash case was slower than TurboQuant baseline using turbo4/turbo3 KV cache.
Hardware: Corsair AI Workstation 300 / MiniV, AMD Ryzen AI MAX 385, Radeon 8050S RADV Vulkan, 64GB UMA.
Build: llama.cpp TurboQuant fork + experimental DFlash backport, version 9681 (8c2b1b3f8).
Context: 8,192 tokens · completion cap: 256 tokens.
| Case | n_max | Status | Load sec | Prefill tok/s | Decode tok/s | Wall tok/s | Acceptance |
|---|---|---|---|---|---|---|---|
| baseline_tq | 0 | OK | 74.4 | 93.7 | 9.347 | 9.109 | — |
| dflash_tq_n2 | 2 | OK | 80.1 | 82.5 | 7.004 | 6.849 | 0.0% |
| dflash_tq_n4 | 4 | OK | 80.2 | 82.8 | 5.395 | 5.304 | 0.0% |
| dflash_tq_n8 | 8 | OK | 78.1 | 77.3 | 2.421 | 2.402 | 0.0% |
| dflash_tq_n12 | 12 | OK | 72.1 | 77.3 | 2.337 | 2.319 | 0.0% |
Do not promote this path to the MiniV production router. Larger draft windows only increased rejected-draft overhead. Baseline TurboQuant remains the correct production lane for this target.