 Ruixiang WangandGeorgi Gerganov
|
571d0d540d
|
model: rotate injected K/V cache for DFlash (#25823)
* dflash: rotate injected K/V cache when using K/V quantization
* Update src/models/dflash.cpp
Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
* clearer format
* remove trailing whitespace
---------
Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
|
2026-07-18 15:02:18 +02:00 |
|