millaguie/llama.cpp
1
0
Fork 0
Code Issues Pull Requests Actions 26 Packages Projects Releases Wiki Activity
10,330 Commits 2 Branches 0 Tags
687e7789271ec1276e3470f158428e11a4f80b6f
Commit Graph
2 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Rafail Giavrimis 687e778927 CUDA: fuse rms_norm + mul + rope (+ view + set_rows) (#26767) 
* CUDA: fuse rms_norm + mul + rope (+ view + set_rows)

* tests: add broadcast weight case to rms_norm_mul_rope

* CUDA: check memory ranges before rms_norm rope fusion

* CUDA: check memory ranges in rope set_rows fusion
 2026-08-09 00:32:37 +08:00
Rafail Giavrimis 69bf643791 CUDA: fix thread/block count in quantized cpy kernel launches (#26731) 
* CUDA: fix thread/block count in quantized cpy kernel launches

* tests: add uneven block count cpy case
 2026-08-08 07:40:04 +03:00