millaguie/llama.cpp
1
0
Fork 0
Code Issues Pull Requests Actions 28 Packages Projects Releases Wiki Activity
Files
d3dc9dd898be805c23a408cc36daed5b3bf29221
llama.cpp/ggml/src
T
History
Oliver SimonsandJohannes Gäßler d3dc9dd898 CUDA: Remove unneded bias/gate dims in fused mmvq (#16858) 
* CUDA: Remove unneded bias/gate dims in fused mmvq

Pointed out
[here](https://github.com/ggml-org/llama.cpp/pull/16847#discussion_r2476798989)
that only a single value is needed per target col per thread

* Apply suggestions from code review

Co-authored-by: Johannes Gäßler <johannesg@5d6.de>

* Fix "Error 991-D: extra braces are nonstandard" during compilation

---------

Co-authored-by: Johannes Gäßler <johannesg@5d6.de>
2025-11-01 13:13:26 +08:00
..
ggml-blas
sync : whisper.cpp (ggml/1359)
2025-09-29 17:43:58 +03:00
ggml-cann
CANN: Improve device ID handling and aclnnArange checks (#16752)
2025-10-28 10:54:53 +08:00
ggml-cpu
cpu: introduce chunking for repack matmuls and enable matmul-id chunking on ARM64 (#16833)
2025-10-30 09:06:13 -07:00
ggml-cuda
CUDA: Remove unneded bias/gate dims in fused mmvq (#16858)
2025-11-01 13:13:26 +08:00
ggml-hexagon
ggml-hexagon: respect input size when getting/setting tensor data (#16836)
2025-10-30 21:46:31 -07:00
ggml-hip
HIP: fix AMDGPU_TARGETS, update documentation (#16803)
2025-10-27 21:39:49 +01:00
ggml-metal
vulkan: fix shmem overrun in mmq id shader (#16873)
2025-10-31 08:14:49 +01:00
ggml-musa
CUDA: faster tile FA, add oob checks, more HSs (#16492)
2025-10-11 20:54:32 +02:00
ggml-opencl
opencl: fix boundary handling for mul_mm (#16875)
2025-10-30 16:00:20 -07:00
ggml-rpc
rpc : report actual free memory (#16616)
2025-10-17 18:02:52 +03:00
ggml-sycl
model: add support for qwen3vl series (#16780)
2025-10-30 16:19:14 +01:00
ggml-vulkan
vulkan: disable spirv-opt for rope shaders (#16872)
2025-10-31 08:34:47 +01:00
ggml-webgpu
model: add support for qwen3vl series (#16780)
2025-10-30 16:19:14 +01:00
ggml-zdnn
zdnn: refactor codebase + add docs (#16178)
2025-09-23 14:53:05 +08:00
CMakeLists.txt
Add experimental ggml-hexagon backend for the Hexagon NPU (#16547)
2025-10-22 13:47:09 -07:00
ggml-alloc.c
ggml-alloc : make gallocr prefer chunks that allow memory reuse (#16788)
2025-10-26 23:19:03 +01:00
ggml-backend-impl.h
rpc : add support for multiple devices (#16276)
2025-10-04 12:49:16 +03:00
ggml-backend-reg.cpp
Add experimental ggml-hexagon backend for the Hexagon NPU (#16547)
2025-10-22 13:47:09 -07:00
ggml-backend.cpp
llama: print memory breakdown on exit (#15860)
2025-09-24 16:53:48 +02:00
ggml-common.h
llama : add gpt-oss (#15091)
2025-08-05 22:10:36 +03:00
ggml-impl.h
vulkan: Update topk_moe fusion to handle gpt's late softmax (#16656)
2025-10-29 14:44:29 +01:00
ggml-opt.cpp
finetune: SGD optimizer, more CLI args (#13873)
2025-08-14 12:03:57 +02:00
ggml-quants.c
ggml : fix uninitialized is_on_grid in quantize_row_iq3_xxs_impl (#15928)
2025-09-23 10:25:20 +02:00
ggml-quants.h
llama : add gpt-oss (#15091)
2025-08-05 22:10:36 +03:00
ggml-threading.cpp
ggml : build backends as libraries (#10256)
2024-11-14 18:04:35 +01:00
ggml-threading.h
remove CMAKE_WINDOWS_EXPORT_ALL_SYMBOLS (#10797)
2024-12-12 19:02:49 +01:00
ggml.c
ggml: add ggml_can_fuse_subgraph (#16662)
2025-10-21 16:43:14 +08:00
ggml.cpp
ggml : Print backtrace on uncaught C++ exceptions (ggml/1232)
2025-06-01 13:43:57 +03:00
gguf.cpp
gguf: gguf_writer refactor (#15691)
2025-09-05 11:34:28 +02:00