llama.cpp

millaguie/llama.cpp

Fork 0

3018a11e79 fix: increase greeting spacing on md screens (#26287) Aleksander Grygier 2026-07-29 19:25:13 +02:00
afeebe103b llama: move suppress_tokens handling to common/sampling (#26276) Xuan-Son Nguyen 2026-07-29 18:02:30 +02:00
caa596ab3f ggml-cuda : disable MMQ on devices with less than 48 KiB shared memory (#26141) KakaruandKakaruHayate 2026-07-29 20:27:35 +08:00
11b068d066 sycl: contiguous fast path + 32-bit index math for unary elementwise ops (#25946) Titaniumtown 2026-07-29 05:16:57 -07:00
e2f59ed71d vendor: update BoringSSL to 0.20260728.0 (#26241) Alessandro de Oliveira Faria (A.K.A.CABELO) 2026-07-29 09:16:02 -03:00
992c325323 server : add trace logging for slot similarity checking (#26271) Georgi Gerganov 2026-07-29 14:59:44 +03:00
e1af89a681 conversion: fix Qwen2.5-Omni mmproj conversion regression (#26262) Kaben Nanlohy 2026-07-29 04:53:44 -06:00
f5b9bd39b5 RPC: add tensor_memset (#25912) Aman Gupta 2026-07-29 15:04:30 +08:00
60bccc3763 add rdna3.5, and 3 to mmq configs so they can be tuned independently. (#26199) Geramy Loveless 2026-07-28 23:43:45 -07:00
7be2c65dc9 model: add NextN/MTP speculative decoding support for GLM_DSA (GLM-5.2) (#25980) Satinder GrewalandClaude Fable 5 2026-07-29 18:02:31 +12:00
e9fa0781f1 model: Add Laguna-S-2.1 LLM_TYPE (#26233) Guido Imperiale 2026-07-28 20:02:33 +01:00
bc71c24c9d ggml-webgpu: Fix some binding alias issues to support all archs, fix recurrent-state-rollback test (#25931) Reese Levine 2026-07-28 11:13:06 -07:00
8190848bb3 opencl: skip the Adreno KQ/KQV image kernels for multi-stream batches (#26189) Hongqiang Wang 2026-07-28 11:04:42 -07:00
7e1e28cae3 mtmd : add Nemotron 3 Nano Omni support (parakeet) (#22520)
Daniel Bevenius Sigbjørn Skjæret Xuan Son Nguyen
2026-07-28 17:20:25 +02:00
6e2bc65fb2 ui: rendering performance follow-up (#26097) Aleksander Grygier 2026-07-28 17:13:25 +02:00
ad77bd31a6 docs: Adapt conda-forge package name (#26229) Julien Jerphanionanddev-tinker 2026-07-28 16:51:20 +02:00
ee3d1b54c1 server: abstract llama_memory calls to common_memory (#26221) Xuan-Son Nguyen 2026-07-28 16:35:20 +02:00
da5b448622 ggml : set output of view src (#25729)
Aman Gupta Gaurav Garg Georgi Gerganov
2026-07-28 21:23:24 +08:00
8161641005 vulkan: add iq4_nl support back to FA (#24585) Jeff Bolz 2026-07-28 13:06:03 +01:00
b62b350981 ggml-cuda: add chunked SSD matmul for Mamba-2 prefill acceleration (#22675) Bhavik Sharda 2026-07-28 17:33:42 +05:30
84075273c8 spec: add DSpark speculative decoding (#25173)
王金旭 Zaire404 Ruixiang Wang Georgi Gerganov
2026-07-28 19:43:27 +08:00
6ba5ef2470 common/chat: add specialized minimax m3 parser (#26210) Aldehir Rojas 2026-07-28 04:27:20 -05:00
d6b61ac0d3 sycl: fix use-after-return of the SDPA scale in the oneDNN flash-attention path (#25880) meatposesandNeo Zhang 2026-07-28 03:37:25 -05:00
9a3bf2b849 server : add extra trace log for prompt similarity (#26218) Georgi Gerganov 2026-07-28 11:05:16 +03:00
f95de9776b ggml-metal: FWHT kernel for metal backend (#25924)
Nick Lafleur YiChen Lv Georgi Gerganov
2026-07-28 03:44:06 -04:00
f87067841b spec: add eagle3-v3 support for gpt-oss model (#25794) Ruixiang Wang 2026-07-28 08:58:16 +02:00
c6292cfb8e contrib : add guideline about the "merge ready" label (#26178) Georgi Gerganov 2026-07-28 08:41:04 +03:00
91f8c9c5fb Disable -ffast-math on HIP (#25495) Beinsezii 2026-07-27 16:13:48 -07:00
1cbfd19883 mtmd: support MiMo-V2.5 audio input (RVQ-based model) (#26190) Xuan-Son Nguyen 2026-07-27 23:17:09 +02:00
0e4a036223 common : add common_print_available_devices() (#26170) Adrien Gallouët 2026-07-27 18:19:59 +02:00
b77d646751 model: Add support for Nanbeige4.2 (#25994) zqlandroot 2026-07-27 23:04:18 +08:00
0324696b8e fit : count nextn (MTP) blocks in n_gpu_layers so front layers stay on GPU (#26177) Jonas Jankaitis 2026-07-27 16:21:37 +03:00
8e8681e0e2 sycl(build): parallelize ocloc invocations (#25903) Titaniumtown 2026-07-27 05:33:11 -07:00
dee2a846b8 ggml : adjust logic for offloading ops to weight's backend (#25832) Georgi Gerganov 2026-07-27 14:54:46 +03:00
7ef790f90a tests : remove unnecessary sync in test-save-load-state (#26166) Georgi Gerganov 2026-07-27 13:11:20 +03:00
ddfc2288e4 common: fix explicit -md precedence over draft sidecar resolution (#26165) PascalandGeorgi Gerganov 2026-07-27 12:10:59 +02:00
419b881c02 docs: add exception about weight folding (#26168) Xuan-Son Nguyen 2026-07-27 12:00:56 +02:00
b910200897 ggml-cpu: Enable BF16 tiled gemm optimization on PowerPC (#26068) shalinib-ibm 2026-07-27 14:22:03 +05:30
ad256ded30 args: add -lm mlock where it mlocks but doesnt mmap (#26135) Aaron Teo 2026-07-27 16:44:08 +08:00
d73c1d6b22 server + ui: fix stream routes for model names containing a slash (#26137) Pascal 2026-07-27 07:34:47 +02:00
88b47a755c ui: Fix symbolic math tool JS sandbox prompt (#26131) rankaiyx 2026-07-27 08:30:22 +08:00
3d1c3a8975 mtmd: Add Vision Support for Minimax-M3 (#25113)
timkhronos Sigbjørn Skjæret Daniel Han Xuan Son Nguyen
2026-07-27 01:44:41 +02:00
0d47ea7427 mtmd: fix android build (#26150) Xuan-Son Nguyen 2026-07-27 00:22:02 +02:00
d4d057b6dd ui: fix system message edit box not expanding to fit content (#26006) Piero Evangelista 2026-07-26 18:03:06 -04:00
7657a6c26a Keep Minimax's indexer tensors at F32 for speed and accuracy (#26144) Bartowski 2026-07-26 18:02:56 -04:00
55b7d6c4c7 ui: detect the conversation import format from file contents (#26121) Pascal 2026-07-26 23:32:58 +02:00
d2a818231e common: add subproc.h wrapper, disabled on android/ios (#26102) Xuan-Son Nguyen 2026-07-26 20:54:25 +02:00
af285020e9 mtmd: add GLM-5.2-Vision (#26126) Eric HartfordandEric Hartford 2026-07-26 14:43:51 -04:00
b1d4c65524 model: Add MiniMax-M3 (MSA: MiniMax Sparse Attention) support (#24908)
timkhronos Sigbjørn Skjæret Daniel Han Xuan Son Nguyen
2026-07-26 19:43:45 +02:00
42fc243060 opencl: fix fused RMS norm mul view offset (#26085) yzyyzyhhh 2026-07-26 23:01:08 +08:00
ff067f76dd ui: fix context gauge card regressions and land at the conversation end (#26099) Pascal 2026-07-26 06:51:10 +02:00
7cdd557f76 ggml-webgpu: Fix WASM compilation with OpenMP (#25943) Reese Levine 2026-07-25 17:37:18 -07:00
8bb909374d common : use-after-free when loading LoRA adapter fails (#25611) Nicky Mouha 2026-07-25 19:10:32 -04:00
20455a4ad3 server: support MCP stdio (#26062)
Xuan-Son Nguyen Piotr Wilkin Pascal
2026-07-26 01:08:49 +02:00
355303edab hexagon: partial im2col support (#26007) Todor Boinovski 2026-07-25 15:47:29 -07:00
c812c543f8 common : skip empty implicit default preset (#25643) hogeheer499-commitsandJS van Dijk 2026-07-25 21:15:27 +02:00
abc348790e server: add format arg to datetime tool (#26117) Xuan-Son Nguyen 2026-07-25 21:15:15 +02:00
2cfc7670ed server : add missing task parameters(adaptive_target, adaptive_decay) in generation_settings (#25830) Tekin Ertekin 2026-07-25 21:53:08 +03:00
720d7fa409 vendor : update cpp-httplib to 0.51.0 (#26067) Adrien Gallouët 2026-07-25 18:16:29 +02:00
fb92d8f187 Update ggml/src/gguf.cpp : Defined virtual keyword for destructor of gguf_writer_base (#25867) Yongmin Yoo 유용민 2026-07-25 21:32:37 +09:00
910196f6b3 common : add support for multiple end sequences in the reasoning budget sampler (#25544) Aldehir Rojas 2026-07-25 04:58:09 -05:00
d67c0b4107 tests: synchronize save-load-state generation (#26056) helanfxz 2026-07-25 16:23:31 +08:00
555881ebc8 ui: reduce per-token render cost when streaming (#26053) Zach WinterandZach Winter 2026-07-24 16:09:46 -04:00
96013c5112 ui: remove render effects (#26083) Pascal 2026-07-24 21:43:23 +02:00
88bfee1429 model: add GLM 5.2 Indexer support (#25407) Pedro Cuencaandfairydreaming 2026-07-24 20:55:56 +02:00
95a923a64c ui: fix MCP server display name conflicts in tools lists (#26011) Pascal 2026-07-24 19:28:14 +02:00
27209a598d server: support "reasoning_effort": "none" in OAI API (#26045) Nigel Bosch 2026-07-24 12:19:10 -05:00
298219f985 llama: various bug fixes (#26051) Xuan-Son Nguyen 2026-07-24 18:56:42 +02:00
fa72aeccb2 HIP: remove rocWMMA FlashAttention (#26046) Johannes Gäßler 2026-07-24 17:53:54 +02:00
ed7adbfefd opencl: cache compiled cl_program binaries on disk (#26050) Hongqiang Wang 2026-07-24 08:14:33 -07:00
56a83860dd opencl: do not treat NULL-mask flash attention as causal (#25771) kumaal 2026-07-24 20:12:01 +05:00
77095ee0cb skill: create add-new-model and code-review (#26042)
Xuan-Son Nguyen Piotr Wilkin Xuan-Son Nguyen
2026-07-24 17:04:17 +02:00
54ce507b6f UI: Fix settings precedence, Factory < Admin (--ui-config-file) < Users (Settings panel) (#26002) Pascal 2026-07-24 15:09:55 +02:00
8f5ab832ca cohere2 moe template parser: enforce JSON schema for text responses if a response schema is provided (#26018) Matt Thompson 2026-07-24 03:54:47 -07:00
0cea36222f vendor: update subprocess.h (#26061) Xuan-Son Nguyen 2026-07-24 08:02:23 +02:00
0a50d9909a hexagon: further improved pipeline of the core bits (L2, DMA, MM, FA) (#26049) Max Krasnyansky 2026-07-23 19:13:03 -07:00
c0bc8591e8 hexagon: fix Windows crash when op_poll is enabled (#26029) adgup-qti 2026-07-23 21:38:10 +05:30
1425386fd9 CUDA: fix external compilation of q1_0 MMQ (#25778) Johannes Gäßler 2026-07-23 14:45:51 +02:00
e6dd0e29a6 args: refactor mlock/mmap/directio into load-mode (#20834) Aaron Teo 2026-07-23 20:32:56 +08:00
da296d6e72 contrib: fix leftovers from the AI usage policy update (#26030) Pascal 2026-07-23 12:32:23 +02:00
c588c4f476 metal : add f16 type support to leaky relu (#25981) Ilia Ilmer 2026-07-22 23:45:46 -04:00
d941f6e1c9 conversion: fix non-MoE NomicBert GGUF conversion error (#25996) Shahir BIn Zulfiker 2026-07-23 09:01:35 +06:00
4310aa4f87 contrib: allow all AI-generated code in general (#26012) Xuan-Son Nguyen 2026-07-23 00:29:03 +02:00
cf512566dc ui: Add a "Default" option for the reasoning selector (#25846) Pascal 2026-07-22 23:09:49 +02:00
1a064ab092 CUDA: Improve NVFP4 W4A4 activation quantization (#25730) Oliver Simons 2026-07-22 19:28:02 +02:00
0278d8362d hexagon: activation ops update (#25974) Todor BoinovskiandMax Krasnyansky 2026-07-22 09:25:04 -07:00
e0833bf686 mtmd: use RAII for setting and resetting non-causal attention (#25723) Niklas Wenzel 2026-07-22 18:10:03 +02:00
61328e6a91 feat(ui): add symbolic math support to JS sandbox via nerdamer (#25948) rankaiyxandPascal 2026-07-22 23:52:55 +08:00
e8e6c7af24 minor: fix reasoning preserve var for DS4 [no ci] (#25999) Piotr Wilkin (ilintar) 2026-07-22 14:32:54 +02:00
6d5a910c50 common: infer the speculative type from the draft repo sidecars (#25989) Pascal 2026-07-22 13:06:35 +02:00
f534da26e4 Fix DeepSeek4 crafted template (#25414) Piotr Wilkin (ilintar) 2026-07-22 12:54:40 +02:00
3ce7da2c85 ggml: enable PowerPC backend variants on AIX (#25983) shalinib-ibm 2026-07-22 14:56:40 +05:30
b4d6c7d8ff ci : fix SYCL package shared library lookup (#25987) KyleHagy 2026-07-22 02:20:40 -07:00
7347430f44 webgpu : add CONV_2D_DW (depthwise conv2d) kernel (#25847) m1el 2026-07-22 03:24:44 -05:00
c5a4a0bb83 cuda: GET_ROWS quants (#25962) Pascal 2026-07-22 08:42:47 +02:00
67b9b0e7f6 llama-arch: fix DeepSeek4 APE tensor op (#25945) helanfxz 2026-07-22 10:55:44 +08:00
1f66c3ce1c Add support for Laguna XS.2 & M.1 (#25165) Joe Rowell 2026-07-22 03:54:08 +02:00
66e4bf7e59 convert: fix handle HunyuanVL XD-RoPE config (#25514) wendadawen 2026-07-22 06:42:35 +08:00
b4aa7dd477 mtmd : use align_corners for qwen3vl vision position embedding interpolation (#25781) Gerben van V 2026-07-21 23:58:34 +02:00
71102a73f2 hexagon: check tensor type when reusing descriptors (#25968) Wei Wang 2026-07-22 05:44:22 +08:00

1 2 3 4 5 ...

Commit Graph Select branches Hide Pull Requests dt3 master Mono Color

Commit Graph

Select branches

Hide Pull Requests

dt3

master