millaguie/llama.cpp
1
0 Fork 0
Code Issues Pull Requests Actions 29 Packages Projects Releases Wiki Activity

Vulkan Shader Refactor, Memory Debugging Option (#7947)

Browse Source 
* Refactor shaders, extract GLSL code from ggml_vk_generate_shaders.py into vulkan-shaders directory

* Improve debug log code

* Add memory debug output option

* Fix flake8

* Fix unnecessary high llama-3 VRAM use
This commit is contained in:
0cc4m authored and GitHub committed 2024-06-16 07:17:31 +02:00
1 parent 0c7b3595b9
commit 7c7836d9d4
54 files changed
+25266 -21885
Download Patch File Download Diff File Expand all files Collapse all files

No files matched your search

Makefile
+4
View File
@@ -608,6 +608,10 @@ ifdef LLAMA_VULKAN_DEBUG
MK_CPPFLAGS += -DGGML_VULKAN_DEBUG
endif
ifdef LLAMA_VULKAN_MEMORY_DEBUG
MK_CPPFLAGS += -DGGML_VULKAN_MEMORY_DEBUG
endif
ifdef LLAMA_VULKAN_VALIDATE
MK_CPPFLAGS += -DGGML_VULKAN_VALIDATE
endif