millaguie/llama.cpp
1
0 Fork 0
Code Issues Pull Requests Actions 27 Packages Projects Releases Wiki Activity

Allow "quantizing" to f16 and f32 (#1787)

Browse Source 
* Allow "quantizing" to f16 and f32

Fix an issue where quantizing didn't respect LLAMA_NO_K_QUANTS

Add brief help to the list of quantization types in the quantize tool

Ignore case for quantization type arguments in the quantize tool
This commit is contained in:
Kerfuffle authored and GitHub committed 2023-06-13 04:23:23 -06:00
1 parent 74a6d922f1
commit 74d4cfa343
4 files changed
+154 -48
Download Patch File Download Diff File Expand all files Collapse all files

No files matched your search

Makefile
+1
View File
@@ -127,6 +127,7 @@ endif
ifndef LLAMA_NO_K_QUANTS
CFLAGS += -DGGML_USE_K_QUANTS
CXXFLAGS += -DGGML_USE_K_QUANTS
OBJS += k_quants.o
endif