ggml : refactor llamafile_sgemm PPC code (#14673)

Browse Source

Remove un-necessary templates from class definition and packing functions
Reduce deeply nested conditionals, if-else switching in mnapck function
Replace repetitive code with inline functions in Packing functions

2 ~ 7% improvement in Q8 Model
15 ~ 50% improvement in Q4 Model

Signed-off-by: Shalini Salomi Bodapati <Shalini.Salomi.Bodapati@ibm.com>

...

This commit is contained in:

shalinib-ibm authored and GitHub committed 2025-07-14 16:16:42 +03:00

1 parent 9c9e4fc635

commit 55c509daf5

1 file changed

+340 -1091

Show all changes Ignore whitespace when comparing lines Ignore changes in amount of whitespace Ignore changes in whitespace at EOL

Download Patch File Download Diff File Expand all files Collapse all files

ggml/src/ggml-cpu/llamafile/sgemm.cpp

+340 -1091

File diff suppressed because it is too large. Load diff