ggml : remove assert for AArch64 GEMV and GEMM Q4 kernels (#9217)

Browse Source

* ggml : remove assert for AArch64 GEMV and GEMM Q4 kernels

* added fallback mechanism when the offline re-quantized model is not
optimized for the underlying target.

* fix for build errors

* remove prints from the low-level code

* Rebase to the latest upstream

...

This commit is contained in:

Charles Xu authored and GitHub committed 2024-09-25 16:12:20 +03:00

1 parent afbbfaa537

commit 1e43630218

1 file changed

+1591 -1635

Show all changes Ignore whitespace when comparing lines Ignore changes in amount of whitespace Ignore changes in whitespace at EOL

Download Patch File Download Diff File Expand all files Collapse all files

ggml/src/ggml-aarch64.c

+1591 -1635

File diff suppressed because it is too large. Load diff