ggml : add support for dynamic loading of backends (#10469)

* ggml : add support for dynamic loading of backends

---------

Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
This commit is contained in:
Diego DevesaandGeorgi Gerganov authored and GitHub committed 2024-11-25 15:13:39 +01:00
1 parent f6d12e7df8
commit 5931c1f233
44 files changed
+728 -272

No files matched your search

+4
View File
@@ -74,6 +74,10 @@ int main(int argc, char ** argv) {
}
}
// load dynamic backends
ggml_backend_load_all();
// initialize the model
llama_model_params model_params = llama_model_default_params();