examples : add readme files

This commit is contained in:
Georgi Gerganov committed 2023-11-29 11:00:17 +02:00
1 parent 4fea3420ee
commit 1f5cd83275
2 files changed
+15

No files matched your search

+7
View File
@@ -0,0 +1,7 @@
# llama.cpp/examples/lookahead
Demonstartion of lookahead decoding technique:
https://lmsys.org/blog/2023-11-21-lookahead-decoding/
More info: https://github.com/ggerganov/llama.cpp/pull/4207
+8
View File
@@ -0,0 +1,8 @@
# llama.cpp/examples/speculative
Demonstartion of speculative decoding and tree-based speculative decoding techniques
More info:
- https://github.com/ggerganov/llama.cpp/pull/2926
- https://github.com/ggerganov/llama.cpp/pull/3624