millaguie/llama.cpp
1
0
Fork 0
Code Issues Pull Requests Actions 33 Packages Projects Releases Wiki Activity
Files
4ffcdce2ff877ebb683cd217ea38faf20faa5ffe
llama.cpp/examples/parallel/README.md
T

4 lines
93 B
Markdown
Raw Normal View History

llama : custom attention mask + parallel decoding + no context swaps (#3228)
2023-09-28 19:04:36 +03:00
# llama.cpp/example/parallel
Fix some documentation typos/grammar mistakes (#4032)
2023-11-11 22:04:58 -08:00
Simplified simulation of serving incoming requests in parallel
Reference in New Issue Copy Permalink