Introduce C-style API (#370)

Browse Source

* Major refactoring - introduce C-style API

* Clean up

* Add <cassert>

* Add <iterator>

* Add <algorithm> ....

* Fix timing reporting and accumulation

* Measure eval time only for single-token calls

* Change llama_tokenize return meaning

...

This commit is contained in:

Georgi Gerganov authored and GitHub committed 2023-03-22 07:32:36 +02:00

1 parent da0e9fe90c

commit f5a77a629b

14 files changed

+1953 -1751

Show all changes Ignore whitespace when comparing lines Ignore changes in amount of whitespace Ignore changes in whitespace at EOL

Download Patch File Download Diff File Expand all files Collapse all files

No files matched your search

llama.cpp

+1565

File diff suppressed because it is too large. Load diff