2025-08-21 12:16:54 +02:00
|
|
|
---
|
|
|
|
|
base_model:
|
|
|
|
|
- {base_model}
|
|
|
|
|
---
|
|
|
|
|
# {model_name} GGUF
|
|
|
|
|
|
|
|
|
|
Recommended way to run this model:
|
|
|
|
|
|
|
|
|
|
```sh
|
2025-12-16 13:25:09 +01:00
|
|
|
llama-server -hf {namespace}/{model_name}-GGUF -c 0
|
2025-08-21 12:16:54 +02:00
|
|
|
```
|
|
|
|
|
|
|
|
|
|
Then, access http://localhost:8080
|