millaguie/llama.cpp
1
0 Fork 0
Code Issues Pull Requests Actions 27 Packages Projects Releases Wiki Activity

CUDA: require explicit opt-in for P2P access (#21910)

Browse Source
This commit is contained in:
Johannes Gäßler authored and GitHub committed 2026-04-15 16:01:46 +02:00
1 parent 014dca49d6
commit a6206958d2
2 files changed
+18 -10
Download Patch File Download Diff File Expand all files Collapse all files

No files matched your search

docs/build.md
+6
View File
@@ -281,6 +281,12 @@ Use `GGML_CUDA_FORCE_CUBLAS_COMPUTE_16F` environment variable to force use FP16
The environment variable `GGML_CUDA_ENABLE_UNIFIED_MEMORY=1` can be used to enable unified memory in Linux. This allows swapping to system RAM instead of crashing when the GPU VRAM is exhausted. In Windows this setting is available in the NVIDIA control panel as `System Memory Fallback`.
### Peer Access
The environment variable `GGML_CUDA_P2P` can be set to enable peer-to-peer access between multiple GPUs, allowing them to transfer data directly rather than to go through system memory.
Requires driver support (usually restricted to workstation/datacenter GPUs).
May cause crashes or corrupted outputs for some motherboards and BIOS settings (e.g. IOMMU).
### Performance Tuning
The following compilation options are also available to tweak performance: