mirror of
https://github.com/open-webui/docs
synced 2025-05-19 18:58:41 +00:00
Update deepseekr1-dynamic.md
This commit is contained in:
parent
1461c0990a
commit
5829859e1e
@ -100,7 +100,7 @@ Here’s the command to start the server:
|
||||
- **`--n-gpu-layers`:** Set the number of layers you want to offload to your GPU for faster inference. The exact number depends on your GPU’s memory capacity — reference Unsloth’s table for specific recommendations.
|
||||
:::
|
||||
|
||||
For example, if your model was downloaded to `/Users/tim/Documents/workspace` and you have an RTX 4090 GPU with 24GB VRAM, your command would look like this:
|
||||
For example, if your model was downloaded to `/Users/tim/Documents/workspace`, your command would look like this:
|
||||
```bash
|
||||
./llama-server \
|
||||
--model /Users/tim/Documents/workspace/DeepSeek-R1-GGUF/DeepSeek-R1-UD-IQ1_S/DeepSeek-R1-UD-IQ1_S-00001-of-00003.gguf \
|
||||
|
Loading…
Reference in New Issue
Block a user