Merge pull request #220 from thiswillbeyourgithub/fix_gpu_instructions

fix: docker gpu instructions
This commit is contained in:
Timothy Jaeryang Baek 2024-09-23 23:02:53 +02:00 committed by GitHub
commit 3815b0e1cf
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194

View File

@ -139,12 +139,14 @@ Visit the [Docker documentation](https://docs.docker.com/storage/) to understand
docker run -d -p 3000:8080 -e OLLAMA_BASE_URL=https://example.com -v open-webui:/app/backend/data --name open-webui --restart always ghcr.io/open-webui/open-webui:main
```
- **To run Open WebUI with Nvidia GPU support**, use this command:
- **To run Open WebUI with Nvidia GPU support**, use this command:
```bash
docker run -d -p 3000:8080 --gpus all --add-host=host.docker.internal:host-gateway -v open-webui:/app/backend/data --name open-webui --restart always ghcr.io/open-webui/open-webui:cuda
```
This will result in a faster Bundled Ollama, faster Speech-To-Text and faster RAG embeddings if using SentenceTransformers.
### Installation for OpenAI API Usage Only
- **If you're only using OpenAI API**, use this command: