From fa275613177f57a660f935f8ee74e1742bc47c23 Mon Sep 17 00:00:00 2001 From: thiswillbeyourgithub <26625900+thiswillbeyourgithub@users.noreply.github.com> Date: Mon, 23 Sep 2024 11:23:35 +0200 Subject: [PATCH] docs: add reason for enabling GPU Initially I decided not to enable GPU because I intended to use Ollama externally but had forgotten about the STT so I think a reminder would be better --- docs/getting-started/index.mdx | 2 ++ 1 file changed, 2 insertions(+) diff --git a/docs/getting-started/index.mdx b/docs/getting-started/index.mdx index 17b1668..5974dd4 100644 --- a/docs/getting-started/index.mdx +++ b/docs/getting-started/index.mdx @@ -145,6 +145,8 @@ Visit the [Docker documentation](https://docs.docker.com/storage/) to understand docker run -d -p 3000:8080 --gpus all --add-host=host.docker.internal:host-gateway -v open-webui:/app/backend/data --name open-webui --restart always ghcr.io/open-webui/open-webui:cuda ``` + This will result in a faster Bundled Ollama, faster Speech-To-Text and faster RAG embeddings if using SentenceTransformers. + ### Installation for OpenAI API Usage Only - **If you're only using OpenAI API**, use this command: