OpenWebUI/docs
1
0
Fork 0
mirror of https://github.com/open-webui/docs synced 2025-06-14 18:40:18 +00:00
Code Issues Actions Packages Projects Releases Wiki Activity

apply deepl write to catch all forms of typos

Browse Source
This commit is contained in:
Samuel Maier 2024-07-29 16:56:07 +02:00
parent 9e106a43ac
commit 6eeecf9256
1 changed files with 9 additions and 9 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

18
docs/tutorial/slim_down.md
View File

@ -1,13 +1,13 @@
---
sidebar_position: 10
title: "Slimming down RAM usage"
title: "Reduce RAM usage"
---
# Slimming down RAM usage
# Reduce RAM usage
If you deploy this image in a RAM constrained environment, there are a few things you can do do slim down the image.
If you are deploying this image in a RAM-constrained environment, there are a few things you can do to slim down the image.
On a Raspberry Pi 4 (arm64) with version v0.3.10 this was able to reduce idle memory consumption from >1GB to ~200MB (as observed with `docker container stats`).
On a Raspberry Pi 4 (arm64) with version v0.3.10, this was able to reduce idle memory consumption from >1GB to ~200MB (as observed with `docker container stats`).
## TLDR
@ -15,12 +15,12 @@ Set the following environment variables: `RAG_EMBEDDING_ENGINE: ollama`, `AUDIO_
## Longer explanation
A lot of the memory consumption is because of loaded ML models. Even if you use an external language model (OpenAI or un-bundled ollama) a lot of models may be loaded for additional purposes.
Much of the memory consumption is due to loaded ML models. Even if you are using an external language model (OpenAI or unbundled ollama), many models may be loaded for additional purposes.
As of v0.3.10 this includes:
* Speach-to-text (defaults to whisper)
* RAG Embedding engine (defaults to local SentenceTransformers model)
* Speech-to-text (whisper by default)
* RAG embedding engine (defaults to local SentenceTransformers model)
* Image generation engine (disabled by default)
The first 2 are enabled and set to local models by default. You can change the models in the admin planel (RAG: Documents category, set it to ollama or OpenAI, Speach-to-text: Audio section, OpenAI or WebAPI work).
If you deploy via docker you can also set these with the following environment variables: `RAG_EMBEDDING_ENGINE: ollama`, `AUDIO_STT_ENGINE: openai`.
The first 2 are enabled and set to local models by default. You can change the models in the admin panel (RAG: Documents category, set it to Ollama or OpenAI, Speech-to-text: Audio section, work with OpenAI or WebAPI).
If you deploy via Docker, you can also set them with the following environment variables: `RAG_EMBEDDING_ENGINE: ollama`, `AUDIO_STT_ENGINE: openai`.