Merge pull request #27 from justinh-rahb/main

Add Model Filter Tutorial
This commit is contained in:
Timothy Jaeryang Baek 2024-03-23 14:37:13 -05:00 committed by GitHub
commit d8c3c67874
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
6 changed files with 39 additions and 2 deletions

View File

@ -1,5 +1,5 @@
---
sidebar_position: 6
sidebar_position: 5
title: "📋 FAQ"
---

View File

@ -1,5 +1,5 @@
---
sidebar_position: 7
sidebar_position: 8
title: "🧑‍🔬 Open WebUI for Research"
---

View File

@ -1,3 +1,8 @@
---
sidebar_position: 3
title: "Image Generation"
---
# Image Generation
Open WebUI now supports image generation through two backends: **AUTOMATIC1111** and **OpenAI DALL·E**. This guide will help you set up and use both options.

View File

@ -1,3 +1,8 @@
---
sidebar_position: 4
title: "LiteLLM Configuration"
---
# LiteLLM Configuration
[LiteLLM](https://litellm.vercel.app/docs/proxy/configs#quick-start) supports a variety of APIs, both OpenAI-compatible and others. To integrate a new API model, follow these instructions:

View File

@ -0,0 +1,27 @@
---
sidebar_position: 5
title: "Model Whitelisting"
---
# Model Whitelisting
Open WebUI allows you to filter specific models for use in your instance. This feature is especially useful for administrators who want to control which models are available to users. Filtering can be done through the WebUI or by adding environment variables to the backend.
## Filtering via WebUI
![Model Filter Configuration](/img/tutorial_model_filter.png)
1. Go to **Admin Panel > Admin Settings**.
2. In the **Manage Models** section, you can enable or disable the feature, and add or remove models from the whitelist.
3. Click **Save** to apply your changes.
## Filtering via Environment Variables
You can also whitelist models by adding environment variables to the backend. This method is useful for automated deployments and can be done by adding the following environment variables to your `docker run` command:
```bash
-e MODEL_FILTER_ENABLED=True \
-e MODEL_FILTER_LIST="llama2:13b;mistral:latest;gpt-3.5-turbo" \
```
In this example, the `MODEL_FILTER_ENABLED` variable is set to `True` to enable the feature, and the `MODEL_FILTER_LIST` variable lists the models to be whitelisted. The format for the `MODEL_FILTER_LIST` variable is `model_name:version;model_name:version;...`.

Binary file not shown.

After

Width:  |  Height:  |  Size: 101 KiB