Merge pull request #397 from signorecello/patch-1

Update Kokoro-FastAPI-integration.md
This commit is contained in:
Timothy Jaeryang Baek 2025-02-11 21:07:37 -08:00 committed by GitHub
commit 113ef8c804
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194

View File

@ -54,14 +54,54 @@ This tutorial is a community contribution and is not supported by the Open WebUI
### GPU Version (Requires NVIDIA GPU with CUDA 12.1) ### GPU Version (Requires NVIDIA GPU with CUDA 12.1)
Using docker run:
```bash ```bash
docker run -d -p 8880:8880 -p 7860:7860 remsky/kokoro-fastapi-gpu:latest docker run --gpus all -p 8880:8880 ghcr.io/remsky/kokoro-fastapi-gpu
``` ```
Or docker compose, by creating a `docker-compose.yml` file and running `docker compose up`. For example:
```yaml
name: kokoro
services:
kokoro-fastapi-gpu:
ports:
- 8880:8880
image: ghcr.io/remsky/kokoro-fastapi-gpu:v0.2.1
restart: always
deploy:
resources:
reservations:
devices:
- driver: nvidia
count: all
capabilities:
- gpu
```
:::info
You may need to install and configure [the NVIDIA Container Toolkit](https://docs.nvidia.com/datacenter/cloud-native/container-toolkit/latest/install-guide.html)
:::
### CPU Version (ONNX optimized inference) ### CPU Version (ONNX optimized inference)
With docker run:
```bash ```bash
docker run -d -p 8880:8880 -p 7860:7860 remsky/kokoro-fastapi-cpu:latest docker run -p 8880:8880 ghcr.io/remsky/kokoro-fastapi-cpu
```
With docker compose:
```yaml
name: kokoro
services:
kokoro-fastapi-cpu:
ports:
- 8880:8880
image: ghcr.io/remsky/kokoro-fastapi-cpu
restart: always
``` ```
## Setting up Open WebUI to use `Kokoro-FastAPI` ## Setting up Open WebUI to use `Kokoro-FastAPI`