New Deployment

Added Dockerfile and compose.yaml as an option for deployment. Updated README.md
This commit is contained in:
pkeffect
2025-04-18 16:03:20 -04:00
parent 40c5cc4b0f
commit f7ecd272b2
3 changed files with 144 additions and 0 deletions

View File

@@ -25,6 +25,20 @@ Installing `llama-cpp-runner` is quick and easy! Just use pip:
pip install llama-cpp-runner
```
## Optional Installation (Docker)
Clone the repository
```bash
git clone https://github.com/open-webui/llama-cpp-runner
```
Build and run
```bash
docker compose up -d
```
## Usage 📖
### Initialize the Runner