llama-cpp-runner/compose.yaml
pkeffect f7ecd272b2 New Deployment
Added Dockerfile and compose.yaml as an option for deployment. Updated README.md
2025-04-18 16:03:20 -04:00

15 lines
321 B
YAML

services:
llama-cpp-runner:
build: .
container_name: owui-llama-cpp-runner
ports:
- "3636:3636"
volumes:
- ./models:/models
- ./cache:/cache
environment:
- MODELS_DIR=/models
- CACHE_DIR=/cache
- VERBOSE=true
- TIMEOUT_MINUTES=30
restart: unless-stopped