ClearML/clearml-docs
1
0
Fork 0
mirror of https://github.com/clearml/clearml-docs synced 2025-01-30 22:18:02 +00:00
Code Issues Actions 1 Packages Projects Releases Wiki Activity

Add llama.cpp application images (#979)

Browse Source
This commit is contained in:
pollfly 2024-12-04 13:33:41 +02:00 committed by GitHub
parent 1e9afa0a64
commit 2f65b9593a
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
3 changed files with 4 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

BIN
docs/img/apps_llama_dashboard.png Normal file
View File

Binary file not shown.
Side by Side

After

Width:  |  Height:  |  Size: 181 KiB

BIN
docs/img/apps_llama_form.png Normal file
View File

Binary file not shown.
Side by Side

After

Width:  |  Height:  |  Size: 40 KiB

4
docs/webapp/applications/apps_llama_deployment.md
View File

@ -43,6 +43,8 @@ After starting a llama.cpp Model Deployment instance, you can view the following
* GPU temperature
* Console log - The console log shows the app instance's console output: setup progress, status changes, error messages, etc.
![llama deployment dashboard](../../img/apps_llama_dashboard.png)
## Llama.cpp Model Deployment Instance Configuration
When configuring a new llama.cpp Model Deployment instance, you can fill in the required parameters or reuse the
@ -75,3 +77,5 @@ values from the file, which can be modified before launching the app instance
* Last Action Report Interval (Seconds) - The frequency at which the last activity made by the application is reported.
Used to stop the application from entering an idle state when the machine metrics are low but the application is
actually still running
![llama deployment app form](../../img/apps_llama_form.png)