mirror of
https://github.com/clearml/clearml-docs
synced 2025-03-09 13:42:26 +00:00
Add GPU Compute application docs (#374)
This commit is contained in:
pollfly
GitHub
parent
d2b7135074
commit
c5050b4ad9
BIN
docs/img/apps_gpu_compute_dashboard.png
Normal file
BIN
docs/img/apps_gpu_compute_dashboard.png
Normal file
Binary file not shown.
|
After Width: | Height: | Size: 351 KiB |
BIN
docs/img/apps_gpu_compute_wizard.png
Normal file
BIN
docs/img/apps_gpu_compute_wizard.png
Normal file
Binary file not shown.
|
After Width: | Height: | Size: 55 KiB |
62
docs/webapp/applications/apps_gpu_compute.md
Normal file
62
docs/webapp/applications/apps_gpu_compute.md
Normal file
@ -0,0 +1,62 @@
|
||||
---
|
||||
title: GPU Compute
|
||||
---
|
||||
|
||||
:::info Pro Plan Offering
|
||||
The ClearML GPU Compute App is available under the ClearML Pro plan
|
||||
:::
|
||||
|
||||
Set up to run your workloads on 100% green cloud machines at optimized costs – no setup required! The ClearML GPU Compute
|
||||
Application automatically spins cloud machines up or down based on demand. The app optimizes machine usage according to
|
||||
a user defined resource budget: define your budget by specifying the GPU type and number of GPUs you want to use.
|
||||
|
||||
Each application instance monitors a ClearML queue: new cloud machines are spun up if there are pending jobs on the
|
||||
queue. The app instance automatically terminates idle machines based on a specified maximum idle time.
|
||||
|
||||
## GPU Compute Instance Configuration
|
||||
* **Import Configuration** - Import an app instance configuration file. This will fill the configuration wizard with the
|
||||
values from the file, which can be modified before launching the app instance
|
||||
* **Machine Specification**
|
||||
* GPU Type - NVIDIA GPU on the machine
|
||||
* Number of GPUs - Number of GPUs in the cloud machine
|
||||
* The rest of the machine’s available resources are dependent on the number and type of GPUs specified above:
|
||||
* vCPUs - Number of vCPUs in the cloud machine
|
||||
* Memory - RAM available to the cloud machine
|
||||
* Hourly Price - Machine's hourly rate
|
||||
* Disk - Amount of Disk space available to the cloud machine
|
||||
* Monitored Queue - Queue associated with application instance. The tasks enqueued to this queue will be executed on
|
||||
machines of this specification
|
||||
* Cloud Machine Limit - Maximum number of concurrent machines to launch
|
||||
* **Idle Time Limit** (Optional) - Maximum time in minutes that a cloud machine can be idle before it is spun down
|
||||
* **Default Docker Image** (Optional) - Default Docker image in which the ClearML Agent will run. Provide a Docker stored
|
||||
in a Docker artifactory so instances can automatically fetch it
|
||||
* **Git Configuration** - Git credentials with which the ClearML Agents running on your cloud instances will access your repositories to retrieve the code for their jobs
|
||||
* Git User
|
||||
* Git Password / Personal Access Token
|
||||
* **Cloud Storage Access** (Optional) - Access credentials to cloud storage service. Provides ClearML Tasks running on cloud
|
||||
machines access to your storage
|
||||
|
||||
|
||||
|
||||
## Dashboard
|
||||
|
||||
Once a GPU Compute instance is launched, the dashboard displays a summary of your cloud usage and costs.
|
||||
|
||||
|
||||
|
||||
The GPU Compute dashboard shows:
|
||||
* Service status indicator
|
||||
* <img src="/docs/latest/icons/ico-server-ok.svg" alt="Working server" className="icon size-md space-sm" /> - Cloud service is available
|
||||
* <img src="/docs/latest/icons/ico-server-alert.svg" alt="Not working server" className="icon size-md space-sm" /> - Cloud service is currently unavailable
|
||||
* Cloud instance details
|
||||
* GPU type
|
||||
* Number of GPUs
|
||||
* Number of vCPUs
|
||||
* RAM
|
||||
* Storage
|
||||
* Cost details
|
||||
* Instance rate
|
||||
* Total cost for current billing cycle
|
||||
* Number of current running cloud instances
|
||||
* Instance History - Number of running cloud instances over time
|
||||
* Console - The log shows updates of cloud instances being spun up/down.
|
||||
@ -13,6 +13,8 @@ Use ClearML’s GUI Applications to manage ML workloads and automatically run yo
|
||||
Configure and launch app instances, then track their execution from the app dashboard.
|
||||
|
||||
ClearML provides the following applications:
|
||||
* [**GPU Compute**](apps_gpu_compute.md) - Launch cloud machines on demand and optimize their usage according to a
|
||||
defined budget--no previous setup necessary
|
||||
* [**AWS Autoscaler**](apps_aws_autoscaler.md) - Optimize AWS EC2 instance usage according to a defined instance budget
|
||||
* [**GCP Autoscaler**](apps_gcp_autoscaler.md) - Optimize GCP instance usage according to a defined instance budget
|
||||
* [**Hyperparameter Optimization**](apps_hpo.md) - Find the parameter values that yield the best performing models
|
||||
|
||||
@ -70,6 +70,7 @@ module.exports = {
|
||||
{
|
||||
'ClearML Applications': [
|
||||
'webapp/applications/apps_overview',
|
||||
'webapp/applications/apps_gpu_compute',
|
||||
'webapp/applications/apps_aws_autoscaler',
|
||||
'webapp/applications/apps_gcp_autoscaler',
|
||||
'webapp/applications/apps_hpo',
|
||||
|
||||
9
static/icons/ico-server-alert.svg
Normal file
9
static/icons/ico-server-alert.svg
Normal file
@ -0,0 +1,9 @@
|
||||
<svg xmlns="http://www.w3.org/2000/svg" viewBox="0 0 64 64">
|
||||
<g>
|
||||
<path d="M52.17,36.62h-.13l2.37,3.92v-1.62c0-1.27-1-2.3-2.24-2.31Z" fill="#8492c2"/>
|
||||
<path d="M38.72,48.15h1.27l2.78-4.61h-4.06c-1.24,0-2.24-1.03-2.24-2.31s1-2.31,2.24-2.31h6.84l1.39-2.31H11.83c-1.24,0-2.24,1.03-2.24,2.31v4.62c0,1.27,1,2.3,2.24,2.31h4.48v2.31h8.96v-2.31h13.45v2.31Zm-22.41-4.61c-1.24,0-2.24-1.03-2.24-2.31,0-1.27,1-2.31,2.24-2.31s2.24,1.03,2.24,2.31-1,2.31-2.24,2.31Zm8.96,0c-1.24,0-2.24-1.03-2.24-2.31s1-2.31,2.24-2.31,2.24,1.03,2.24,2.31c0,1.27-1,2.31-2.24,2.31Z" fill="#8492c2"/>
|
||||
<path d="M11.83,32H52.17c1.24,0,2.24-1.03,2.24-2.31v-4.62c0-1.27-1-2.3-2.24-2.31H11.83c-1.24,0-2.24,1.03-2.24,2.31v4.62c0,1.27,1,2.3,2.24,2.31Zm26.89-6.92h8.96c1.24,0,2.24,1.03,2.24,2.31s-1,2.31-2.24,2.31h-8.96c-1.24,0-2.24-1.03-2.24-2.31s1-2.31,2.24-2.31Zm-13.45,0c1.24,0,2.24,1.03,2.24,2.31,0,1.27-1,2.3-2.24,2.31-1.24,0-2.24-1.03-2.24-2.31s1-2.31,2.24-2.31Zm-8.96,0c1.24,0,2.24,1.03,2.24,2.31,0,1.27-1,2.3-2.24,2.31-1.24,0-2.24-1.03-2.24-2.31s1-2.31,2.24-2.31Z" fill="#8492c2"/>
|
||||
<path d="M11.83,18.16H52.17c1.24,0,2.24-1.03,2.24-2.31v-4.62c0-1.27-1-2.3-2.24-2.31H11.83c-1.24,0-2.24,1.03-2.24,2.31v4.62c0,1.27,1,2.3,2.24,2.31Zm26.89-6.92h8.96c1.24,0,2.24,1.03,2.24,2.31s-1,2.31-2.24,2.31h-8.96c-1.24,0-2.24-1.03-2.24-2.31s1-2.31,2.24-2.31Zm-13.45,0c1.24,0,2.24,1.03,2.24,2.31,0,1.27-1,2.3-2.24,2.31-1.24,0-2.24-1.03-2.24-2.31s1-2.31,2.24-2.31Zm-8.96,0c1.24,0,2.24,1.03,2.24,2.31,0,1.27-1,2.3-2.24,2.31-1.24,0-2.24-1.03-2.24-2.31s1-2.31,2.24-2.31Z" fill="#8492c2"/>
|
||||
</g>
|
||||
<path id="alert" d="M59.22,52.89l-8-14c-.76-1.37-2.73-1.37-3.5,0l-8,14c-.74,1.33,.22,2.97,1.75,2.97h16c1.52,0,2.49-1.64,1.75-2.97Zm-9.75,.15c-.55,0-1-.45-1-1s.45-1,1-1,1,.45,1,1-.45,1-1,1Zm.5-4.59c0,.55-1,.55-1,0l-.5-4.59c0-.55,.45-1,1-1s1,.45,1,1l-.5,4.59Z" fill="#fd8934"/>
|
||||
</svg>
|
||||
|
After Width: | Height: | Size: 1.8 KiB |
8
static/icons/ico-server-ok.svg
Normal file
8
static/icons/ico-server-ok.svg
Normal file
@ -0,0 +1,8 @@
|
||||
<svg xmlns="http://www.w3.org/2000/svg" viewBox="0 0 64 64">
|
||||
<g>
|
||||
<path d="M38.34,43.5c-1.07-.18-1.88-1.12-1.88-2.27,0-1.28,1-2.31,2.24-2.31h3.8c1.87-1.21,4.1-1.92,6.5-1.92,1.9,0,3.69,.45,5.29,1.24-.28-.94-1.12-1.62-2.13-1.63H11.83c-1.24,0-2.24,1.03-2.24,2.31v4.62c0,1.27,1,2.3,2.24,2.31h4.48v2.31h8.96v-2.31h12.16c.22-.82,.53-1.61,.91-2.35Zm-22.05,.04c-1.24,0-2.24-1.03-2.24-2.31s1-2.31,2.24-2.31,2.24,1.03,2.24,2.31-1,2.31-2.24,2.31Zm8.97,0c-1.24,0-2.24-1.03-2.24-2.31s1-2.31,2.24-2.31,2.24,1.03,2.24,2.31-1.01,2.31-2.24,2.31Z" fill="#8492c2"/>
|
||||
<path d="M11.83,18.17H52.17c1.24,0,2.24-1.03,2.24-2.31v-4.62c0-1.27-1-2.3-2.24-2.31H11.83c-1.24,0-2.24,1.03-2.24,2.31v4.62c0,1.27,1,2.3,2.24,2.31Zm26.89-6.94h8.96c1.24,0,2.24,1.03,2.24,2.31s-1,2.31-2.24,2.31h-8.96c-1.24,0-2.24-1.03-2.24-2.31s1-2.31,2.24-2.31Zm-13.45,0c1.24,0,2.24,1.03,2.24,2.31s-1,2.3-2.24,2.31c-1.24,0-2.24-1.03-2.24-2.31s1-2.31,2.24-2.31Zm-8.96,0c1.24,0,2.24,1.03,2.24,2.31s-1,2.3-2.24,2.31c-1.24,0-2.24-1.03-2.24-2.31s1-2.31,2.24-2.31Z" fill="#8492c2"/>
|
||||
<path d="M11.83,32.01H52.17c1.24,0,2.24-1.03,2.24-2.31v-4.62c0-1.27-1-2.3-2.24-2.31H11.83c-1.24,0-2.24,1.03-2.24,2.31v4.62c0,1.27,1,2.3,2.24,2.31Zm26.88-6.94h8.96c1.24,0,2.24,1.03,2.24,2.31s-1,2.31-2.24,2.31h-8.96c-1.24,0-2.24-1.03-2.24-2.31s1-2.31,2.24-2.31Zm-13.45,0c1.24,0,2.24,1.03,2.24,2.31s-1,2.3-2.24,2.31c-1.24,0-2.24-1.03-2.24-2.31s1-2.31,2.24-2.31Zm-8.96,0c1.24,0,2.24,1.03,2.24,2.31s-1,2.3-2.24,2.31c-1.24,0-2.24-1.03-2.24-2.31s1-2.31,2.24-2.31Z" fill="#8492c2"/>
|
||||
</g>
|
||||
<path d="M49,39c-5.52,0-10,4.48-10,10s4.48,10,10,10,10-4.48,10-10-4.48-10-10-10Zm-1.99,14.99l-3.5-3.5,1.41-1.41,2.09,2.09,6.08-6.08,1.41,1.41-7.5,7.5h.01Z" fill="#21b553"/>
|
||||
</svg>
|
||||
|
After Width: | Height: | Size: 1.7 KiB |
Loading…
Reference in New Issue
Block a user