Add AWS Autoscaler admonition ()

This commit is contained in:
pollfly 2024-12-05 10:54:35 +02:00 committed by GitHub
parent 2f65b9593a
commit ff2a7bd893
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
2 changed files with 25 additions and 4 deletions
docs
guides/services
webapp/applications

View File

@ -16,8 +16,19 @@ Run the ClearML AWS autoscaler in one of these ways:
script locally
* Launch through your [`services` queue](../../clearml_agent/clearml_agent_services_mode.md)
:::note Default AMI
The autoscaler service uses by default the `NVIDIA Deep Learning AMI v20.11.0-46a68101-e56b-41cd-8e32-631ac6e5d02b` AMI.
:::note AMIs
The AWS autoscaler can make use of any AMI (e.g. `NVIDIA Deep Learning AMI v20.11.0-46a68101-e56b-41cd-8e32-631ac6e5d02b`),
available to your AWS account. Note that AWS frequently updates its available AMIs.
Recent NVIDIA AMIs only install the required drivers on initial user login. To make use of such AMIs, the autoscaler
needs to mimic an initial user login. This can be accomplished by adding the following pre-execution bash script
(see [step 5](#step_5)):
```
apt-get update
DEBIAN_FRONTEND=noninteractive apt-get -y -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" upgrade
su -l ubuntu -c '/usr/bin/bash /home/ubuntu/.profile'
```
:::
### Running the Script
@ -95,7 +106,7 @@ When the script runs, a configuration wizard prompts for instance details and bu
Define another instance type? [y/N]:
```
1. Enter any bash script to run on newly created instances before launching the ClearML Agent.
1. Enter any bash script to run on newly created instances before launching the ClearML Agent. <a id="step_5"></a>
```console
Enter any pre-execution bash script to be executed on the newly created instances []:

View File

@ -70,7 +70,17 @@ to open the app's instance launch form.
to launch this resource in
* AMI ID - The AWS AMI to launch
:::note AMI prerequisites
The AMI used for the autoscaler must include docker runtime and virtualenv
The AMI used for the autoscaler must include docker runtime and virtualenv.
Recent NVIDIA AMIs only install the required drivers on initial user login. To make use of such AMIs, the autoscaler
needs to mimic an initial user login. This can be accomplished by, adding the following script to the `Init script`
field:
```
apt-get update
DEBIAN_FRONTEND=noninteractive apt-get -y -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" upgrade
su -l ubuntu -c '/usr/bin/bash /home/ubuntu/.profile'
```
:::
* Max Number of Instances - Maximum number of concurrent running instances of this type allowed
* Monitored Queue - Queue associated with this instance type. The tasks enqueued to this queue will be executed on