diff --git a/docs/guides/services/aws_autoscaler.md b/docs/guides/services/aws_autoscaler.md index 85e6035d..0823869a 100644 --- a/docs/guides/services/aws_autoscaler.md +++ b/docs/guides/services/aws_autoscaler.md @@ -16,8 +16,19 @@ Run the ClearML AWS autoscaler in one of these ways: script locally * Launch through your [`services` queue](../../clearml_agent/clearml_agent_services_mode.md) -:::note Default AMI -The autoscaler service uses by default the `NVIDIA Deep Learning AMI v20.11.0-46a68101-e56b-41cd-8e32-631ac6e5d02b` AMI. +:::note AMIs +The AWS autoscaler can make use of any AMI (e.g. `NVIDIA Deep Learning AMI v20.11.0-46a68101-e56b-41cd-8e32-631ac6e5d02b`), +available to your AWS account. Note that AWS frequently updates its available AMIs. + +Recent NVIDIA AMIs only install the required drivers on initial user login. To make use of such AMIs, the autoscaler +needs to mimic an initial user login. This can be accomplished by adding the following pre-execution bash script +(see [step 5](#step_5)): + +``` +apt-get update +DEBIAN_FRONTEND=noninteractive apt-get -y -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" upgrade +su -l ubuntu -c '/usr/bin/bash /home/ubuntu/.profile' +``` ::: ### Running the Script @@ -95,7 +106,7 @@ When the script runs, a configuration wizard prompts for instance details and bu Define another instance type? [y/N]: ``` -1. Enter any bash script to run on newly created instances before launching the ClearML Agent. +1. Enter any bash script to run on newly created instances before launching the ClearML Agent. ```console Enter any pre-execution bash script to be executed on the newly created instances []: diff --git a/docs/webapp/applications/apps_aws_autoscaler.md b/docs/webapp/applications/apps_aws_autoscaler.md index 43fbaccb..9adc5122 100644 --- a/docs/webapp/applications/apps_aws_autoscaler.md +++ b/docs/webapp/applications/apps_aws_autoscaler.md @@ -70,7 +70,17 @@ to open the app's instance launch form. to launch this resource in * AMI ID - The AWS AMI to launch :::note AMI prerequisites - The AMI used for the autoscaler must include docker runtime and virtualenv + The AMI used for the autoscaler must include docker runtime and virtualenv. + + Recent NVIDIA AMIs only install the required drivers on initial user login. To make use of such AMIs, the autoscaler + needs to mimic an initial user login. This can be accomplished by, adding the following script to the `Init script` + field: + + ``` + apt-get update + DEBIAN_FRONTEND=noninteractive apt-get -y -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" upgrade + su -l ubuntu -c '/usr/bin/bash /home/ubuntu/.profile' + ``` ::: * Max Number of Instances - Maximum number of concurrent running instances of this type allowed * Monitored Queue - Queue associated with this instance type. The tasks enqueued to this queue will be executed on