2021-05-13 23:48:51 +00:00
---
title: AWS EC2 AMIs
---
2022-05-19 06:59:10 +00:00
Deployment of ClearML Server on AWS is easily performed using AWS AMIs, which are available in the AWS community AMI catalog.
2022-04-06 09:08:45 +00:00
The [ClearML Server community AMIs ](#clearml-server-aws-community-amis ) are configured by default without authentication
to allow quick access and onboarding.
2021-05-13 23:48:51 +00:00
2022-04-06 09:08:45 +00:00
After deploying the AMI, configure the ClearML Server instance to provide the authentication scheme that
2021-05-13 23:48:51 +00:00
best matches the workflow.
2022-01-30 10:54:40 +00:00
For information about upgrading a ClearML Server in an AWS instance, see [here ](upgrade_server_aws_ec2_ami.md ).
2021-05-13 23:48:51 +00:00
:::important
2022-05-19 06:59:10 +00:00
If ClearML Server is being reinstalled, clearing browser cookies for ClearML Server is recommended. For example,
2021-05-13 23:48:51 +00:00
for Firefox, go to Developer Tools > Storage > Cookies, and for Chrome, go to Developer Tools > Application > Cookies,
2022-01-30 10:54:40 +00:00
and delete all cookies under the ClearML Server URL.
2021-05-13 23:48:51 +00:00
:::
## Launching
2024-06-23 07:00:06 +00:00
:::warning
2022-05-19 06:59:10 +00:00
By default, ClearML Server deploys as an open network. To restrict ClearML Server access, follow the instructions
2021-05-13 23:48:51 +00:00
in the [Security ](clearml_server_security.md ) page.
:::
2023-08-27 07:23:06 +00:00
The minimum recommended amount of RAM is 8 GB. For example, a `t3.large` or `t3a.large` EC2 instance type would accommodate the recommended RAM size.
2021-05-13 23:48:51 +00:00
2022-04-06 09:08:45 +00:00
**To launch a ClearML Server AWS community AMI**, use one of the [ClearML Server AWS community AMIs ](#clearml-server-aws-community-amis )
and see:
2021-05-13 23:48:51 +00:00
2022-04-06 09:08:45 +00:00
* The AWS Knowledge Center page, [How do I launch an EC2 instance from a custom Amazon Machine Image (AMI)? ](https://aws.amazon.com/premiumsupport/knowledge-center/launch-instance-custom-ami/ )
* Detailed instructions in the AWS Documentation for [Launching an Instance Using the Launch Instance Wizard ](https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/launching-instance.html ).
2021-05-13 23:48:51 +00:00
## Accessing ClearML Server
2022-05-19 06:59:10 +00:00
Once deployed, ClearML Server exposes the following services:
2021-05-13 23:48:51 +00:00
* Web server on `TCP port 8080`
* API server on `TCP port 8008`
* File Server on `TCP port 8081`
2022-04-06 09:08:45 +00:00
**To locate ClearML Server address:**
2021-05-13 23:48:51 +00:00
1. Go to AWS EC2 Console.
2022-04-06 09:08:45 +00:00
1. In the **Details** tab, **Public DNS (IPv4)** shows the ClearML Server address.
2021-05-13 23:48:51 +00:00
2023-06-15 08:22:50 +00:00
**To access ClearML Server WebApp (UI):**
2021-05-13 23:48:51 +00:00
* Direct browser to its web server URL: `http://<Server Address>:8080`
**To SSH into ClearML Server:**
* Log into the AWS AMI using the default username `ec2-user` . Control the SSH credentials from the AWS management console.
2022-04-06 09:08:45 +00:00
### Logging in to the WebApp (UI)
2021-05-13 23:48:51 +00:00
2022-04-06 09:08:45 +00:00
Enter any name to log in to the ClearML WebApp (UI). If needed, modify the default login behavior to match workflow policy,
see [Configuring Web Login Authentication ](clearml_server_config.md#web-login-authentication )
2021-05-13 23:48:51 +00:00
on the "Configuring Your Own ClearML Server" page.
2021-09-09 10:17:46 +00:00
## Storage Configuration
2021-05-13 23:48:51 +00:00
2022-04-06 09:08:45 +00:00
The pre-built ClearML Server storage configuration is the following:
2021-05-13 23:48:51 +00:00
2022-02-20 15:48:55 +00:00
* MongoDB: `/opt/clearml/data/mongo_4/`
2021-05-13 23:48:51 +00:00
* Elasticsearch: `/opt/clearml/data/elastic_7/`
2023-08-27 07:28:38 +00:00
* File Server: `/opt/clearml/data/fileserver/`
2021-05-13 23:48:51 +00:00
2021-09-09 10:17:46 +00:00
## Backing Up and Restoring Data and Configuration
2021-05-13 23:48:51 +00:00
2024-06-23 07:00:06 +00:00
:::warning
2023-08-22 08:11:29 +00:00
Stop your server before backing up or restoring data and configuration
:::
2021-05-13 23:48:51 +00:00
:::note
If data is being moved between a **Trains Server** and a **ClearML Server** installation, make sure to use the correct paths
2022-04-06 09:08:45 +00:00
for backup and restore (`/opt/trains` and `/opt/clearml` respectively).
2021-05-13 23:48:51 +00:00
:::
The commands in this section are examples for backing up and restoring data and configuration.
If data and configuration folders are in `/opt/clearml` , then archive all data into `~/clearml_backup_data.tgz` , and
configuration into `~/clearml_backup_config.tgz` :
```bash
sudo tar czvf ~/clearml_backup_data.tgz -C /opt/clearml/data .
sudo tar czvf ~/clearml_backup_config.tgz -C /opt/clearml/config .
```
**If data and configuration need to be restored**:
1. Verify you have the backup files.
1. Replace any existing data with the backup data:
2024-06-30 06:16:11 +00:00
2021-05-13 23:48:51 +00:00
```bash
sudo rm -fR /opt/clearml/data/* /opt/clearml/config/*
sudo tar -xzf ~/clearml_backup_data.tgz -C /opt/clearml/data
sudo tar -xzf ~/clearml_backup_config.tgz -C /opt/clearml/config
```
1. Grant access to the data:
2024-06-30 06:16:11 +00:00
2021-05-13 23:48:51 +00:00
```bash
sudo chown -R 1000:1000 /opt/clearml
```
2021-09-09 10:17:46 +00:00
## ClearML Server AWS Community AMIs
2021-05-13 23:48:51 +00:00
2022-04-06 09:08:45 +00:00
The following section contains a list of AMI Image IDs per-region for the latest ClearML Server version.
2021-05-13 23:48:51 +00:00
2021-09-09 10:17:46 +00:00
### Latest Version
2021-05-13 23:48:51 +00:00
2024-07-22 09:40:56 +00:00
#### v1.16.1
* **af-south-1** : ami-02ed8d588205b4fe2
* **ap-east-1** : ami-05a3b16b52c7ab9ee
* **ap-northeast-1** : ami-0a425f51ecb48c837
* **ap-northeast-2** : ami-00541f92b8fb1d3d7
* **ap-northeast-3** : ami-09ca9eba0d6a47fe8
* **ap-south-1** : ami-01554b85af7377d9e
* **ap-south-2** : ami-02c9475b1fbeb86fa
* **ap-southeast-1** : ami-034f99ecf6c229060
* **ap-southeast-2** : ami-086f7305eb33973a7
* **ap-southeast-3** : ami-0360c72ea185c79ba
* **ap-southeast-4** : ami-0f734b86d8ff3ec12
* **ca-central-1** : ami-0f8cf16115bbca70c
* **ca-west-1** : ami-078db3102a65f77ca
* **eu-central-1** : ami-05fbe763f42a1085c
* **eu-central-2** : ami-0e9f76fd80c3688df
* **eu-north-1** : ami-0b924dbc0f8d39311
* **eu-south-1** : ami-04c58eb3ddccb9ce1
* **eu-south-2** : ami-08939ab12f788384a
* **eu-west-1** : ami-009dc0721973a62c8
* **eu-west-2** : ami-094b7a21d2b684d68
* **eu-west-3** : ami-02388617dd65a2b9d
* **il-central-1** : ami-06894be77bc26ab32
* **me-central-1** : ami-003c2d8afeb2fd7bb
* **me-south-1** : ami-01b48c98f6162bfa1
* **sa-east-1** : ami-0eb02ec9e8855c020
* **us-east-1** : ami-01cced957f2d5b2ee
* **us-east-2** : ami-051665ae435790e0f
* **us-west-1** : ami-0b9f7b0977ac14d36
* **us-west-2** : ami-09a5b99b5c24fb20e
2021-05-13 23:48:51 +00:00
## Next Step
2024-04-30 12:31:05 +00:00
To keep track of your experiments and/or data, the `clearml` package needs to communicate with your server.
For instruction to connect the ClearML SDK to the server, see [Getting Started: First Steps ](../getting_started/ds/ds_first_steps.md ).