mirror of
https://github.com/clearml/clearml-server
synced 2025-01-31 10:56:48 +00:00
300 lines
12 KiB
Markdown
300 lines
12 KiB
Markdown
# Deploying **trains-server** on AWS
|
|
|
|
To easily deploy **trains-server** on AWS, use one of our pre-built Amazon Machine Images (AMIs).
|
|
We provide AMIs per region for each released version of **trains-server**, see [Released versions](#released-versions) below.
|
|
|
|
Once the AMI is up and running, [configure the Trains client](https://github.com/allegroai/trains/blob/master/README.md#configuration) to use your **trains-server**.
|
|
The service port numbers on our **trains-server** AMIs:
|
|
|
|
- Web application: `8080`
|
|
- API Server: `8008`
|
|
- File Server: `8081`
|
|
|
|
The persistent storage configuration:
|
|
|
|
- MongoDB: `/opt/trains/data/mongo/`
|
|
- ElasticSearch: `/opt/trains/data/elastic/`
|
|
- File Server: `/mnt/fileserver/`
|
|
|
|
For examples and use cases, check the [Trains usage examples](https://github.com/allegroai/trains/blob/master/docs/trains_examples.md).
|
|
|
|
For instructions on launching a custom AMI from the EC2 console, see the [AWS Knowledge Center](https://aws.amazon.com/premiumsupport/knowledge-center/launch-instance-custom-ami/) or detailed instructions in the [AWS Documentation](https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/launching-instance.html).
|
|
|
|
The minimum recommended amount of RAM is 8GB. For example, **t3.large** or **t3a.large** would have the minimum recommended amount of resources.
|
|
|
|
## Upgrading
|
|
|
|
To upgrade **trains-server** on an existing EC2 instance based on one of these AMIs, SSH into the instance and follow the [upgrade instructions](../README.md#upgrade) for **trains-server**.
|
|
|
|
### Note on upgrading AMIs to v0.12
|
|
|
|
This upgrade includes the automatically updated AMI in Version 0.12. It also includes an additional REDIS docker to the **trains-server** setup.
|
|
|
|
To upgrade the AMI:
|
|
|
|
1. SSH to the EC2 machine running one of the `Latest Version AMI's`
|
|
2. Execute the following bash commands
|
|
```bash
|
|
sudo bash
|
|
echo "" >> /usr/bin/start_or_update_server.sh
|
|
echo "sudo mkdir -p \${datadir}/redis" >> /usr/bin/start_or_update_server.sh
|
|
echo "sudo docker stop trains-redis || true && sudo docker rm -v trains-redis || true" >> /usr/bin/start_or_update_server.sh
|
|
echo "echo never | sudo tee -a /sys/kernel/mm/transparent_hugepage/enabled" >> /usr/bin/start_or_update_server.sh
|
|
echo "sudo sysctl vm.overcommit_memory=1" >> /usr/bin/start_or_update_server.sh
|
|
echo "sudo docker run -d --restart=always --name=trains-redis -v \${datadir}/redis:/data --network=host redis:5 redis-server" >> /usr/bin/start_or_update_server.sh
|
|
```
|
|
3. Reboot the EC2 machine
|
|
|
|
|
|
## Released versions
|
|
|
|
The following sections contain lists of AMI Image IDs, per region, for each released **trains-server** version.
|
|
|
|
### Latest version AMI - v0.15.1 (auto update)<a name="autoupdate"></a>
|
|
|
|
For easier upgrades, the following AMIs automatically update to the latest release every reboot:
|
|
|
|
* **eu-north-1** : ami-0f63429f8e5d57315
|
|
* **ap-south-1** : ami-058a2a70b7fb8ec87
|
|
* **eu-west-3** : ami-0fc9f9e8e986f39c4
|
|
* **eu-west-2** : ami-0b0bc1ff2f0239bd9
|
|
* **eu-west-1** : ami-0056ec5d22b0fac91
|
|
* **ap-northeast-2** : ami-0898c9aa7f580fec7
|
|
* **ap-northeast-1** : ami-011036ddcc9398871
|
|
* **sa-east-1** : ami-04feeded12192438c
|
|
* **ca-central-1** : ami-02c717776c9e75025
|
|
* **ap-southeast-1** : ami-05b5866e7029bb9f1
|
|
* **ap-southeast-2** : ami-0384bd2b69467fff8
|
|
* **eu-central-1** : ami-01f15be85297d6f06
|
|
* **us-east-2** : ami-094070ca8aa110180
|
|
* **us-west-1** : ami-0d08ec5bc29eddb29
|
|
* **us-west-2** : ami-04715cceedaf6eae7
|
|
* **us-east-1** : ami-071dbaa1847585c4c
|
|
|
|
### v0.15.1 (static update)
|
|
|
|
* **eu-north-1** : ami-0bb36c4dbe61f8c46
|
|
* **ap-south-1** : ami-0ac93ff85a5c770f9
|
|
* **eu-west-3** : ami-015ebfa846b8de5bb
|
|
* **eu-west-2** : ami-082aacd59408713d9
|
|
* **eu-west-1** : ami-066aad8c6b9b9991b
|
|
* **ap-northeast-2** : ami-0cb47f1c8591c799d
|
|
* **ap-northeast-1** : ami-005131d3037da9d2a
|
|
* **sa-east-1** : ami-0f7fdc4e19c8444a3
|
|
* **ca-central-1** : ami-07c234dad3ece2d78
|
|
* **ap-southeast-1** : ami-0d8e0475d7d4897e4
|
|
* **ap-southeast-2** : ami-053e3f25dee0424b9
|
|
* **eu-central-1** : ami-00d25558c5242708e
|
|
* **us-east-2** : ami-0bd45f800dfbde456
|
|
* **us-west-1** : ami-05e79bf1704721148
|
|
* **us-west-2** : ami-037c328649048409b
|
|
* **us-east-1** : ami-0a3cafe46bf085200
|
|
|
|
### v0.15.0 (static update)
|
|
|
|
* **eu-north-1** : ami-0bef15c03eab64c0c
|
|
* **ap-south-1** : ami-06ac6248e583e2cd2
|
|
* **eu-west-3** : ami-0541d86ef47a5714e
|
|
* **eu-west-2** : ami-01381ef4c4ed22482
|
|
* **eu-west-1** : ami-064626a0dd38b21f1
|
|
* **ap-northeast-2** : ami-0a2490a7a3a8aa675
|
|
* **ap-northeast-1** : ami-063f1de819a2524b8
|
|
* **sa-east-1** : ami-07980486741b94987
|
|
* **ca-central-1** : ami-0ced3b8b21ded839e
|
|
* **ap-southeast-1** : ami-0c493c5093fde8741
|
|
* **ap-southeast-2** : ami-0320a727eccb8dc6c
|
|
* **eu-central-1** : ami-0aa85cfc78674c526
|
|
* **us-east-2** : ami-01791485051e1880c
|
|
* **us-west-1** : ami-0d8eade4d5888ea73
|
|
* **us-west-2** : ami-02ceaef72cdf60f7e
|
|
* **us-east-1** : ami-0fc3f9d1d0eba1d62
|
|
|
|
### v0.14.2 (static update)
|
|
|
|
* **eu-north-1** : ami-006d491e9e8869248
|
|
* **ap-south-1** : ami-0e55ec221687f98e7
|
|
* **eu-west-3** : ami-06ad9cf3c05c83e91
|
|
* **eu-west-2** : ami-0d05839268e748cff
|
|
* **eu-west-1** : ami-0d14c297789ce0d7a
|
|
* **ap-northeast-2** : ami-0d7fd775f0e76cc6f
|
|
* **ap-northeast-1** : ami-0c0a6e1daeb3f7a9c
|
|
* **sa-east-1** : ami-01e0c5e30e94ec887
|
|
* **ca-central-1** : ami-07a31896832734897
|
|
* **ap-southeast-1** : ami-0886d5b2d4b7fccd5
|
|
* **ap-southeast-2** : ami-0397d5a2db3c356fe
|
|
* **eu-central-1** : ami-0629f26eea22f5c17
|
|
* **us-east-2** : ami-0499c3d7bb45a1a6e
|
|
* **us-west-1** : ami-02fa8a961a4daf9f0
|
|
* **us-west-2** : ami-05c711cfab4342468
|
|
* **us-east-1** : ami-0b97d99a08012c726
|
|
|
|
### v0.14.1 (static update)
|
|
|
|
* **eu-north-1** : ami-036defe1885dced2e
|
|
* **ap-south-1** : ami-0b403aa1da6a5dc17
|
|
* **eu-west-3** : ami-0d30c2d330d1255c4
|
|
* **eu-west-2** : ami-06f0e8d075e50a029
|
|
* **eu-west-1** : ami-0da721d874f282b6d
|
|
* **ap-northeast-2** : ami-03bffe94675dd5f8c
|
|
* **ap-northeast-1** : ami-0f96520d646423673
|
|
* **sa-east-1** : ami-0c2f706a3b7d97282
|
|
* **ca-central-1** : ami-0da74525dcfd74e32
|
|
* **ap-southeast-1** : ami-066368a21cf6d232b
|
|
* **ap-southeast-2** : ami-0bfd09170067f7318
|
|
* **eu-central-1** : ami-06aa99b1c41492986
|
|
* **us-east-2** : ami-065c1880f59d03272
|
|
* **us-west-1** : ami-0b7f6b896f5058eba
|
|
* **us-west-2** : ami-0041e10ca68eef29a
|
|
* **us-east-1** : ami-0b7125e4305bbd7eb
|
|
|
|
### v0.14.0 (static update)
|
|
* **eu-north-1** : ami-02de71586ec496e38
|
|
* **ap-south-1** : ami-074b03849b51852e5
|
|
* **eu-west-3** : ami-022c388835e0eeb03
|
|
* **eu-west-2** : ami-0a151c236c6b27707
|
|
* **eu-west-1** : ami-06de69b06b4e73312
|
|
* **ap-northeast-2** : ami-0ee821b72d9f669b1
|
|
* **ap-northeast-1** : ami-03687ae215e64e100
|
|
* **sa-east-1** : ami-01eb83364b7f667af
|
|
* **ca-central-1** : ami-02e9b35f9c90377e6
|
|
* **ap-southeast-1** : ami-0d3ab5ab0048fea51
|
|
* **ap-southeast-2** : ami-0bd39d908fe3a9e06
|
|
* **eu-central-1** : ami-0b8638701311b35c4
|
|
* **us-east-2** : ami-02ff039693fc3a614
|
|
* **us-west-1** : ami-08634f7dfb608a9a7
|
|
* **us-west-2** : ami-034d693ef742b9333
|
|
* **us-east-1** : ami-0b828b05c323dde7f
|
|
|
|
### v0.13.0 (static update)
|
|
* **eu-north-1** : ami-0d9c74a015e7510d8
|
|
* **ap-south-1** : ami-02acd6dd0659bb5c1
|
|
* **eu-west-3** : ami-0f0cc5cb6d9afd194
|
|
* **eu-west-2** : ami-0298fdc0860206ed9
|
|
* **eu-west-1** : ami-0cdc072e528401d5e
|
|
* **ap-northeast-2** : ami-0055579cc95b0e53e
|
|
* **ap-northeast-1** : ami-0ced7becb9b83b5d0
|
|
* **sa-east-1** : ami-033345d0f16a1b5e4
|
|
* **ca-central-1** : ami-06c63b05aed47ae67
|
|
* **ap-southeast-1** : ami-09f0355f367f30602
|
|
* **ap-southeast-2** : ami-0bd2314163ce0fba0
|
|
* **eu-central-1** : ami-05fbae957df63e366
|
|
* **us-east-2** : ami-050c51b5b4074d3fc
|
|
* **us-west-1** : ami-06ad513073d4e5a19
|
|
* **us-west-2** : ami-0c96e1361d1d4ca94
|
|
* **us-east-1** : ami-07b669040d1eea213
|
|
|
|
### v0.12.1 (static update)
|
|
* **eu-north-1** : ami-003118a8103286d84
|
|
* **ap-south-1** : ami-02dfe86baa48e096f
|
|
* **eu-west-3** : ami-0cc1f01267d2a780d
|
|
* **eu-west-2** : ami-0e4c8332e5ce09585
|
|
* **eu-west-1** : ami-03459a2f0b0a3b1ab
|
|
* **ap-northeast-2** : ami-08f6c2aed3a53f24c
|
|
* **ap-northeast-1** : ami-0b798eab95a7c5435
|
|
* **sa-east-1** : ami-0d3ee166c09f0d1b2
|
|
* **ca-central-1** : ami-00a758c56bd63acd5
|
|
* **ap-southeast-1** : ami-0be64d4988cd03fbb
|
|
* **ap-southeast-2** : ami-02087310d43a63f31
|
|
* **eu-central-1** : ami-097bbefeac0c74225
|
|
* **us-east-2** : ami-07eda256712b90f4d
|
|
* **us-west-1** : ami-02ef2b55cbd01c7df
|
|
* **us-west-2** : ami-037c6176ef4735360
|
|
* **us-east-1** : ami-08715c20c0e3f1c15
|
|
|
|
### v0.12.0 (static update)
|
|
|
|
* **eu-north-1** : ami-03ff8ab48cd43e77e
|
|
* **ap-south-1** : ami-079c1a41ff836487c
|
|
* **eu-west-3** : ami-0121ef0398ae87ab0
|
|
* **eu-west-2** : ami-09f0f97654d8c79de
|
|
* **eu-west-1** : ami-0b7ba303f757bfcd9
|
|
* **ap-northeast-2** : ami-053f416517b5f40a6
|
|
* **ap-northeast-1** : ami-056dff06c698c2d9d
|
|
* **sa-east-1** : ami-017ab655119258639
|
|
* **ca-central-1** : ami-03bf5fa1d86ac97f6
|
|
* **ap-southeast-1** : ami-0e667958002b0360c
|
|
* **ap-southeast-2** : ami-091f1b69cb43b1933
|
|
* **eu-central-1** : ami-068ec2f0e98c26541
|
|
* **us-east-2** : ami-0524bbdc1b64ff83f
|
|
* **us-west-1** : ami-0b4facd7534e393c9
|
|
* **us-west-2** : ami-0018d5a7e58966848
|
|
* **us-east-1** : ami-08f24178fc14a84d2
|
|
|
|
### v0.11.0 (static update)
|
|
|
|
* **eu-north-1** : ami-0cbe338f058018c97
|
|
* **ap-south-1** : ami-06d72ff894f7a5e5d
|
|
* **eu-west-3** : ami-00f2a45d67df2d2f3
|
|
* **eu-west-2** : ami-0627ae688f4533237
|
|
* **eu-west-1** : ami-00bf924ccb0354418
|
|
* **ap-northeast-2** : ami-0800edf1d1dec1da8
|
|
* **ap-northeast-1** : ami-07b2ed9709cdc4b15
|
|
* **sa-east-1** : ami-0012c1648618b812c
|
|
* **ca-central-1** : ami-02870b965d002fc8a
|
|
* **ap-southeast-1** : ami-068ec23abf2473192
|
|
* **ap-southeast-2** : ami-06664624728b5e01a
|
|
* **eu-central-1** : ami-05f2a9304f237a6f0
|
|
* **us-east-2** : ami-0ec242e6dca2b72b9
|
|
* **us-west-1** : ami-050b6577acf246ceb
|
|
* **us-west-2** : ami-0e384b6f78bf96ebe
|
|
* **us-east-1** : ami-0a7b46f907d5d9c4a
|
|
|
|
### v0.10.1 (static update)
|
|
|
|
* **eu-north-1** : ami-09937ec4d18350c32
|
|
* **ap-south-1** : ami-089d6ba7541ec4c7f
|
|
* **eu-west-3** : ami-0accb1a94bdd5c5c1
|
|
* **eu-west-2** : ami-0dd2c97bc678b8570
|
|
* **eu-west-1** : ami-07a38865cbe7ca3cb
|
|
* **ap-northeast-2** : ami-09aa0b7fe1cf3dd55
|
|
* **ap-northeast-1** : ami-0905e7d1543e5ed36
|
|
* **sa-east-1** : ami-08c0627daa67d7372
|
|
* **ca-central-1** : ami-034add081712ff648
|
|
* **ap-southeast-1** : ami-0c6caee3689b6e066
|
|
* **ap-southeast-2** : ami-04994afd8dae5b417
|
|
* **eu-central-1** : ami-06b10f8c30e1434f1
|
|
* **us-east-2** : ami-0d3abe7a1fec535cc
|
|
* **us-west-1** : ami-02bb610b70c55018b
|
|
* **us-west-2** : ami-0d1cb8ba7de246ff0
|
|
* **us-east-1** : ami-049ccba6abdb40cba
|
|
|
|
### v0.10.0 (static update)
|
|
|
|
* **eu-north-1** : ami-05ba33c763877e54e
|
|
* **ap-south-1** : ami-0529eec569161cae5
|
|
* **eu-west-3** : ami-03cb9396f63e26ff6
|
|
* **eu-west-2** : ami-0dd28cc97283cc201
|
|
* **eu-west-1** : ami-059cf379ae14b0a24
|
|
* **ap-northeast-2** : ami-031409d71f1280616
|
|
* **ap-northeast-1** : ami-0171437c68b3660aa
|
|
* **sa-east-1** : ami-0eb440a3b6e591c7a
|
|
* **ca-central-1** : ami-097da9ec155ee654a
|
|
* **ap-southeast-1** : ami-0ab7ff3ea09826e39
|
|
* **ap-southeast-2** : ami-00969c550ef2d1f60
|
|
* **eu-central-1** : ami-02246400c51990acb
|
|
* **us-east-2** : ami-0cafc1d730381d6fa
|
|
* **eu-central-1** : ami-02246400c51990acb
|
|
* **us-west-1** : ami-0e82a98ddbe995a65
|
|
* **us-west-2** : ami-04a522ecb2250fb44
|
|
* **us-east-1** : ami-0a66ddbd50959f91e
|
|
|
|
### v0.9.0 (static update)
|
|
|
|
* **us-east-1** : ami-0991ad536ecbacdac
|
|
* **eu-north-1** : ami-07cbcdff501b14afe
|
|
* **ap-south-1** : ami-014cf398b00d4db83
|
|
* **eu-west-3** : ami-0396ba51e9b733581
|
|
* **eu-west-2** : ami-09134f4c7a20bad09
|
|
* **eu-west-1** : ami-00427ed0a1bbfa7b0
|
|
* **ap-northeast-2** : ami-041756675ca1be954
|
|
* **ap-northeast-1** : ami-0c09ebad05c9128ff
|
|
* **sa-east-1** : ami-017a8de4e8d1e8c8e
|
|
* **ca-central-1** : ami-049ec444470f852be
|
|
* **ap-southeast-1** : ami-0c919b8f821a6c635
|
|
* **ap-southeast-2** : ami-04844a0594712d27b
|
|
* **eu-central-1** : ami-0b4e756e0f7c0617d
|
|
* **us-east-2** : ami-03b01914b07428488
|
|
* **us-west-1** : ami-0cf4768e9d47ed076
|
|
* **us-west-2** : ami-0b145f37da31eb9fb
|
|
|