2021-05-13 23:48:51 +00:00
|
|
|
---
|
|
|
|
title: Configuring ClearML for Your ClearML Server
|
|
|
|
---
|
|
|
|
|
|
|
|
:::important
|
|
|
|
This documentation page applies to deploying your own open source ClearML Server. It does not apply to ClearML Hosted Service users.
|
|
|
|
:::
|
|
|
|
|
2022-03-16 11:08:47 +00:00
|
|
|
The ClearML **configuration file** that will be initialized will contain the host URLs of the ClearML Server, and
|
2022-01-16 09:13:53 +00:00
|
|
|
ClearML credentials, allowing the code to integrate with the server. Later, ClearML can be tailored to fit requirements
|
2021-05-13 23:48:51 +00:00
|
|
|
by setting [configuration options](../configs/clearml_conf.md).
|
|
|
|
|
|
|
|
**To configure ClearML for your ClearML Server:**
|
|
|
|
1. If not installed already, install `clearml` (see [install](../getting_started/ds/ds_first_steps.md))
|
2022-01-16 09:13:53 +00:00
|
|
|
1. In a terminal session, run the ClearML setup wizard.
|
2021-05-13 23:48:51 +00:00
|
|
|
```
|
|
|
|
clearml-init
|
|
|
|
```
|
|
|
|
|
2023-02-22 10:29:36 +00:00
|
|
|
<Collapsible type="info" title="Learn about creating multiple ClearML configuration files">
|
2021-05-13 23:48:51 +00:00
|
|
|
|
2022-01-16 09:13:53 +00:00
|
|
|
Additional ClearML configuration files can be created, for example, to use inside Docker containers when executing
|
2021-05-13 23:48:51 +00:00
|
|
|
a Task.
|
|
|
|
|
|
|
|
Use the `--file` option for `clearml-init`.
|
|
|
|
|
|
|
|
clearml-init --file MyOtherClearML.conf
|
|
|
|
|
|
|
|
and then specify it using the ``CLEARML_CONFIG_FILE`` environment variable inside the container:
|
|
|
|
|
|
|
|
CLEARML_CONFIG_FILE = MyOtherClearML.conf
|
|
|
|
|
2022-12-26 09:08:10 +00:00
|
|
|
For more information about running experiments inside Docker containers, see [ClearML Agent Deployment](../clearml_agent.md#deployment)
|
2022-08-15 14:31:02 +00:00
|
|
|
and [ClearML Agent Reference](../clearml_agent/clearml_agent_ref.md).
|
2021-05-13 23:48:51 +00:00
|
|
|
|
2023-02-22 10:29:36 +00:00
|
|
|
</Collapsible>
|
|
|
|
|
2021-05-13 23:48:51 +00:00
|
|
|
If the setup wizard's response indicates that a configuration file already exists, follow the instructions in
|
|
|
|
[here](#add-clearml-to-a-configuration-file). The wizard does not edit or overwrite existing configuration files.
|
|
|
|
|
2022-01-16 09:13:53 +00:00
|
|
|
1. The setup wizard prompts for ClearML credentials.
|
2021-05-13 23:48:51 +00:00
|
|
|
|
|
|
|
|
|
|
|
ClearML SDK setup process
|
|
|
|
|
2022-03-07 09:43:59 +00:00
|
|
|
Please create new clearml credentials through the settings page in your `clearml-server` web app,
|
|
|
|
or create a free account at https://app.clear.ml/settings/webapp-configuration
|
2021-05-13 23:48:51 +00:00
|
|
|
|
2022-03-07 09:43:59 +00:00
|
|
|
In the settings > workspace page, press "Create new credentials", then press "Copy to clipboard".
|
|
|
|
Paste copied configuration here:
|
2021-05-13 23:48:51 +00:00
|
|
|
|
2022-01-16 09:13:53 +00:00
|
|
|
1. Get ClearML credentials. Open the ClearML Web UI in a browser. On the **SETTINGS > WORKSPACE** page, click
|
2021-05-13 23:48:51 +00:00
|
|
|
**Create new credentials** **>** **Copy to clipboard**.
|
|
|
|
|
2022-03-13 13:07:06 +00:00
|
|
|
1. At the command prompt `Paste copied configuration here:`, copy and paste the ClearML credentials.
|
2021-05-13 23:48:51 +00:00
|
|
|
|
|
|
|
The setup wizard confirms the credentials.
|
|
|
|
|
|
|
|
Detected credentials key="********************" secret="*******"
|
|
|
|
|
2022-03-13 13:07:06 +00:00
|
|
|
1. Enter the ClearML Server web server URL, or press **Enter** to accept the default which is detected from the
|
2021-05-13 23:48:51 +00:00
|
|
|
credentials.
|
|
|
|
|
|
|
|
WEB Host configured to: [https://app.<your-domain>]
|
|
|
|
|
2022-03-13 13:07:06 +00:00
|
|
|
1. Enter the ClearML Server API server URL, or press **Enter** to accept the default value which is based on the previous response:
|
2021-05-13 23:48:51 +00:00
|
|
|
|
|
|
|
API Host configured to: [https://api.<your-domain>]
|
|
|
|
|
2022-03-16 11:08:47 +00:00
|
|
|
1. Enter the ClearML Server file server URL, or press **Enter** to accept the default value which is based on the previous response:
|
2021-05-13 23:48:51 +00:00
|
|
|
|
|
|
|
File Store Host configured to: [files.<your-domain>]
|
|
|
|
|
2022-03-16 11:08:47 +00:00
|
|
|
The wizard responds with a configuration and directs to the ClearML Server.
|
2021-05-13 23:48:51 +00:00
|
|
|
|
|
|
|
CLEARML Hosts configuration:
|
|
|
|
Web App: https://app.<your-domain>
|
|
|
|
API: https://api.<your-domain>
|
|
|
|
File Store: https://files.<your-domain>
|
|
|
|
|
|
|
|
Verifying credentials ...
|
|
|
|
Credentials verified!
|
|
|
|
|
|
|
|
New configuration stored in /home/<username>/clearml.conf
|
|
|
|
CLEARML setup completed successfully.
|
|
|
|
|
|
|
|
<br/>
|
|
|
|
The configuration file's location depends upon the operating system:
|
|
|
|
|
|
|
|
* Linux - `~/clearml.conf`
|
|
|
|
* Mac - `$HOME/clearml.conf`
|
|
|
|
* Windows - `\User\<username>\clearml.conf`
|
|
|
|
|
2021-09-02 07:48:37 +00:00
|
|
|
## Add ClearML to a Configuration File
|
2021-05-13 23:48:51 +00:00
|
|
|
|
|
|
|
The setup wizard may indicate that a configuration file already exists. For example, if a **ClearML Agent** was previously
|
|
|
|
configured, then a configuration file was created. The wizard does not edit or overwrite existing configuration files.
|
|
|
|
|
2022-03-16 11:08:47 +00:00
|
|
|
The host URLs for the ClearML Server are required:
|
2021-05-13 23:48:51 +00:00
|
|
|
|
2022-03-16 11:08:47 +00:00
|
|
|
* ClearML Server web server
|
|
|
|
* ClearML Server API server
|
|
|
|
* ClearML Server file server
|
2021-05-13 23:48:51 +00:00
|
|
|
|
2022-09-04 07:17:44 +00:00
|
|
|
These may be localhost, the domain, or a subdomain of the domain.
|
2021-05-13 23:48:51 +00:00
|
|
|
|
|
|
|
**To add ClearML settings to an existing ClearML configuration file:**
|
|
|
|
|
2022-03-13 13:07:06 +00:00
|
|
|
1. Open the ClearML configuration file for editing. Depending upon the operating system, it is:
|
2021-05-13 23:48:51 +00:00
|
|
|
|
|
|
|
* Linux - `~/clearml.conf`
|
|
|
|
* macOS - `$HOME/clearml.conf`
|
|
|
|
* Windows - `\User\<username>\clearml.conf`
|
|
|
|
|
|
|
|
1. In the `sdk.development` section, add the logging of environment variables option (see ``log_os_environments`` in an
|
|
|
|
[example configuration file](https://github.com/allegroai/clearml/blob/master/docs/clearml.conf#L178)).
|
2022-03-21 14:00:29 +00:00
|
|
|
|
|
|
|
```editorconfig
|
2021-05-13 23:48:51 +00:00
|
|
|
# Log specific environment variables. OS environments are enlisted in the "Environment" section
|
|
|
|
# of the Hyper-Parameters.
|
|
|
|
# multiple selected variables are supported including the suffix '*'.
|
|
|
|
# For example: "AWS_*" will log any OS environment variable starting with 'AWS_'.
|
|
|
|
# This value can be overwritten with os environment variable CLEARML_LOG_ENVIRONMENT="[AWS_*, CUDA_VERSION]"
|
|
|
|
# Example: log_os_environments: ["AWS_*", "CUDA_VERSION"]
|
|
|
|
log_os_environments: []
|
2022-03-21 14:00:29 +00:00
|
|
|
```
|
2021-05-13 23:48:51 +00:00
|
|
|
|
2022-03-16 11:08:47 +00:00
|
|
|
1. Save the ClearML configuration file. ClearML is now configured for the ClearML Server.
|