Edit hyperparameter optimization example (#680)
@ -21,8 +21,8 @@ The optimizer Task, `Hyperparameter Optimization`, and the experiments appear in
|
|||||||
|
|
||||||
### Hyperparameters
|
### Hyperparameters
|
||||||
|
|
||||||
The `HyperParameterOptimizer`'s configuration, which is provided when the object instantiated, are stored under the
|
The `HyperParameterOptimizer`'s configuration, which is provided when the object instantiated, are displayed in the
|
||||||
optimizer task's **CONFIGURATION** **>** **HYPERPARAMETERS**.
|
optimizer task's **CONFIGURATION > HYPERPARAMETERS > General** section.
|
||||||
|
|
||||||
```python
|
```python
|
||||||
optimizer = HyperParameterOptimizer(
|
optimizer = HyperParameterOptimizer(
|
||||||
@ -83,48 +83,11 @@ provides a summary of the optimization results in tabular and parallel coordinat
|
|||||||
|
|
||||||

|

|
||||||
|
|
||||||
|
|
||||||
## Experiments Comparison
|
|
||||||
|
|
||||||
## Experiments Comparison
|
## Experiments Comparison
|
||||||
|
|
||||||
ClearML automatically logs each job, meaning each experiment that executes with a set of hyperparameters, separately. Each appears as an individual experiment in the ClearML Web UI, where the Task name is `image_classification_CIFAR10` and the hyperparameters appended.
|
ClearML automatically logs each job, meaning each experiment that executes with a set of hyperparameters, separately. Each appears as an individual experiment in the ClearML Web UI, where the Task name is `image_classification_CIFAR10` and the hyperparameters appended.
|
||||||
For example: `image_classification_CIFAR10: base_lr=0.0075 batch_size=12 dropout=0.05 number_of_epochs=6`
|
For example: `image_classification_CIFAR10: base_lr=0.0075 batch_size=12 dropout=0.05 number_of_epochs=6`.
|
||||||
|
|
||||||
Use the ClearML Web UI [experiment comparison](../../../../../webapp/webapp_exp_comparing.md) to visualize the following:
|
Compare the experiments' configuration, results, plots, debug samples, and more, using the WebApp [comparison features](../../../../../webapp/webapp_exp_comparing.md).
|
||||||
|
|
||||||
* Side by side hyperparameter value comparison
|

|
||||||
* Metric comparison by hyperparameter
|
|
||||||
* Scalars by specific values and series
|
|
||||||
* Plots
|
|
||||||
* Debug images
|
|
||||||
|
|
||||||
### Side by Side Hyperparameter Value Comparison
|
|
||||||
|
|
||||||
In the experiment comparison window, **HYPERPARAMETERS** tab, select **Values** in the list (the right of **+ Add Experiment**), and hyperparameter differences appear with a different background color.
|
|
||||||
|
|
||||||

|
|
||||||
|
|
||||||
### Metric Comparison by Hyperparameter
|
|
||||||
|
|
||||||
Select **Parallel Coordinates** in the list, click a **Performance Metric**, and then select the checkboxes of the hyperparameters.
|
|
||||||
|
|
||||||

|
|
||||||
|
|
||||||
### Scalar Values Comparison
|
|
||||||
|
|
||||||
In the **SCALARS** tab, select **Last Values**, **Min Values**, or **Max Values**. Value differences appear with a different background color.
|
|
||||||
|
|
||||||

|
|
||||||
|
|
||||||
### Scalar Series Comparison
|
|
||||||
|
|
||||||
Select **Graph** and the scalar series for the jobs appears, where each scalar plot shows the series for all jobs.
|
|
||||||
|
|
||||||

|
|
||||||
|
|
||||||
### Debug Samples Comparison
|
|
||||||
|
|
||||||
In the **DEBUG SAMPLES** tab, debug images appear.
|
|
||||||
|
|
||||||

|
|
||||||
|
Before Width: | Height: | Size: 89 KiB After Width: | Height: | Size: 86 KiB |
Before Width: | Height: | Size: 122 KiB After Width: | Height: | Size: 116 KiB |
Before Width: | Height: | Size: 86 KiB After Width: | Height: | Size: 88 KiB |
Before Width: | Height: | Size: 264 KiB After Width: | Height: | Size: 268 KiB |
Before Width: | Height: | Size: 78 KiB After Width: | Height: | Size: 86 KiB |
Before Width: | Height: | Size: 60 KiB After Width: | Height: | Size: 59 KiB |
Before Width: | Height: | Size: 92 KiB |
Before Width: | Height: | Size: 104 KiB |
Before Width: | Height: | Size: 182 KiB |
Before Width: | Height: | Size: 149 KiB After Width: | Height: | Size: 142 KiB |
Before Width: | Height: | Size: 115 KiB |