Rewrite experiment comparison section (#922)

This commit is contained in:
pollfly 2024-09-08 13:17:01 +03:00 committed by GitHub
parent 383f766937
commit 906e488f94
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
2 changed files with 14 additions and 10 deletions

Binary file not shown.

After

Width:  |  Height:  |  Size: 155 KiB

View File

@ -269,19 +269,12 @@ The comparison view compares experiment scalar and plot results (for a more in d
When selected, the view presents a comparison of all [selected experiments](#selecting-multiple-experiments). If no When selected, the view presents a comparison of all [selected experiments](#selecting-multiple-experiments). If no
experiments are selected, the first 100 visible experiments in the table are displayed in the comparison. experiments are selected, the first 100 visible experiments in the table are displayed in the comparison.
In the dropdown menu, select to view **Scalars** or **Plots**. **Scalars** shows experiment scalar results as time In the dropdown menu, select to view **Scalars** or **Plots**.
series line graphs. **Plots** shows the last reported iteration sample of each metric/variant combination per compared
experiment.
Line, scatter, and bar graphs are compared by overlaying each metric/variant from all compared experiments' into a **Scalars** shows experiment scalar results as time series line graphs.
single comparative plot.
![Merged comparison plots](../img/webapp_compare_view_1.png) ![Merged comparison plots](../img/webapp_compare_view_1.png)
Other plot types are displayed separately for each experiment.
![Separate comparison plots](../img/webapp_compare_view_2.png)
All single value scalars are plotted into a single clustered bar chart under the "Summary" title, where each cluster All single value scalars are plotted into a single clustered bar chart under the "Summary" title, where each cluster
represents a reported metric, and each bar in the cluster represents an experiment. represents a reported metric, and each bar in the cluster represents an experiment.
@ -290,9 +283,20 @@ represents a reported metric, and each bar in the cluster represents an experime
Click <img src="/docs/latest/icons/ico-settings.svg" alt="Setting Gear" className="icon size-md" /> to customize which Click <img src="/docs/latest/icons/ico-settings.svg" alt="Setting Gear" className="icon size-md" /> to customize which
metrics to view. metrics to view.
In the **Scalars** view, click <img src="/docs/latest/icons/ico-tune.svg" alt="Tune" className="icon size-md" /> to access Click <img src="/docs/latest/icons/ico-tune.svg" alt="Tune" className="icon size-md" /> to access
[scalar plot tools](webapp_exp_track_visual.md#scalar-plot-tools). [scalar plot tools](webapp_exp_track_visual.md#scalar-plot-tools).
**Plots** shows the last reported iteration sample of each metric/variant combination per compared
experiment.
Line, scatter, and bar graphs are compared by overlaying each metric/variant from all compared experiments' into a
single comparative plot.
![Merged comparison plots](../img/webapp_compare_view_4.png)
Other plot types are displayed separately for each experiment.
![Separate comparison plots](../img/webapp_compare_view_2.png)
## Creating an Experiment Leaderboard ## Creating an Experiment Leaderboard