Rewrite experiment comparison section (#922)

This commit is contained in:
pollfly 2024-09-08 13:17:01 +03:00 committed by GitHub
parent 383f766937
commit 906e488f94
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
2 changed files with 14 additions and 10 deletions

Binary file not shown.

After

Width:  |  Height:  |  Size: 155 KiB

View File

@ -269,19 +269,12 @@ The comparison view compares experiment scalar and plot results (for a more in d
When selected, the view presents a comparison of all [selected experiments](#selecting-multiple-experiments). If no
experiments are selected, the first 100 visible experiments in the table are displayed in the comparison.
In the dropdown menu, select to view **Scalars** or **Plots**. **Scalars** shows experiment scalar results as time
series line graphs. **Plots** shows the last reported iteration sample of each metric/variant combination per compared
experiment.
In the dropdown menu, select to view **Scalars** or **Plots**.
Line, scatter, and bar graphs are compared by overlaying each metric/variant from all compared experiments' into a
single comparative plot.
**Scalars** shows experiment scalar results as time series line graphs.
![Merged comparison plots](../img/webapp_compare_view_1.png)
Other plot types are displayed separately for each experiment.
![Separate comparison plots](../img/webapp_compare_view_2.png)
All single value scalars are plotted into a single clustered bar chart under the "Summary" title, where each cluster
represents a reported metric, and each bar in the cluster represents an experiment.
@ -290,9 +283,20 @@ represents a reported metric, and each bar in the cluster represents an experime
Click <img src="/docs/latest/icons/ico-settings.svg" alt="Setting Gear" className="icon size-md" /> to customize which
metrics to view.
In the **Scalars** view, click <img src="/docs/latest/icons/ico-tune.svg" alt="Tune" className="icon size-md" /> to access
Click <img src="/docs/latest/icons/ico-tune.svg" alt="Tune" className="icon size-md" /> to access
[scalar plot tools](webapp_exp_track_visual.md#scalar-plot-tools).
**Plots** shows the last reported iteration sample of each metric/variant combination per compared
experiment.
Line, scatter, and bar graphs are compared by overlaying each metric/variant from all compared experiments' into a
single comparative plot.
![Merged comparison plots](../img/webapp_compare_view_4.png)
Other plot types are displayed separately for each experiment.
![Separate comparison plots](../img/webapp_compare_view_2.png)
## Creating an Experiment Leaderboard