New release: issues fixed and integrated training speed acceleration.

2025-06-26 18:18:11 +00:00 · 2024-10-24 10:52:57 +02:00
parent a2a91d9093
commit 182afc95b2
30 changed files with 296 additions and 57 deletions
--- a/results.md
+++ b/results.md
@@ -1,14 +1,90 @@
 # Evaluations
-We evaluated the impact of the features we added on MipNeRF360, Tanks&Temples and Deep Blending datasets.
+We evaluated the impact of the features we added on MipNeRF360, Tanks&Temples and Deep Blending datasets. [Exposure Compensation](#exposure-compensation) is evaluated separately. Note that [Default rasterizer](#default-rasterizer) refers to the original [3dgs rasterizer](https://github.com/graphdeco-inria/diff-gaussian-rasterization/tree/9c5c2028f6fbee2be239bc4c9421ff894fe4fbe0) and [Accelerated rasterizer](#accelerated-rasterizer) refers to the [taming-3dgs rasterizer](https://github.com/graphdeco-inria/diff-gaussian-rasterization/tree/3dgs_accel).

-## PSNR
-![all results PSNR](assets/all_results_PSNR.png)
-***DR**:depth regularization, **AA**:antialiasing, **EXPCOMP**:exposure compensation.*
+## Default rasterizer

-## SSIM
-![all results SSIM](assets/all_results_SSIM.png)
-***DR**:depth regularization, **AA**:antialiasing, **EXPCOMP**:exposure compensation.*
+### PSNR

-## LPIPS
-![all results LPIPS](assets/all_results_LPIPS.png)
-*lower is better, **DR**:depth regularization, **AA**:antialiasing, **EXPCOMP**:exposure compensation.*
+![all results PSNR](assets/charts/base_PSNR.png)
+
+***DR**:depth regularization, **AA**:antialiasing*
+
+<br>
+
+![nodepth/depth](assets/Depth_comparison.png)
+
+### SSIM
+![all results SSIM](assets/charts/base_SSIM.png)
+
+***DR**:depth regularization, **AA**:antialiasing*
+
+### LPIPS
+![all results LPIPS](assets/charts/base_LPIPS.png)
+
+*lower is better, **DR**:depth regularization, **AA**:antialiasing*
+
+## Accelerated rasterizer
+
+### Default optimizer
+
+These numbers were obtained using the accelerated rasterizer and `--optimizer_type default` when training.
+
+#### PSNR
+![all results PSNR](assets/charts/accel_default_PSNR.png)
+
+***DR**:depth regularization, **AA**:antialiasing*
+
+#### SSIM
+![all results SSIM](assets/charts/accel_default_SSIM.png)
+
+***DR**:depth regularization, **AA**:antialiasing*
+
+#### LPIPS
+![all results LPIPS](assets/charts/accel_default_LPIPS.png)
+
+*lower is better, **DR**:depth regularization, **AA**:antialiasing*
+
+### Sparse Adam optimizer
+
+These numbers were obtained using the accelerated rasterizer and `--optimizer_type sparse_adam` when training.
+
+#### PSNR
+![all results PSNR](assets/charts/accel_sparse_adam_PSNR.png)
+
+***DR**:depth regularization, **AA**:antialiasing*
+
+#### SSIM
+![all results SSIM](assets/charts/accel_sparse_adam_SSIM.png)
+
+***DR**:depth regularization, **AA**:antialiasing*
+
+#### LPIPS
+![all results LPIPS](assets/charts/accel_sparse_adam_LPIPS.png)
+
+*lower is better, **DR**:depth regularization, **AA**:antialiasing*
+
+## Exposure compensation
+
+We account for exposure variations between images by optimizing a 3x4 affine transform for each image. During training, this transform is applied to the colour of the rendered images.
+The exposure compensation is designed to improve the inputs' coherence during training and is not applied during real-time navigation.
+Enabling the `--train_test_exp` option includes the left half of the test images in the training set, using only their right halves for testing, following the same testing methodology as NeRF-W and Mega-NeRF. This allows us to optimize the exposure affine transform for test views. However, since this setting alters the train/test splits, the resulting metrics are not comparable to those from models trained without it. Here we provide results with `--train_test_exp`, with and without exposure compensation.
+
+### PSNR
+
+![exposures_psnr](/assets/charts/exposure_PSNR.png)
+
+### SSIM
+
+![exposures_ssim](/assets/charts/exposure_SSIM.png)
+
+### LPIPS
+
+*Lower is better.*
+![exposures_lpips](/assets/charts/exposure_LPIPS.png)
+
+![noexposure/exposure](assets/Exposure_comparison.png)
+
+## Training times comparisons
+
+We report the training times with all features enabled using the original 3dgs rasterizer *(baseline)* and the accelerated rasterizer with default optimizer then sparse adam.
+![Training-times](assets/charts/timings.png)