mirror of
https://github.com/clearml/clearml-docs
synced 2025-06-26 18:17:44 +00:00
9.5 KiB
9.5 KiB
| title |
|---|
| Version 1.0 |
ClearML 1.0.5
Features
- Add Click support (ClearML GitHub issue #386)
- Add progress bar to SHA2 generation (ClearML GitHub issue #396)
- Add prefix to Task reported runtime info:
cpu_cores,gpu_driver_versionandgpu_driver_cuda_version - Add support for
Logger.report_text()explicit log-level reporting - Add
return_full_pathargument toStorageManager.list() - Support
Task.get_tasks()passing multiple project names - Add
TaskScheduler - Add
task_filterargument toObjective.get_top_tasks(), allownameas atask_filterfield - Add
--output-uricommand-line option toclearml-task - Add
requirements_fileargument toTask.force_requirements_env_freeze()to allow specifying a local requirements file - Add support for
listtype argument inTask.connect_configuration()(previously onlydicttype was supported) - Rename
TrainsTunertoClearmlTuner - Update documentation links
Bug Fixes
- Fix Pandas with multi-index (ClearML GitHub issue #399)
- Fix check permissions fail in
HTTPDriver(ClearML GitHub issue #394) - Fix Dataset not setting system tag on existing
data_processingTasks - Fix disable redundant resource monitoring in pipeline controller
- Fix
ClearMLJobwhen bothprojectandtarget_projectare specified - Fix
ClearMLJobdocker container info is not cached - Fix no print logging after Python logging handlers are cleared
- Fix
PipelineControllercallback returningFalse - Fix internal
logging.Loggercan't be pickled (only applicable to Python 3.6 or lower) - Wait for reported events to flush to ensure
Task.flush()withwait_for_uploads=Trueawaits background processes
ClearML 1.0.4
Features
- Add Google Colab notebook tutorial (ClearML GitHub PR 368 and ClearML GitHub PR 374)
- Add support for GIF images in Tensorboard (ClearML GitHub issue 372)
- Add a tensorboardX example for
add_video(creates GIFs in tensorboard) (ClearML GitHub PR 372) - Add auto scaler customizable boot bash script
- Add
Task.ignore_requirements - Deprecate
Logger.tensorboard_single_series_per_graph()as it is now controlled from the UI 🙂
Bug Fixes
- Fix
default_output_urifor Dataset creation (ClearML GitHub issue 371) - Fix
clearml-taskfailing without a docker script (ClearML GitHub issue 378) - Fix PyTorch DDP sub-process spawn multi-process
- Fix
Task.execute_remotely()on created Task (not initialized Task) - Fix auto scaler custom bash script should be called last before starting agent
- Fix auto scaler spins too many instances at once then kills the idle ones (spin time is longer than poll time)
- Fix multi-process spawn context using
ProcessForkkills sub-process before parent process ends
ClearML 1.0.3
Features
- Use default
botocredential chain if no keys are provided in the configuration file or environment variables (ClearML GitHub PR 342) - Support
DummyModelconfiguration (Slack Channel) - Add
report_matplotlib_figure(..., report_interactive=False)allowing to upload a matplotlib as a non-interactive (high quality png) plot - Add
Logger.matplotlib_force_report_non_interactive() - Remove matplotlib axis range (
plotly.jsauto-range can adjust it in real-time) - Add object-storage support in cleanup-service
- Add
dataset_tagsargument toDataset.create() - Expose
docker_argsanddocker_bash_setup_scriptinclearml-taskCLI - Add logging for Nvidia driver and Cuda version
- Add optional ignored packages in script requirements (currently used for
pywin32) - Update examples
- Increase channel result to support max of 1K channels for finding slack channel and use cursor in Slack Alerts monitoring service
- Add
csvdata sample todata_samples - Remove deprecated examples
Bug Fixes
- Fix Hydra should not store the full resolved OmegaConf (ClearML GitHub issue 327)
- Fix direct import of keras save/load model functions (ClearML GitHub issue 355)
- Fix run as module (ClearML GitHub issue 359)
- Fix Python 2.7 support (ClearML GitHub issue 366)
- Fix
Task.add_requirements()passingpackage_versionstarting with@,;or# - Fix import keras from TF
- Fix support for Hydra's
run_job()change in parameter order by passingconfigandtask_functionas keyword arguments - Fix background upload retries with Google Storage (
gs://) - Fix Python 3.8 race condition in
Task.close() - Fix shutting down a Task immediately after creation might block
- Fix
Task.execute_remotely()from Jupyter notebook - Fix Jupyter Notebook inside VSCode
- Fix support for
Dataset.create()argumentuse_current_task - Fix
Dataset.finalize()can hang in extreme scenario - Protect against wrong file object type when auto-binding models
- Fix matplotlib date convertor
- Fix automation controller overrides nodes clone
ClearML 1.0.2
Bug Fix
- Fix in rare scenarios process stuck on exit, again :)
ClearML 1.0.1
Bug Fix
- Fix in rare scenarios process stuck on exit
ClearML 1.0.0
:::info Breaking Changes
Arguments order changed in Logger.report_line_plot(), Logger.report_plotly() and Logger.report_matplotlib_figure() - please use keywords instead of positional arguments
:::
Features
- Add OS environment variable
CLEARML_DEFAULT_OUTPUT_URIto override defaultoutput_urifor automatic models upload (ClearML GitHub issue 328) - Add
Task.force_requirements_env_freeze()forcingpip freezeinstead of package analysis (ClearML GitHub issue 304) - Improve pipeline support
- Add Task parameters override in
ClearmlJob(ClearML GitHub issue 214) - Add PipelineController node skip visualization and pre/post-execution callback
- Add Task parameters override in
- Allow enabling/disabling tensorboard auto-connect using
Task.init(auto_connect_frameworks={'tensorboard': True/False})(default:True) - Allow to continue running from previous execution iteration
- Support stopping instead of resetting in
Task.execute_remotely()when server supports enqueueing stopped tasks - Add Model query interface using
Model.query_models() - Support storing dict with
"."in the keys using Task.connect_configuration - Add
forceargument toTask.mark_failed()to allow setting Task status tofailedregardless of Task state - Add
docker_argsanddocker_bash_setup_scriptarguments toTask.create() - Change Logger plot iteration argument default to 0 (or
None) - Add task filtering in
Task.get_task()using theallow_archivedandtask_filterarguments - Add
Task.get_configuration_objects()for retrieving configuration object as a blob of text in automation use-cases (instead of usingTask.connect_configuration()) - Improved pipeline support
- Add pipeline step caching
- Add Pipeline controller caching
- Improve pipeline plot reporting
- Add
PipelineControllerinto main namespace (usefrom clearml import PipelineController)
- Add jupyter notebook preview update time stamp
- Change default metric report flushing to every 5 seconds
- Improve
Task.artifactsfor safer Task multi node use cases - Support ClearML server API v2.13
- Add Python 3.9 to the support table
- Improve documentation and examples
- Improve documentation for clearml-data, clearml-task
- Add
multiple_tasks_single_processexample script for multiple Tasks created in same code - Add
using_artifacts_exampleandexecute_remotely_exampleexample scripts - Update
requirements.txtforKerasTunerexample
Bug Fixes
- Fix
\rand\nin debug samples title/series (ClearML GitHub issue 323) - Fix Google API credentials without storage section raises exception on import (ClearML GitHub issue 331)
- Fix Matplotlib automagic export legend not showing series names (ClearML GitHub issue 337)
- Fix
Task.set_comment/name()passingNoneshould be equivalent to'' - Fix
Task.set_credentials()uses incorrect config file when bothtrains.confandclearml.confare found - Fix
Task.set_credetnials()should override settings from config file - Fix Keras h5 model storage
- Fix
Task.execute_remotely()with sub process - Fix Task requirements should conform to strings
- Fix reporting after task closing
- Fix remove deprecation warning with matplotlib 3.1
- Fix dataset create single root plot
- Fix
Model.taskshould return task ID - Fix code hangs when leaving process
- Fix flushing on CR timeout (default 10sec)
- Wait for subprocess when terminating
- Improve flush behaviour on
KeyboardInterruptexception - Wait for subprocesses to flush when terminating
- Fix
Task.set_credentials()withstore_conf_file=True