ClearML/clearml-docs
1
0
Fork 0
mirror of https://github.com/clearml/clearml-docs synced 2025-02-07 21:24:49 +00:00
Code Issues Actions 1 Packages Projects Releases Wiki Activity
0b167497ad
clearml-docs/docs/release_notes/sdk/open_source/ver_1_0.md
pollfly 8249768619
Refactor Release Notes (#938)
2024-09-26 16:09:25 +03:00

9.6 KiB
Raw Blame History

title
Version 1.0

ClearML 1.0.5

Features

  • Add Click support (ClearML GitHub issue #386)
  • Add progress bar to SHA2 generation (ClearML GitHub issue #396)
  • Add prefix to Task reported runtime info: cpu_cores, gpu_driver_version and gpu_driver_cuda_version
  • Add support for Logger.report_text() explicit log-level reporting
  • Add return_full_path argument to StorageManager.list()
  • Support Task.get_tasks() passing multiple project names
  • Add TaskScheduler
  • Add task_filter argument to Objective.get_top_tasks(), allow name as a task_filter field
  • Add --output-uri command-line option to clearml-task
  • Add requirements_file argument to Task.force_requirements_env_freeze() to allow specifying a local requirements file
  • Add support for list type argument in Task.connect_configuration() (previously only dict type was supported)
  • Rename TrainsTuner to ClearmlTuner
  • Update documentation links

Bug Fixes

  • Fix Pandas with multi-index (ClearML GitHub issue #399)
  • Fix check permissions fail in HTTPDriver (ClearML GitHub issue #394)
  • Fix Dataset not setting system tag on existing data_processing Tasks
  • Fix disable redundant resource monitoring in pipeline controller
  • Fix ClearMLJob when both project and target_project are specified
  • Fix ClearMLJob docker container info is not cached
  • Fix no print logging after Python logging handlers are cleared
  • Fix PipelineController callback returning False
  • Fix internal logging.Logger can't be pickled (only applicable to Python 3.6 or lower)
  • Wait for reported events to flush to ensure Task.flush() with wait_for_uploads=True awaits background processes

ClearML 1.0.4

Features

Bug Fixes

  • Fix default_output_uri for Dataset creation (ClearML GitHub issue 371)
  • Fix clearml-task failing without a docker script (ClearML GitHub issue 378)
  • Fix PyTorch DDP sub-process spawn multi-process
  • Fix Task.execute_remotely() on created Task (not initialized Task)
  • Fix auto scaler custom bash script should be called last before starting agent
  • Fix auto scaler spins too many instances at once then kills the idle ones (spin time is longer than poll time)
  • Fix multi-process spawn context using ProcessFork kills sub-process before parent process ends

ClearML 1.0.3

Features

  • Use default boto credential chain if no keys are provided in the configuration file or environment variables (ClearML GitHub PR 342)
  • Support DummyModel configuration (Slack Channel)
  • Add report_matplotlib_figure(..., report_interactive=False) allowing to upload a matplotlib as a non-interactive (high quality png) plot
  • Add Logger.matplotlib_force_report_non_interactive()
  • Remove matplotlib axis range (plotly.js auto-range can adjust it in real-time)
  • Add object-storage support in cleanup-service
  • Add dataset_tags argument to Dataset.create()
  • Expose docker_args and docker_bash_setup_script in clearml-task CLI
  • Add logging for Nvidia driver and Cuda version
  • Add optional ignored packages in script requirements (currently used for pywin32)
  • Update examples
    • Increase channel result to support max of 1K channels for finding slack channel and use cursor in Slack Alerts monitoring service
    • Add csv data sample to data_samples
    • Remove deprecated examples

Bug Fixes

  • Fix Hydra should not store the full resolved OmegaConf (ClearML GitHub issue 327)
  • Fix direct import of keras save/load model functions (ClearML GitHub issue 355)
  • Fix run as module (ClearML GitHub issue 359)
  • Fix Python 2.7 support (ClearML GitHub issue 366)
  • Fix Task.add_requirements() passing package_version starting with @, ; or #
  • Fix import keras from TF
  • Fix support for Hydra's run_job() change in parameter order by passing config and task_function as keyword arguments
  • Fix background upload retries with Google Storage (gs://)
  • Fix Python 3.8 race condition in Task.close()
  • Fix shutting down a Task immediately after creation might block
  • Fix Task.execute_remotely() from Jupyter notebook
  • Fix Jupyter Notebook inside VSCode
  • Fix support for Dataset.create() argument use_current_task
  • Fix Dataset.finalize() can hang in extreme scenario
  • Protect against wrong file object type when auto-binding models
  • Fix matplotlib date convertor
  • Fix automation controller overrides nodes clone

ClearML 1.0.2

Bug Fixes

  • Fix in rare scenarios process stuck on exit, again :)

ClearML 1.0.1

Bug Fixes

  • Fix in rare scenarios process stuck on exit

ClearML 1.0.0

:::info Breaking Changes Arguments order changed in Logger.report_line_plot(), Logger.report_plotly() and Logger.report_matplotlib_figure() - please use keywords instead of positional arguments :::

Features

  • Add OS environment variable CLEARML_DEFAULT_OUTPUT_URI to override default output_uri for automatic models upload (ClearML GitHub issue 328)
  • Add Task.force_requirements_env_freeze() forcing pip freeze instead of package analysis (ClearML GitHub issue 304)
  • Improve pipeline support
    • Add Task parameters override in ClearmlJob (ClearML GitHub issue 214)
    • Add PipelineController node skip visualization and pre/post-execution callback
  • Allow enabling/disabling tensorboard auto-connect using Task.init(auto_connect_frameworks={'tensorboard': True/False}) (default: True)
  • Allow to continue running from previous execution iteration
  • Support stopping instead of resetting in Task.execute_remotely() when server supports enqueueing stopped tasks
  • Add Model query interface using Model.query_models()
  • Support storing dict with "." in the keys using Task.connect_configuration
  • Add force argument to Task.mark_failed() to allow setting Task status to failed regardless of Task state
  • Add docker_args and docker_bash_setup_script arguments to Task.create()
  • Change Logger plot iteration argument default to 0 (or None)
  • Add task filtering in Task.get_task() using the allow_archived and task_filter arguments
  • Add Task.get_configuration_objects() for retrieving configuration object as a blob of text in automation use-cases (instead of using Task.connect_configuration())
  • Improved pipeline support
    • Add pipeline step caching
    • Add Pipeline controller caching
    • Improve pipeline plot reporting
    • Add PipelineController into main namespace (use from clearml import PipelineController)
  • Add jupyter notebook preview update time stamp
  • Change default metric report flushing to every 5 seconds
  • Improve Task.artifacts for safer Task multi node use cases
  • Support ClearML server API v2.13
  • Add Python 3.9 to the support table
  • Improve documentation and examples
    • Improve documentation for clearml-data, clearml-task
    • Add multiple_tasks_single_process example script for multiple Tasks created in same code
    • Add using_artifacts_example and execute_remotely_example example scripts
    • Update requirements.txt for KerasTuner example

Bug Fixes

  • Fix \r and \n in debug samples title/series (ClearML GitHub issue 323)
  • Fix Google API credentials without storage section raises exception on import (ClearML GitHub issue 331)
  • Fix Matplotlib automagic export legend not showing series names (ClearML GitHub issue 337)
  • Fix Task.set_comment/name() passing None should be equivalent to ''
  • Fix Task.set_credentials() uses incorrect config file when both trains.conf and clearml.conf are found
  • Fix Task.set_credetnials() should override settings from config file
  • Fix Keras h5 model storage
  • Fix Task.execute_remotely() with sub process
  • Fix Task requirements should conform to strings
  • Fix reporting after task closing
  • Fix remove deprecation warning with matplotlib 3.1
  • Fix dataset create single root plot
  • Fix Model.task should return task ID
  • Fix code hangs when leaving process
  • Fix flushing on CR timeout (default 10sec)
  • Wait for subprocess when terminating
  • Improve flush behaviour on KeyboardInterrupt exception
  • Wait for subprocesses to flush when terminating
  • Fix Task.set_credentials() with store_conf_file=True