From fe9ce852974025110aa87a2f8a6f60a491fc5bd1 Mon Sep 17 00:00:00 2001 From: pollfly <75068813+pollfly@users.noreply.github.com> Date: Thu, 29 Aug 2024 19:26:25 +0300 Subject: [PATCH] Add ClearML Agent 1.9.0 release notes (#915) --- docs/release_notes/ver_1_9.md | 37 +++++++++++++++++++++++++++++++++++ 1 file changed, 37 insertions(+) diff --git a/docs/release_notes/ver_1_9.md b/docs/release_notes/ver_1_9.md index 005ff535..d10c6880 100644 --- a/docs/release_notes/ver_1_9.md +++ b/docs/release_notes/ver_1_9.md @@ -2,6 +2,43 @@ title: Version 1.9 --- +### ClearML Agent 1.9.0 + +**New Features and Improvements** +* Add `NO_DOCKER` flag to `clearml-agent-services` entrypoint ([ClearML Agent GitHub PR #206](https://github.com/allegroai/clearml-agent/pull/206)) +* Use `venv` module if `virtualenv` is not supported +* Find the correct python version when using a pre-installed python environment +* Add `/bin/bash` support in the task's `script.binary` property +* Add support for `.ipynb` script entry files (install nbconvert in runtime, convert file to python and execute the +python script). Includes `CLEARML_AGENT_FORCE_TASK_INIT` patching of `.ipynb` files (post-python conversion) +* Add `CLEARML_MULTI_NODE_SINGLE_TASK` (values -1, 0, 1, 2) for easier multi-node single Task workloads +* Add default docker `agent.default_docker.match_rules` configuration option (note: `matching_rules` are ignored if `--docker container` is passed in command line) +* Add `-m module args` in script entry now supports standalone script. Standalone script is placed in a file specified +by the `working_dir` setting in the `:` format (e.g. `:standalone.py`), or in `untitled.py` if not specified +* Add `K8S_GLUE_POD_USE_IMAGE_ENTRYPOINT` env var to allow running k8s pods without overriding the image entrypoint +(useful for agents using prebuilt images in k8s) +* Add venv cache mount override for non-root containers (use: `agent.docker_internal_mounts.venvs_cache`) +* Add `/bin/bash -c "command"` support. Task binary should be set to `/bin/bash` and `entry_point` should be set to `-c command` +* Add support for tasks containing only bash script or python module command +* Add support for skipping container apt installs using `CLEARML_AGENT_SKIP_CONTAINER_APT` env var in k8s + +**Bug Fixes** +* Fix git fetch did not update new tags ([ClearML Agent GitHub issue #209](https://github.com/allegroai/clearml-agent/issues/209)) +* Fix file mode should be optional in configuration `files` section +* Fix `-m module $env` to support parsing `$env` before launching +* Fix setting tasks that were just marked as `aborted` to `started` - only force task to `started` after dequeueing it, +otherwise do nothing +* Fix slurm multi-node rank detection +* Fix passing only `--docker` (i.e. no default container image) when using `--dynamic-gpus` feature +* Fix logger object used even if `None` +* Fix a race condition where in rare conditions popping a task from a queue that was aborted did not set it to `started` +before the watchdog killed it (not applicable in k8s/slurm) +* Fix multi-node support to only send `pip freeze` update, only set task as `started`, and only update task status on exit for RANK 0 +* Fix do not cache venv cache if venv/python skip env var was set +* Fix use same state transition in k8s if supported by the server (instead of stopping the task before re-enqueue) +* Fix failed Task in services mode logged as `User aborted` instead of `failed`. Add Task state reason string +* Fix remove task from pending queue and set to `failed` in k8s when applying the pod template fails + ### ClearML SDK 1.9.3 **Bug Fixes**