mirror of
https://github.com/clearml/clearml-docs
synced 2025-02-07 13:21:46 +00:00
3.7 KiB
3.7 KiB
title |
---|
Version 1.9 |
ClearML Agent 1.9.2
New Features and Bug Fixes
- Handle OSError when checking for
is_file
(ClearML GitHub issue #1337) - Add support for pip legacy resolver for versions specified using the
agent.package_manager.pip_legacy_resolver
configuration option - Add skip existing packages
- Fix report index not advancing in resource monitoring causes more than one GPU not to be reported
- Fix use
req_token_expiration_sec
and not the default value when creating a task session - Fix reload method is found in the config object causing periodic agent error printouts
ClearML Agent 1.9.1
New Features and Improvements
- Add default pip version support for Python 3.12
ClearML Agent 1.9.0
New Features and Improvements
- Add
NO_DOCKER
flag toclearml-agent-services
entrypoint (ClearML Agent GitHub PR #206) - Use
venv
module ifvirtualenv
is not supported - Find the correct python version when using a pre-installed python environment
- Add
/bin/bash
support in the task'sscript.binary
property - Add support for
.ipynb
script entry files (install nbconvert in runtime, convert file to python and execute the python script). IncludesCLEARML_AGENT_FORCE_TASK_INIT
patching of.ipynb
files (post-python conversion) - Add
CLEARML_MULTI_NODE_SINGLE_TASK
(values -1, 0, 1, 2) for easier multi-node single Task workloads - Add default docker
agent.default_docker.match_rules
configuration option (note:matching_rules
are ignored if--docker container
is passed in command line) - Add
-m module args
in script entry now supports standalone script. Standalone script is placed in a file specified by theworking_dir
setting in the<dir>:<target_file>
format (e.g.:standalone.py
), or inuntitled.py
if not specified - Add
K8S_GLUE_POD_USE_IMAGE_ENTRYPOINT
env var to allow running k8s pods without overriding the image entrypoint (useful for agents using prebuilt images in k8s) - Add venv cache mount override for non-root containers (use:
agent.docker_internal_mounts.venvs_cache
) - Add
/bin/bash -c "command"
support. Task binary should be set to/bin/bash
andentry_point
should be set to-c command
- Add support for tasks containing only bash script or python module command
- Add support for skipping container apt installs using
CLEARML_AGENT_SKIP_CONTAINER_APT
env var in k8s
Bug Fixes
- Fix git fetch did not update new tags (ClearML Agent GitHub issue #209)
- Fix file mode should be optional in configuration
files
section - Fix
-m module $env
to support parsing$env
before launching - Fix setting tasks that were just marked as
aborted
tostarted
- only force task tostarted
after dequeueing it, otherwise do nothing - Fix slurm multi-node rank detection
- Fix passing only
--docker
(i.e. no default container image) when using--dynamic-gpus
feature - Fix logger object used even if
None
- Fix a race condition where in rare conditions popping a task from a queue that was aborted did not set it to
started
before the watchdog killed it (not applicable in k8s/slurm) - Fix multi-node support to only send
pip freeze
update, only set task asstarted
, and only update task status on exit for RANK 0 - Fix do not cache venv cache if venv/python skip env var was set
- Fix use same state transition in k8s if supported by the server (instead of stopping the task before re-enqueue)
- Fix failed Task in services mode logged as
User aborted
instead offailed
. Add Task state reason string - Fix remove task from pending queue and set to
failed
in k8s when applying the pod template fails