Commit Graph

899 Commits

Author SHA1 Message Date
allegroai
603d74da57 Fix pipeline controller fetching archived Tasks for caching 2022-12-18 22:59:33 +02:00
allegroai
9b9c81afec Fix browser_login() when 3rd party cookies are disabled 2022-12-18 22:58:02 +02:00
allegroai
1dd98ecf8d Fix lazyloaderproxy casting 2022-12-18 22:57:31 +02:00
allegroai
90f30e8d9a Version bump 2022-12-13 16:09:42 +02:00
allegroai
47ea919ddc PEP8 2022-12-13 16:07:51 +02:00
allegroai
dd6e4f1598 Fix StorageManager doesn't support uploading files to minio (#763) 2022-12-13 16:07:44 +02:00
allegroai
694ffc160b Fix Task.connect() sets wrong types if task was never ran locally 2022-12-13 16:02:36 +02:00
allegroai
8076e387ab Add missing changes 2022-12-13 16:00:20 +02:00
allegroai
d3de2151e8 Add IDE to the task's runtime properties
Improve type annotations and docstrings
Flake8
2022-12-13 15:59:42 +02:00
allegroai
3cb66650e8 Fix Dataset.get() should ignore archived datasets by default 2022-12-13 15:49:11 +02:00
allegroai
16c8a037cc Fix can't add S3 external links (#845) 2022-12-13 15:48:18 +02:00
allegroai
62a5ef102a Fix uploading files to S3 when _at_exit() is called fails (work around https://github.com/boto/boto3/issues/3113) 2022-12-13 15:43:18 +02:00
allegroai
09a53bce48 Fix optimization on many agents returns random errors (#829) 2022-12-13 15:37:16 +02:00
allegroai
16df0794be Fix ontinuing Tasks with tensorflow sometimes result in wrong initial iteration (#762) 2022-12-13 15:36:05 +02:00
allegroai
3da182426f Add support for network.file_upload_retries configuration option to control the UploadManager's file upload default retries 2022-12-13 15:35:19 +02:00
allegroai
5b38590756 Fix error message 2022-12-11 15:07:59 +02:00
allegroai
381b856b57 Fix mark_aborted() does not exist, use mark_stopped() instead 2022-12-11 15:07:58 +02:00
allegroai
64e00716e1 Fix Task.query_tasks() returns all tasks when a non-existent project name is provided 2022-12-11 15:07:58 +02:00
Frédéric Jean
7d6897f91b
Fix dataset not synced if the changes are only modified files (#835) 2022-12-06 14:33:43 +02:00
William Reynolds
64e1fb8571
Add r prefix to re.match() strings (#837) 2022-12-06 14:27:50 +02:00
john-zielke-snkeos
e709e46d91
Fix StorageHelper.delete() does not respect path substitutions (#838)
Fixes allegroai/clearml#825
Make StorageHelper.get_object() call StorageHelper._canonized_url() to make path substitutions work.
2022-12-06 14:26:05 +02:00
allegroai
d8926ace25 Version bump to v1.8.3 2022-12-04 12:52:27 +02:00
allegroai
ec70b5113a Fix a sync issue with ConrfigWrapper when loading configuration in session
Optimize load sequence by not loading configuration on session start if not provided (worse case it will be loaded by the ConfigWrapper)
2022-12-04 12:52:27 +02:00
Fred DeSerres-Blanchet
911a72f561
Set GCS credentials to None if invalid service account creds are provided (#841)
Related to https://github.com/allegroai/clearml/issues/840
2022-12-03 12:08:36 +02:00
allegroai
95cf9fff90 Version bump to v1.8.2 2022-12-01 08:54:43 +02:00
allegroai
ceb20f1eec Add CLEARML_VCS_ENTRY_POINT env var controlling experiment's entry point
Fix CLEARML_VCS_WORK_DIR and CLEARML_VCS_DIFF support for standalone mode
2022-11-30 19:54:43 +02:00
allegroai
7016138c84 Fix ClearML SDK does not work with PyTest (related to https://github.com/pytest-dev/pytest/issues/5502#issuecomment-647157873) 2022-11-27 17:32:24 +02:00
allegroai
65d0e15a74 Fix Task.set_parameters() does not add parameter type when parameter exists but does not have a type 2022-11-24 22:45:21 +02:00
allegroai
762bc5325f Version bump to v1.8.1 2022-11-21 17:31:04 +02:00
allegroai
66cccd22fd Fix examples 2022-11-21 17:14:07 +02:00
allegroai
ed2b8ed850 Support num_workers in dataset operations
Support max connections setting for Azure storage using the `sdk.azure.storage.max_connection` setting
2022-11-21 17:12:02 +02:00
allegroai
68467d7288 Fix default clearml logger level cannot be changed (#741) 2022-11-21 17:07:21 +02:00
allegroai
443c6dc814 Fix default method might get updated after default argument was initialized
Fix default api method does not work when set in configuration
2022-11-21 17:06:17 +02:00
allegroai
164169b73a Fix Hydra does use get overridden information from ClearML (#751) 2022-11-21 17:00:19 +02:00
allegroai
a841ab7450 Add ModelInfo.weights_object() for store callback access to the actual model object being stored (valid for both pre/post save calls, otherwise None) 2022-11-21 16:31:58 +02:00
allegroai
1729b9019f Fix CLEARML_DEFERRED_TASK_INIT=1 doesn't work 2022-11-21 16:31:23 +02:00
allegroai
d9497dd603 Fix checking backend api version lower than the supported version is meaningless 2022-11-21 16:30:37 +02:00
allegroai
9713f63cb7 Fix ModelsList.keys() is missing 2022-11-21 16:28:28 +02:00
Lavi
1d77b55dde
Raise error on failed uploads (#820) 2022-11-21 15:31:49 +02:00
allegroai
2aba12cf52 Fix docstring 2022-11-19 00:58:35 +02:00
allegroai
0b0fd55329 Fix StorageManager.list(“s3://..”, with_metadata=True) doesn't work 2022-11-19 00:58:05 +02:00
allegroai
035a76e282 Change report_event_flush_threshold default to 100 2022-11-15 15:59:26 +02:00
allegroai
cf7361e134 Version bump to v1.8.0 2022-11-13 14:47:24 +02:00
allegroai
1633af28e2 Skip hparams with non-basic types 2022-11-13 14:46:38 +02:00
allegroai
f6238b8a0f Fix broken pip package might mess up requirements detection 2022-11-11 23:46:33 +02:00
allegroai
7f6c80f292 Fix task.update_output_model() should always upload local models to a remote server 2022-11-11 23:46:20 +02:00
allegroai
ebe7aa3fb7 Fix Enum hyper-parameter description 2022-11-11 23:45:42 +02:00
allegroai
e55d113258 Add support for connecting Enum values as parameters 2022-11-11 15:49:24 +02:00
allegroai
d0db6ea919 Fix Python 3.5 Unicode support 2022-11-11 15:35:30 +02:00
allegroai
b58c70f65e Fix media preview is created instead of a table preview 2022-11-11 15:34:43 +02:00
allegroai
251cfa30a9 Fix Python 2.7 support 2022-11-11 15:30:25 +02:00
allegroai
0e283dd514 Fix too many parts will cause preview to increase Task object beyond 16MB limit, set a total limit of 320kbs 2022-11-11 13:30:57 +02:00
allegroai
8e9f422ec5 PEP8 2022-11-11 13:30:15 +02:00
allegroai
74614bad6d Fix Dataset.get_local_copy() deletes the source archive if it is stored locally 2022-11-09 11:45:09 +02:00
allegroai
a4d83c30ba Fixed Python 2.7 support, refactor, PEP8 2022-11-09 11:42:06 +02:00
allegroai
039f9f6938 Return stub object from Task.init() if no clearml.conf file is found 2022-11-09 11:40:36 +02:00
allegroai
9164a38708 Fix reported images might not all be reported when waiting to complete the task 2022-11-09 11:39:26 +02:00
allegroai
b793f2dfc6 Limit number of _serialize requests when adding list of links with add_external_files() (#813) 2022-11-09 11:37:52 +02:00
allegroai
8340d4b86c Fix Python 2.7 support 2022-11-09 11:36:17 +02:00
allegroai
e319770831 Fix git remote repository detection when remote is not "origin" 2022-11-09 11:30:05 +02:00
allegroai
dc1c9b5844 Add clearml.browser_login to authenticate browser online sessions such as CoLab, Jupyter Notebooks etc. 2022-11-09 11:29:46 +02:00
allegroai
f0400dd099 Fix if project has a default output uri there is no way to disable it in development mode (manual). Allow passing output_uri=False to disable it. 2022-11-09 11:28:25 +02:00
allegroai
18a4065b2b Add sdk.development.worker.report_event_flush_threshold to control the number of events to trigger a report 2022-11-07 19:17:20 +02:00
allegroai
fa45d32394 Fix cloning pipelines ran with start_locally() doesn't work 2022-11-07 19:09:09 +02:00
Konstantin Frolov
7f92e5b4ee
Add Task.delete_artifacts() with raise_on_errors argument (#806)
* 'raise_on_errors' flag exposed to the parameters of Task._delete_artifacts()

* indentation fixed

* raise exceptions on errors by default on artifact deletions
2022-11-01 12:39:32 +02:00
allegroai
ff73e7848c Refactor inner functions 2022-10-30 19:29:01 +02:00
allegroai
8c776b6da0 Remove import_bind from stack trace of import errors 2022-10-30 19:27:15 +02:00
allegroai
88f0e68eab Remove deprecated demo server. Add initial browser session auto-login. 2022-10-30 19:26:55 +02:00
allegroai
16fb59c33f Improve CoLab integration (store entire colab, not history) 2022-10-30 19:25:15 +02:00
allegroai
89b675c267 Fix clearml-init colab detection 2022-10-30 19:24:43 +02:00
allegroai
9c171d8a5d Fix unique_selector is not applied properly on batches after the first batch. Remove default selector value since it does not work for all event types (and we always specify it anyway) 2022-10-30 19:24:19 +02:00
Doron Serebro
ff7b174bf1
Fix passing compression=ZIP_STORED (or 0) to Dataset.upload() uses ZIP_DEFLATED and overrides the user-supplied argument (#812)
Co-authored-by: dorons <dorons@wisense.tech>
2022-10-27 17:17:13 +03:00
TrellixVulnTeam
d17903d4e9
Adding tarfile member sanitization to extractall() (#803) 2022-10-27 14:56:05 +03:00
allegroai
b598ee5866 Version bump to v1.7.2 2022-10-23 15:22:55 +03:00
allegroai
2766255e8f Fix pipeline clone logic 2022-10-23 15:21:30 +03:00
allegroai
9d096d8ab0 PEP8 2022-10-22 14:16:10 +03:00
allegroai
25df5efe74 Fix Task.upload_artifact() fails uploading pandas DataFrames 2022-10-17 23:34:21 +03:00
tonyd
92fbe062b4
Fix crash when running cloned pipeline that invokes a step twice (#770, related to #769)
Co-authored-by: eajechiloae <97950284+eugen-ajechiloae-clearml@users.noreply.github.com>
2022-10-17 23:30:58 +03:00
allegroai
aad01056b5 version bump 2022-10-14 10:32:49 +03:00
allegroai
6d6b54f5a1 Allow pipeline steps to return string paths without them being treated as a folder artifact and zipped (#780) 2022-10-14 10:32:36 +03:00
allegroai
a64b918c79 Support running jupyter notebook inside a git repo - repository referenced without uncommitted changes and jupyter notebook as code (uncommitted changes)
Add jupyter notebook fail warning
2022-10-14 10:24:37 +03:00
allegroai
76939339c4 Fix support for multiple jupyter servers running on the same machine
Fix issue with old/new notebook packages installed
2022-10-14 10:19:35 +03:00
allegroai
8364cd23d9 Fix docstring 2022-10-14 10:17:41 +03:00
allegroai
54489e23a6 version bump 2022-10-14 10:16:42 +03:00
allegroai
57b7a31097 Fix exception raised when using ThreadPool (#790) 2022-10-14 10:16:11 +03:00
allegroai
d497869a1f Fix retry_on_failure callback does nothing when specified on PipelineController.add_step 2022-10-14 10:14:29 +03:00
allegroai
a0e19d833d Fix docstrings 2022-10-14 10:12:49 +03:00
allegroai
5ece83fe9f version bump 2022-10-14 10:11:23 +03:00
allegroai
dd17fca080 Fix pipeline argument becomes None if default value is not set 2022-10-14 10:10:11 +03:00
allegroai
452d3c5750 Fix local cache with access rules disabling partial local access 2022-10-14 10:10:11 +03:00
allegroai
4945182fa4 Fix Pyplot/Matplotlib binding reports incorrect line labels and colors (#791) 2022-10-03 20:22:24 +03:00
allegroai
1eee271f01 Version bump to v1.7.1 2022-09-29 18:01:39 +03:00
allegroai
d54657c27e Fix Python <3.5 compatibility 2022-09-29 17:54:41 +03:00
allegroai
17a5ca91d8 Fix Task.upload_artifact() does not upload empty lists/tuples 2022-09-29 17:53:38 +03:00
allegroai
a8175ac2e8 Fix Python Fire binding 2022-09-29 17:52:40 +03:00
allegroai
8b22d58a94 version bump 2022-09-26 23:27:47 +03:00
allegroai
564295ecf9 Fix docstring 2022-09-26 23:27:36 +03:00
allegroai
dc3258ab0b Fix pipeline retry mechanism interface 2022-09-26 23:27:13 +03:00
allegroai
77f25b82bd Fix possibility to get a local copy of a dataset that is not finalized 2022-09-26 23:26:29 +03:00
allegroai
3b2a296724 PEP8 2022-09-26 23:25:09 +03:00