Commit Graph

23 Commits

Author SHA1 Message Date
eugen-ajechiloae-clearml
5be1c8b2b0 Support newer azure storage python version (#548)
Add support for Azure Blob Storage >=12.0.0. Backwards compatibility remains for >=2.0.1,<=2.1
2022-02-12 17:32:43 +02:00
allegroai
5f1345b148 Add skip_zero_size_check to StorageManager.download_folder() 2022-01-31 11:07:15 +02:00
allegroai
fa95d041e2 Add support for not raising error on downloaded files with 0 size 2022-01-18 20:33:26 +02:00
allegroai
b3176a223b Change HTTP driver timeout and retry codes (connection timeout will now trigger a retry) 2022-01-13 11:57:44 +02:00
allegroai
ddffffa51c Control S3/GS _stream_download_pool_connections from clearml.conf "stream_connections", default 128 2021-12-30 12:22:11 +02:00
allegroai
d9aee85821 Fix forked StorageHelper should use its own ThreadExecuter 2021-12-22 13:27:57 +02:00
allegroai
1a0a7b6738 Fix local StorageHelper.delete() raising exception on non existing file instead of returning false 2021-12-22 13:08:32 +02:00
allegroai
69846d200a Add HTTP download timeout control (change default connection timeout to 30sec) 2021-12-22 12:53:37 +02:00
allegroai
6f6c5e9f5e Fix Storage Helper rename partial file throwing errors on multiple access 2021-12-17 11:56:24 +02:00
allegroai
11892a2145 Add support for Google Cloud Storage pool_connections and pool_maxsize overrides 2021-11-30 21:13:48 +02:00
allegroai
73cfbcb947 Fix download progress bar based on sdk.storage.log.report_download_chunk_size_mb configuration 2021-11-29 12:46:40 +02:00
allegroai
8ebf9be604 Add support for deferred configuration 2021-09-09 22:00:40 +03:00
allegroai
6e15349b76 Fix unsafe Google Storage delete object 2021-09-02 15:48:09 +03:00
allegroai
aff39ae061 Fix documentation and prints 2021-08-25 16:46:44 +03:00
allegroai
82009a5935 Fix check permissions fail in HTTPDriver (issue #394) 2021-07-23 16:00:23 +03:00
allegroai
d3929033c0 Fix background upload retries with Google Storage (gs://) 2021-05-19 15:26:43 +03:00
Manoj
bcf344da19 Use default boto credential chain if no keys in the config (#342)
* Use default boto credential chain if no keys in the config

* Add use_credentials_chain config to explicitly enable boto cred chain

* Propagate the new config param in the right way

* PEP8 fixes
2021-05-13 11:34:13 +03:00
allegroai
a2557c253c Disable progress upload callback at the end of http driver upload until we have full upload progress 2021-02-27 23:52:14 +02:00
allegroai
41230ac2c7 Add progress report logging for StorageHelper.upload_from_stream, StorageHelper.upload and StorageHelper.upload_from_stream 2021-02-21 14:55:04 +02:00
allegroai
f1de48a082 Fix Azure support delete_object() returns incorrect value 2021-01-10 12:54:15 +02:00
allegroai
3c00453bd4 Add Task.delete() support 2021-01-10 12:46:02 +02:00
allegroai
d327f2e2b9 clearml initial version 0.17.0 2020-12-22 23:25:37 +02:00
allegroai
a460df1e68 renamed trains -> clearml 2020-12-22 21:17:56 +02:00