eugen-ajechiloae-clearml
5be1c8b2b0
Support newer azure storage python version ( #548 )
...
Add support for Azure Blob Storage >=12.0.0. Backwards compatibility remains for >=2.0.1,<=2.1
2022-02-12 17:32:43 +02:00
allegroai
5f1345b148
Add skip_zero_size_check to StorageManager.download_folder()
2022-01-31 11:07:15 +02:00
allegroai
ad735f93e0
Fix StorageManager.download_folder() fails on Windows path
2022-01-18 20:34:45 +02:00
allegroai
fa95d041e2
Add support for not raising error on downloaded files with 0 size
2022-01-18 20:33:26 +02:00
allegroai
977d68169b
Fix cleanup fail silently does not remove all entries
2022-01-15 23:03:58 +02:00
allegroai
b3176a223b
Change HTTP driver timeout and retry codes (connection timeout will now trigger a retry)
2022-01-13 11:57:44 +02:00
allegroai
ddffffa51c
Control S3/GS _stream_download_pool_connections from clearml.conf "stream_connections", default 128
2021-12-30 12:22:11 +02:00
allegroai
d9aee85821
Fix forked StorageHelper should use its own ThreadExecuter
2021-12-22 13:27:57 +02:00
allegroai
1a0a7b6738
Fix local StorageHelper.delete() raising exception on non existing file instead of returning false
2021-12-22 13:08:32 +02:00
allegroai
69846d200a
Add HTTP download timeout control (change default connection timeout to 30sec)
2021-12-22 12:53:37 +02:00
allegroai
6f6c5e9f5e
Fix Storage Helper rename partial file throwing errors on multiple access
2021-12-17 11:56:24 +02:00
allegroai
11892a2145
Add support for Google Cloud Storage pool_connections and pool_maxsize overrides
2021-11-30 21:13:48 +02:00
allegroai
73cfbcb947
Fix download progress bar based on sdk.storage.log.report_download_chunk_size_mb configuration
2021-11-29 12:46:40 +02:00
allegroai
0bc43a31f4
PEP8
2021-10-19 10:39:55 +03:00
allegroai
844c01e15b
Add clearml-Data (Datasets) multi-chunk support
2021-09-25 23:07:49 +03:00
allegroai
8ebf9be604
Add support for deferred configuration
2021-09-09 22:00:40 +03:00
allegroai
6e15349b76
Fix unsafe Google Storage delete object
2021-09-02 15:48:09 +03:00
allegroai
aff39ae061
Fix documentation and prints
2021-08-25 16:46:44 +03:00
allegroai
5295708e18
Add "sdk.storage.log.report_upload_chunk_size_mb" and "sdk.storage.log.report_download_chunk_size_mb", control upload/download log reporting (issue #424 )
2021-08-20 00:34:20 +03:00
allegroai
62946c04f1
Fix wrong path for downloading the content
2021-08-12 13:19:56 +03:00
allegroai
82009a5935
Fix check permissions fail in HTTPDriver (issue #394 )
2021-07-23 16:00:23 +03:00
allegroai
0765d18868
Add return_full_path argument to StorageManager.list()
2021-06-16 18:27:02 +03:00
allegroai
d3929033c0
Fix background upload retries with Google Storage (gs://)
2021-05-19 15:26:43 +03:00
Manoj
bcf344da19
Use default boto credential chain if no keys in the config ( #342 )
...
* Use default boto credential chain if no keys in the config
* Add use_credentials_chain config to explicitly enable boto cred chain
* Propagate the new config param in the right way
* PEP8 fixes
2021-05-13 11:34:13 +03:00
allegroai
a3ace2261c
Fix docstring
2021-05-03 18:33:12 +03:00
allegroai
bd110aed5e
Fix docstrings
2021-05-02 09:47:02 +03:00
allegroai
696034ac75
Add Task.get_configuration_objects() add Task.get_task() filtering support
2021-04-25 10:41:29 +03:00
allegroai
3e61e3b39b
Add hash utility functions
2021-04-15 00:08:16 +03:00
allegroai
60b6da5d8d
Fix typo
2021-04-13 22:54:37 +03:00
allegroai
86148a928b
Support ClearML server API v2.13
2021-04-10 22:32:49 +03:00
allegroai
a2557c253c
Disable progress upload callback at the end of http driver upload until we have full upload progress
2021-02-27 23:52:14 +02:00
allegroai
ae6caf4404
PEP8
2021-02-23 10:38:02 +02:00
allegroai
41230ac2c7
Add progress report logging for StorageHelper.upload_from_stream, StorageHelper.upload and StorageHelper.upload_from_stream
2021-02-21 14:55:04 +02:00
allegroai
0f401545b8
Replace humanfriendly with utility functions
2021-01-24 09:22:56 +02:00
allegroai
8c4d3aca5b
Add StorageManager.upload_folder() and StorageManager.download_folder()
2021-01-18 11:35:23 +02:00
allegroai
f1de48a082
Fix Azure support delete_object() returns incorrect value
2021-01-10 12:54:15 +02:00
allegroai
3c00453bd4
Add Task.delete() support
2021-01-10 12:46:02 +02:00
erezalg
c4158b55b2
fix manager.py ( #275 )
...
Co-authored-by: jkhenning <>
2021-01-04 12:15:36 +02:00
allegroai
486520abfd
Fix extracted archives were extracted to the running folder instead of the cached folder
...
Fix support for direct access links
2020-12-30 16:40:25 +02:00
allegroai
d327f2e2b9
clearml initial version 0.17.0
2020-12-22 23:25:37 +02:00
allegroai
a460df1e68
renamed trains -> clearml
2020-12-22 21:17:56 +02:00
