ClearML/clearml
1
0
Fork 0
mirror of https://github.com/clearml/clearml synced 2025-06-23 01:55:38 +00:00
Code Issues Actions Packages Projects Releases Wiki Activity
2,399 Commits 4 Branches 180 Tags 56 MiB
d8ca5c73c4
Commit Graph

1259 Commits

Author SHA1 Message Date
allegroai
d26ce48dbe Improve artifacts serialization: should now be consistent when serializing pandas object into gzip stream (csv.gz) 2023-08-04 19:08:51 +03:00
allegroai
197894735b Make sure we work on a copy of task objects 2023-08-04 19:08:09 +03:00
allegroai
696c349488 Improve warning message on task execute_remotely 2023-08-04 19:07:35 +03:00
allegroai
b846772138 Fix pipeline monitor must be called after pipeline is completed (just in case we missed something) 2023-08-04 19:07:05 +03:00
allegroai
99c7eecbee Fix pipeline should always use artifacts hash for checking cache hits 2023-08-04 19:06:15 +03:00
allegroai
46c6d2bf0f Fix proxy object support for lists 2023-08-04 19:05:24 +03:00
Alex Burlacu
92511efbde Allow setting multiprocessing start method 2023-07-31 21:34:13 +03:00
Alex Burlacu
80ef359f45 Bump version and clarify docs 2023-07-31 21:33:28 +03:00
allegroai
e467c05fb4 Fix S3 uploads fail with LazyEvalWrapper type error (#1081) 2023-07-30 13:04:42 +03:00
Michael Pilosov
b1f99abc96
Raise error if dataset name empty (#1083) 
* raise error if dataset name empty.

hidden dataset project when name is an empty string.

if the dataset project happens to match an existing project, it can be quite jarring to have one's history of results suddenly become hidden.

if there's an intent behind this behavior, please let me know and I'd gladly change it to a warning instead.

* move check to top of init, change message

* whitespace
 2023-07-27 14:54:19 +03:00
pollfly
c451589298
Edit docstrings (#1084) 2023-07-25 12:19:24 +03:00
Alex Burlacu
09363b0d30 Fix typo 2023-07-21 14:23:32 +03:00
Alex Burlacu
618a625b74 Bump version to 1.12.0 2023-07-19 17:33:28 +03:00
Alex Burlacu
cc875f0fbe Fix linter issues 2023-07-19 17:28:58 +03:00
Alex Burlacu
028a835676 Deprecate Task.get_by_name 2023-07-19 02:11:40 +03:00
Alex Burlacu
75b4015fdb Fix misconfigured boto3 bucket credentials verify 2023-07-19 02:09:49 +03:00
Alex Burlacu
c8c8a1224e Add support for .get ing pipelines and enqueue-ing them 2023-07-18 15:03:31 +03:00
achaiah
9d57dad652
AWS credential access fix (#1000) 
Fixing AWS credential access that uses a token, instantiation within VPC without AvailabilityZones and ebs volume creation. Note: EBS is attached but never mounted.
 2023-07-16 15:22:10 +03:00
Alex Burlacu
f6ae803110 Add default values in .conf files for s3 multipart 2023-07-14 14:24:10 +03:00
alex-burlacu-clear-ml
bae4886412
Merge pull request #1059 from cgaudreau-ubisoft/s3-configure-multipart 
Added boto3 parameters for multipart configurations
 2023-07-14 14:13:21 +03:00
Alex Burlacu
e7edcbb813 Fix #1054, now retring a pipeline step will continue from the correct tf epoch 2023-07-14 14:04:38 +03:00
pollfly
44faf6ef7b
Improve clearml.conf (#1071) 2023-07-11 10:53:19 +03:00
natephysics
29227cade1
Add include_archived to optionally exclude archived datasets from dataset.list_datasets() (#1069) 
Addresses #1067

* feat(datasets.py): ✨ Added the option `include_archived` to Dataset.list_datasets() class method which, if False, will exclude archived datasets from the list. Defaults to True to maintain the current behavior of the class method.

While it's possible to filter datasets using the get() class method it wasn't possible to do the same for the list_datasets() method. This feature seems useful to include and it's a simple, non-breaking modification.

* style(datasets.py): 🚨 Updated formatting (white spaces/spaces after comma/line breaks) in accordance with the flake8 formatting checks for dataset.py.

As suggesting in the contribution guidelines, fake8 was used to validate the formatting. Several errors were found from prior commits that were fixed.
 2023-07-10 20:59:49 +03:00
allegroai
5aa80267d6 Version bump to v1.11.2rc0 
Small refactoring
 2023-07-10 11:20:27 +03:00
allegroai
3f882c37b9 Fix pipeline steps are not cached when the arguments come from the pipeline controller 2023-07-10 11:18:37 +03:00
allegroai
c394046a2d Fix Task.connect_configuration() removes trailing + sign from configuration key 2023-07-10 11:14:09 +03:00
Alex Burlacu
13f11a68be Improve pipeline caching behaviour 2023-07-08 16:58:41 +03:00
Alex Burlacu
6dc2c8ca8c Fix GCS quoting issue 2023-07-06 12:23:06 +03:00
Make42
5824e27ada
Correct spelling, code formatting, add deprecation warnings to logger methods (#1052) 
* Correct spelling in docstrings and comments in automation controller

* Improve readability by adding line breaks in automation controller

* Add deprecation warnings for logger methods

* Add docstring text regarding deprecation of logger methods

* Format deprecation warnings for logger methods in Black style

* Correct the docstring of query_tasks

* Remove new line in 'pre_execute_callback' docstring

---------

Co-authored-by: Make42 <none@none.net>
 2023-06-29 18:10:09 +03:00
AbdulHamid Merii
9e8ed16b3e Added boto3 parameters for multipart configurations 
- multipart threshold and chunksize
 2023-06-26 12:07:40 -05:00
AbdulHamid Merii
cbd14e3d6a
Fix typo in projects docstring (#1038) 2023-06-25 08:05:53 +03:00
Alex Burlacu
7eb4cb46af Bump version to 1.11.1 2023-06-21 18:33:44 +03:00
allegroai
8524874998 Fix task status comparison breaks when using a string 2023-06-21 08:54:01 +03:00
allegroai
ab3c148de2 Fix message not reloaded before appending text 2023-06-21 08:51:47 +03:00
allegroai
1da47a20f8 Add CLI client name to client header 2023-06-19 11:02:05 +03:00
Alex Burlacu
050d6d8970 Fix infinite recursion when updating connected dict remotely 2023-06-16 13:52:55 +03:00
Alex Burlacu
eede2b6155 Bump version to 1.11.1rc2 2023-06-13 13:57:41 +03:00
Alex Burlacu
4ab46dd92c Patch Gradio root_path argument 2023-06-12 15:13:13 +03:00
allegroai
be65b6055a Fix support for new lightning namespace 2023-06-11 14:12:16 +03:00
Andreas Weinmann
ec51f35ec7
Add support for new lightning namespace (#1033) 2023-06-11 14:05:39 +03:00
Paweł Kotiuk
1ccdff5e77
Support clearml-init hosts detection for WebApp with no port (#1031) 
Support clearml-init hosts detection for WebApp with no port and api/files hosts use the default ports.
 2023-06-06 16:52:40 +03:00
allegroai
a343fc4c26 Bump version to 1.11.1rc1 2023-06-04 10:30:30 +03:00
allegroai
13c44b0b6a Fix lazy evaluated value should be casted to str before passed through to OS calls 2023-06-04 10:30:20 +03:00
Alex Burlacu
9ec28b47b3 Bump version to 1.11.1rc0 2023-06-01 15:13:03 +03:00
Alex Burlacu
f207e72200 Fix jsonargparse not loading new values from changed config files 2023-06-01 15:12:30 +03:00
pollfly
56d4de04e4
Edit docstrings (#1024) 2023-05-30 15:40:43 +03:00
pollfly
db2f899d95
Edit docstrings (#1013) 2023-05-28 08:48:49 +03:00
Alex Burlacu
449a4cc42d Bump version to v1.11.0 2023-05-25 19:00:20 +03:00
Alex Burlacu
0b6cb2edb8 Add Task.get_all_reported_scalars 2023-05-25 19:00:05 +03:00
Alex Burlacu
5772a1551e Add support for offline datasets and JSON previews 2023-05-25 18:15:33 +03:00
Alex Burlacu
60c3a5ef98 Fix downloading artifacts from GCP when the download URI includes unsafe characters 2023-05-25 18:14:17 +03:00
Alex Burlacu
813777a4cc Fix package identification for scikit-image 2023-05-25 17:41:35 +03:00
Alex Burlacu
14351e9f93 Add support for multi-node experiments 2023-05-25 17:34:55 +03:00
Alex Burlacu
0fba023fc4 Add version to clearml-data list command 2023-05-23 14:57:07 +03:00
Phill Zarfos
f99a5d03f6
Fix comment for storage scheme gs:// (#1018) 
Co-authored-by: Phill Zarfos <pzarfos@thepennyhoarder.com>
 2023-05-22 11:14:57 +03:00
allegroai
7c09251686 Fix code hangs when running with joblib (#1009) 2023-05-21 09:42:32 +03:00
allegroai
e80d1f1ff4 Support removing task input models using Task.remove_input_models() 2023-05-21 09:41:00 +03:00
Alex Burlacu
b91f20b7a3 Add a warning asking to import Task from allegroai when calling an enterprise property on a ClearML Task object 2023-05-15 12:11:28 +03:00
allegroai
3b16553ba3 Add Task.get_task_output_log_web_page() class method 2023-05-11 16:05:44 +03:00
allegroai
7ab1168532 Fix multiple local parallel experiments conflict on storage access validation (#897) 2023-05-11 16:05:19 +03:00
allegroai
6edc1b840c Fix Task.query_tasks() fails with a None task_filter 2023-05-11 16:04:09 +03:00
allegroai
059ff050df Fix when using Task.set_parameters() dict parameters are not dumped as JSON, causing the SDK to load them incorrectly 2023-05-11 16:02:50 +03:00
allegroai
5625a4c485 Support multi-node training using Task.launch_multi_node() 2023-05-11 16:00:06 +03:00
allegroai
a0bc87ab5c Support pytorch-lightning CLI >=2.0 2023-05-11 15:59:11 +03:00
allegroai
43f7c549fb Fix PY3.5 compatibility 2023-05-11 15:58:02 +03:00
allegroai
c2b6165987 Add support for development.worker.report_start_sec to allow starting resource monitoring sooner than usual 2023-05-11 15:57:15 +03:00
pollfly
1927e6578c
Edit docstrings (#1011) 2023-05-07 15:50:49 +03:00
pollfly
1c254c3d83
Edit docstrings (#1005) 2023-05-02 15:06:47 +03:00
allegroai
7b131d23e8 Fix pipeline cache is not invalidated when a different docker image is used 2023-05-02 14:58:31 +03:00
pollfly
0ed2cd1f04
Edit docstrings (#1001) 2023-04-30 15:27:50 +03:00
allegroai
67accedd36 Fix urllib3.contrib.appengine removed from urllib 2.0 2023-04-30 15:23:54 +03:00
allegroai
c58f8649a2 Fix race condition in pipeline declaration 2023-04-30 15:22:52 +03:00
allegroai
422807555d Fix Pipeline self._nodes changes during iteration 2023-04-30 09:38:18 +03:00
allegroai
e9ecc9a29b Fix streams are patched by logger when logging to a non-main task 2023-04-25 10:00:00 +03:00
john-zielke-snkeos
a07f396f17
External files: Improve performance (#962) 
* External files: Improve performance
Add option for faster .add_external_files() option
Add option for parallel external file download

* Fix bug in add_external_files

* Remove max_workers_external_files parameter
Integrate PR feedback

* Integrate feedback

* Fix PEP suggestion
 2023-04-24 16:21:08 +03:00
allegroai
71e1608ad8 Fix ProxyDictPostWrite.update() does not trigger write-back to backend (#985) 2023-04-23 10:34:39 +03:00
allegroai
9f9af85a2a Fix TensorBoard negative iterations were zeroed 2023-04-19 15:06:10 +03:00
allegroai
107bb93ab0 Fix Task.init(continue_last_task=0) ignored when running remotely 2023-04-19 15:05:26 +03:00
Make42
af04877a0e
Update reference to GetAllRequest in Task docstrings (#982) 
Co-authored-by: Richard Leibrandt <richard.leibrandt@omikron.net>
 2023-04-17 20:05:51 +03:00
allegroai
1980f1c56b Support Retry.DEFAULT_BACKOFF_MAX in a backwards-compatible way 2023-04-10 22:54:35 +03:00
Alex Burlacu
a794d0d8ab Bump version to 1.10.3 2023-04-06 16:31:35 +03:00
Alex Burlacu
b3809403e3 Fix interfering logs in pipelines 2023-04-06 16:31:21 +03:00
alex-burlacu-clear-ml
a60df1382d
Bump version to 1.10.2 2023-04-03 18:48:16 +03:00
Alex Burlacu
18ccbcf8b0 Adjust VCS_DIFF docstring 2023-04-03 18:37:15 +03:00
Alex Burlacu
d564940cd4 Fix plot reporting for models 2023-04-03 18:36:45 +03:00
Alex Burlacu
4ad4939feb Add tags to pipeline steps and controller 2023-04-03 18:35:11 +03:00
Alex Burlacu
03fdf0807f Restrict Dataset creation for old API versions 2023-04-03 18:33:55 +03:00
Alex Burlacu
202d93ce21 Fix v2.23 API issue 2023-04-03 18:29:44 +03:00
Alex Burlacu
7ca8743d86 Remove redundant docstrings and allow TaskTypes in filter conditions 2023-04-03 18:22:29 +03:00
pollfly
28c54524d8
Edit docstrings (#961) 
Should partially fix issue mentioned in #950
 2023-03-30 17:09:19 +03:00
jday1
4a30e32f73
Modify Tasl.get_reported_scalars() docstring (#964) 
See #963
 2023-03-30 17:05:18 +03:00
Alex Burlacu
09f8d3d848 Bump version to 1.10.1 2023-03-29 19:02:06 +03:00
Alex Burlacu
cc843f6afa Fix docstrings 2023-03-29 19:01:48 +03:00
Alex Burlacu
fc8435e26b Fix backward compatibility when using datetime filtering for GetAllRequest in models.py and tasks.py 2023-03-29 19:01:03 +03:00
Harry
6f1c208726
Add a cast parameter to Task.get_parameter() (#958) 2023-03-28 12:21:43 +03:00
allegroai
2f4f11aadb Refactor pipeline code 2023-03-27 13:43:52 +03:00
allegroai
4a91843559 Add local HPO cli execution (--local --args) 2023-03-27 13:40:58 +03:00
allegroai
fa92c75ffc Add support to python package namespace detection 2023-03-27 13:40:26 +03:00
allegroai
4cd8857c0d Refactor code 2023-03-27 13:38:11 +03:00
allegroai
ecf6a4df2a Fix last commit 2023-03-26 16:59:01 +03:00
Alex Burlacu
5635137972 Bump version to 1.10.0 2023-03-24 13:48:43 +02:00
Alex Burlacu
309b09f8a9 Add support for API v2.23 and attaching plots and scalars to models 2023-03-24 13:41:18 +02:00
jday1
b34063dd3f
Fix missing comma (#959) 2023-03-23 22:21:23 +02:00
Alex Burlacu
43e73c5f0a Allow moving a task from offline to online mode in a specific manner 2023-03-23 18:58:15 +02:00
Alex Burlacu
dc5be02328 Allow registering offline models 2023-03-23 18:32:53 +02:00
Alex Burlacu
a5d25b1a88 Allow for automatic identification of SageMaker notebooks 2023-03-23 18:24:46 +02:00
Alex Burlacu
4bb83c1c6c Allow to force_download model weights 2023-03-23 18:17:19 +02:00
Alex Burlacu
c5b05fcd49 Allow tuning the behavior of pipeline_controller.is_successful 2023-03-23 18:10:23 +02:00
Alex Burlacu
067c817f30 Allow deleting files when deleting datasets stored with clearml-data 2023-03-23 18:03:40 +02:00
Alex Burlacu
fce03ef0a2 Fix messed XGBoost/CatBoost metrics when training multiple models in the same task 2023-03-23 17:58:39 +02:00
Alex Burlacu
c758a02634 Emit an warning on non-string dictionary keys for task.connect 2023-03-23 17:55:27 +02:00
Alex Burlacu
a9d2abae5b Allow custom serialization/deserialization in pipelines 2023-03-23 17:38:09 +02:00
Alex Burlacu
ecd905e518 Add task.get_debug_samples method 2023-03-23 17:21:39 +02:00
Alex Burlacu
d90804f1cc Add pipeline_controller.connect_configuration 2023-03-23 17:15:37 +02:00
Alex Burlacu
3ee6ddf835 Allow to pass Plotly-style data_config to report_table 2023-03-23 17:12:29 +02:00
Alex Burlacu
f9fa303091 Fix Parallel Coordinate plots handling of categorical variables 2023-03-23 16:12:31 +02:00
Alex Burlacu
3817f0ca36 Fix task.connect docstring 2023-03-23 16:09:43 +02:00
Alex Burlacu
438da316e6 Fix StorageManager incorrectly identifying the bucket as additional folder for MinIO 2023-03-23 14:53:11 +02:00
Alex Burlacu
26bdfd66d0 Fix wrong overriding of custom server URLs when running clearml-init 2023-03-23 13:39:43 +02:00
Alex Burlacu
6ff629c4e7 Patch gradio only when imported 2023-03-23 13:24:13 +02:00
Alex Burlacu
2604401dd3 Fix fire binding 2023-03-23 13:20:28 +02:00
Alex Burlacu
90354a7751 Fix task.get_user_properties when called with value_only=True 2023-03-23 13:16:06 +02:00
Alex Burlacu
2e6e0c1a1d Do not allow dataset metadata entries that start with data_ 2023-03-23 13:11:07 +02:00
Alex Burlacu
11aee6c8e9 Add the possibility to not log Uncommitted Changes by explicitly setting CLEARML_VCS_DIFF to an empty string 2023-03-22 15:35:45 +02:00
Alex Burlacu
09a4d85c0c Fix parsing pipeline component arguments with comma slices in python 3.9 2023-03-22 15:15:21 +02:00
Alex Burlacu
6fb98d9e8c Add support for Task.publish_on_completion for API versions older than v2.20 2023-03-22 15:08:12 +02:00
alex-burlacu-clear-ml
79784baf2d
Merge pull request #927 from Make42/master 
Improve the hyper_parameter example
 2023-03-17 14:50:17 +02:00
jday1
ea1e4ac087
Fix git+https requirement using subdirectory is not supported (#947) 
Fixes issue #946
 2023-03-12 14:52:43 +02:00
Alex Burlacu
37dde23bc9 bump version to 1.9.3 2023-03-08 21:45:46 +02:00
Alex Burlacu
4a928addb7 Bugfix: Broken Task._get_status() 
Avoid creating an ephemeral object on every status call (we call them a lot)
 2023-03-08 21:39:40 +02:00
Richard Leibrandt
641a4a2057 Remove docstring text of Task.close() that details Task.mark_completed() 2023-03-08 15:48:30 +01:00
alex-burlacu-clear-ml
fda5095ab2
Merge pull request #935 from john-zielke-snkeos/bugfix-path-substitutions 
Fixes for path substitution
 2023-03-02 16:40:41 +02:00
allegroai
b5775840e5 Reintroduce code due to backwards compatibility fix 2023-02-28 21:57:49 +02:00
allegroai
8957e09ef9 Version bump to v1.9.2 2023-02-28 17:22:24 +02:00
allegroai
22df336860 Fix clearml browser_login set host servers (because clearml-agent does not have default ones) 2023-02-28 17:22:23 +02:00
allegroai
fba1f4c9a6 Fix get_or_create_project() might crash when called in parallel 2023-02-28 17:22:22 +02:00
allegroai
aff7f87975 Fix TaskScheduler initial scheduled Task could be closer to starting date 2023-02-28 17:22:21 +02:00
allegroai
487fe75946 Fix dataset CSV files are not previewed properly 2023-02-28 17:22:21 +02:00
allegroai
72b341ee51 Add Gradio binding support 2023-02-28 17:22:20 +02:00
allegroai
22715cda19 Fix some plots and debug samples are missing for clearml examples 2023-02-28 17:22:20 +02:00
allegroai
5d027a335f Improve Task.query_tasks()` docstring 2023-02-28 17:22:20 +02:00
allegroai
4585db0f0f Fix Task.connect_configuration() with non-string keys 2023-02-28 17:22:19 +02:00
allegroai
890f4cfa77 Improve get_status performance 2023-02-28 17:22:19 +02:00
allegroai
dd5036a0a0 Fix breaking change in call to Logger.report_confusion_matrix() 2023-02-28 17:22:18 +02:00
allegroai
89e39f0b02 Add status change callback to pipelines 2023-02-28 17:22:18 +02:00
allegroai
6b32e1d33a Fix Pipeline from tasks does not propagate params overwrite 2023-02-28 17:22:17 +02:00
vfdev
08ce79002b
Fixed bug in report_confusion_matrix when series argument was removed (#936) 2023-02-26 10:04:39 +02:00
john-zielke-snkeos
df5d317c06 Fix typo 2023-02-24 19:13:13 +01:00
john-zielke-snkeos
8f57c5132c Added fix to store unsubstituted url for model 
Added canonize_url for .delete()
 2023-02-24 18:59:15 +01:00
Yiftach Beer
7701d47b44
Typo fix (to large -> too large) (#932) 2023-02-23 17:39:41 +02:00
Richard Leibrandt
017dc4c784 Improve docstring for Task.close and Task.mark_completed 2023-02-21 16:39:47 +01:00
Richard Leibrandt
aa69f45d3b Improve docstring for Task.close and Task.mark_completed 2023-02-21 15:21:56 +01:00
Make42
4ebe714165
Improve docstring for Task.close() (#920) 2023-02-19 09:25:24 +02:00
jday1
541c2425e0
Fix debug samples are not uploaded correctly (#924) 
* PR relating to bug #923.
---------

Co-authored-by: jday1 <jd685@cam.ac.uk>
Co-authored-by: jday1 <james.day@bglgroup.co.uk>
 2023-02-19 09:19:40 +02:00
Make42
e938f2800b
Improve docstring for Task.mark_completed() (#921) 2023-02-17 23:27:43 +02:00
allegroai
311e05d938 Fix StorageManager.get_file_size_bytes() and StorageManager.get_metadata() might raise an error even with silence_errors=True 2023-02-14 12:25:59 +02:00
RoseGold
7de0644eef
Jupyter API token patch (#904) 2023-02-09 21:13:12 +02:00
Zegang Cheng
269f5e7974
Ignore None keys in click args (#903) 2023-02-07 22:53:57 +02:00
allegroai
b1f17db657 Add pre and post-callbacks to the Pipeline decorator 2023-02-07 17:32:31 +02:00
allegroai
a48f1c4b58 Keep original upload URI when reporting events when URI is changed due to path substitution 2023-02-05 10:19:44 +02:00
pollfly
c978d8c259
Edit docstrings (#900) 2023-02-02 10:24:01 +02:00
Anton Cherepkov
54c601eea2
Add support for references in Pipeline queue_name (#857) 2023-01-26 19:11:47 +02:00
Yiftach Beer
da6f75363d
Fix Logger.report_confusion_matrix (#894) 
* set annotated cells (cells with text inside them) to be the default.
* removed the unused series argument from the signature.
 2023-01-26 19:10:10 +02:00
pollfly
0b9428bf21
Fix docstring spacing (#896) 2023-01-26 19:08:11 +02:00
allegroai
b3e330ea9b Version bump to v1.9.1 2023-01-24 14:24:24 +02:00
allegroai
00464a879b Fix Taks.get_project_id() cannot find hidden projects 2023-01-24 13:16:10 +02:00
pollfly
e0bea7f586
Edit docstrings (#889) 2023-01-24 13:13:19 +02:00
pollfly
3585eff49b
Edit hyperdataset examples (#895) 2023-01-24 12:30:55 +02:00
john-zielke-snkeos
7d80406290
Bugfix for storage with path substitutions (#877) 
* Bugfix: canonize url in StorageHelper.exists_file()

* Added fixes for path substitutions:
StorageManager to use orginal path in metadata
Helper to use path rewrites in list operations

* Fixed a copy-paste error

Co-authored-by: eajechiloae <97950284+eugen-ajechiloae-clearml@users.noreply.github.com>
 2023-01-23 15:51:21 +02:00
allegroai
b4cb44bf1b Fix auth headers are not set on substituted fileserver urls 2023-01-23 14:09:46 +02:00
allegroai
5465f27b8f Fix clearml-task runtime is not set when no queue was provided 2023-01-23 14:09:10 +02:00
allegroai
55b00eb776 Fix connecting a dictionary to task sometimes raises an exception 2023-01-23 14:08:18 +02:00
allegroai
1a62d4b6e1 Fix StorageManager.list() does not return size metadata (#865) 2023-01-23 14:07:02 +02:00
allegroai
2120fc85f5 Refactor CreateFromFunction 2023-01-23 14:04:13 +02:00
allegroai
8cb4ac2acb Allow requesting custom token expiration using the api.auth.req_token_expiration_sec configuration setting 2023-01-19 11:20:08 +02:00
allegroai
88259094ac Add client version to runtime properties 2023-01-19 11:19:02 +02:00
allegroai
1953fcc519 Fix metadata set on an uploaded model object is not accessible (#890) 2023-01-19 11:18:06 +02:00
allegroai
812d22a3c7 Fix clearml-data previews are saved on file server even when output_uri is specified 2023-01-19 11:16:21 +02:00
allegroai
896e949649 Add more runtime properties 2023-01-19 10:42:33 +02:00
allegroai
4f770395fa Fix docstrings 2023-01-19 10:38:13 +02:00
Colin Gaudreau
d0fa72ee1a
Add signature version to boto3 config (#884) 2023-01-18 19:13:03 +02:00
cajewsa
3d5d8ef706
Add extra split identifier (#885) 
Added an extra split identifier to make sure presence of extras does not influence determining whether clearml is included in requirements.
 2023-01-18 19:12:09 +02:00
pollfly
3e8835d91d
Edit docstring (#874) 2023-01-11 10:30:46 +02:00
pollfly
b39829a011
Edit docstrings (#875) 2023-01-10 11:12:47 +02:00
allegroai
0950757d44 PEP8 2022-12-29 13:20:03 +02:00
allegroai
0029f131c9 Fix numpy 1.24 support 2022-12-29 13:19:17 +02:00
allegroai
c75c83c21d Fix casting None to int fails uploads and permission checks 2022-12-29 13:18:39 +02:00
allegroai
a3d44aa81f Fix connect list of dicts parsed incorrectly in remote 2022-12-29 13:17:25 +02:00
allegroai
3371a58bcb Fix IDE info when running in pure python console 2022-12-29 13:12:58 +02:00
david pash
af79ee7839
Fix UniformParameterRange tolist throws error when step size is not defined (#859) 2022-12-27 16:28:19 +02:00
allegroai
4e2e6a4d6b Version bump to v1.9.0 2022-12-23 22:39:55 +02:00
allegroai
690a4b42c4 Add delete_from_storage (default true) to Task.delete_artifacts() 2022-12-23 22:22:16 +02:00
allegroai
79185487a8 Fix types in strings list 2022-12-23 22:21:23 +02:00
allegroai
a621b4fa20 Add pipeline decorator argument to control docker image (#856) 2022-12-22 22:11:43 +02:00
allegroai
341aba2cee Fix None values get casted to empty strings when connecting a dictionary 2022-12-22 22:09:19 +02:00
allegroai
a2b3f1cf3b Add Dataset.set_metadata() and Dataset.get_metadata() 2022-12-22 22:06:38 +02:00
allegroai
bc94a55525 Fix crash when calling task.flush(wait_for_uploads=True) while executing remotely 2022-12-22 22:05:14 +02:00
allegroai
8992275f8e Support querying model metadata in Model.query_models() 2022-12-22 21:59:24 +02:00
allegroai
8ba78b5a11 Add allow_archived argument in Task.get_tasks() 2022-12-22 21:58:13 +02:00
allegroai
ab73447cbd Add StorageManager.set_report_upload_chunk_size() and StorageManager.set_report_download_chunk_size() to set chunk size for upload and download 2022-12-22 21:57:15 +02:00
allegroai
7d6eff4858 Fix error when using TaskScheduler with 'limit_execution_time' (#648) 2022-12-22 21:55:27 +02:00
allegroai
dd79bd6197 Fix tensorflow_macos support 2022-12-22 21:54:13 +02:00
allegroai
6529c0dc11 Dataset lineage view is broken with multiple dataset dependencies 2022-12-22 21:53:23 +02:00
allegroai
3dee5854bd Fix StorageManager.get_file_size_bytes() returns ClientError instead of None for invalid S3 links 2022-12-22 21:52:24 +02:00
allegroai
d723299f1e Fix can't write more than 2 GB to a file 2022-12-22 21:48:07 +02:00
allegroai
17dfa2b92f Fix jsonargparse and pytorch lightning integration broken for remote execution (#403) 2022-12-22 21:47:00 +02:00
allegroai
bf37df61aa Clarify deferred_init usage in Task.init() (#855) 2022-12-22 21:45:57 +02:00
allegroai
72d9b22e0d Fix HPO CLI doesn't work when --params-override is not specified 2022-12-18 23:02:29 +02:00
allegroai
8ef25a0030 Fix task.close() removes all log handlers (should only remove ClearML handlers) 2022-12-18 23:01:41 +02:00
allegroai
e53c4008a1 Fix None values get casted to empty strings when connecting a dictionary 2022-12-18 23:00:38 +02:00
allegroai
603d74da57 Fix pipeline controller fetching archived Tasks for caching 2022-12-18 22:59:33 +02:00
allegroai
9b9c81afec Fix browser_login() when 3rd party cookies are disabled 2022-12-18 22:58:02 +02:00
allegroai
1dd98ecf8d Fix lazyloaderproxy casting 2022-12-18 22:57:31 +02:00
allegroai
90f30e8d9a Version bump 2022-12-13 16:09:42 +02:00
allegroai
47ea919ddc PEP8 2022-12-13 16:07:51 +02:00
allegroai
dd6e4f1598 Fix StorageManager doesn't support uploading files to minio (#763) 2022-12-13 16:07:44 +02:00
allegroai
694ffc160b Fix Task.connect() sets wrong types if task was never ran locally 2022-12-13 16:02:36 +02:00
allegroai
8076e387ab Add missing changes 2022-12-13 16:00:20 +02:00
allegroai
d3de2151e8 Add IDE to the task's runtime properties 
Improve type annotations and docstrings
Flake8
 2022-12-13 15:59:42 +02:00
allegroai
3cb66650e8 Fix Dataset.get() should ignore archived datasets by default 2022-12-13 15:49:11 +02:00
allegroai
16c8a037cc Fix can't add S3 external links (#845) 2022-12-13 15:48:18 +02:00
allegroai
62a5ef102a Fix uploading files to S3 when _at_exit() is called fails (work around https://github.com/boto/boto3/issues/3113) 2022-12-13 15:43:18 +02:00
allegroai
09a53bce48 Fix optimization on many agents returns random errors (#829) 2022-12-13 15:37:16 +02:00
allegroai
16df0794be Fix ontinuing Tasks with tensorflow sometimes result in wrong initial iteration (#762) 2022-12-13 15:36:05 +02:00
allegroai
3da182426f Add support for network.file_upload_retries configuration option to control the UploadManager's file upload default retries 2022-12-13 15:35:19 +02:00
allegroai
5b38590756 Fix error message 2022-12-11 15:07:59 +02:00
allegroai
381b856b57 Fix mark_aborted() does not exist, use mark_stopped() instead 2022-12-11 15:07:58 +02:00
allegroai
64e00716e1 Fix Task.query_tasks() returns all tasks when a non-existent project name is provided 2022-12-11 15:07:58 +02:00
Frédéric Jean
7d6897f91b
Fix dataset not synced if the changes are only modified files (#835) 2022-12-06 14:33:43 +02:00
William Reynolds
64e1fb8571
Add r prefix to re.match() strings (#837) 2022-12-06 14:27:50 +02:00
john-zielke-snkeos
e709e46d91
Fix StorageHelper.delete() does not respect path substitutions (#838) 
Fixes allegroai/clearml#825
Make StorageHelper.get_object() call StorageHelper._canonized_url() to make path substitutions work.
 2022-12-06 14:26:05 +02:00
allegroai
d8926ace25 Version bump to v1.8.3 2022-12-04 12:52:27 +02:00
allegroai
ec70b5113a Fix a sync issue with ConrfigWrapper when loading configuration in session 
Optimize load sequence by not loading configuration on session start if not provided (worse case it will be loaded by the ConfigWrapper)
 2022-12-04 12:52:27 +02:00
Fred DeSerres-Blanchet
911a72f561
Set GCS credentials to None if invalid service account creds are provided (#841) 
Related to https://github.com/allegroai/clearml/issues/840
 2022-12-03 12:08:36 +02:00
allegroai
95cf9fff90 Version bump to v1.8.2 2022-12-01 08:54:43 +02:00
allegroai
ceb20f1eec Add CLEARML_VCS_ENTRY_POINT env var controlling experiment's entry point 
Fix CLEARML_VCS_WORK_DIR and CLEARML_VCS_DIFF support for standalone mode
 2022-11-30 19:54:43 +02:00
allegroai
7016138c84 Fix ClearML SDK does not work with PyTest (related to https://github.com/pytest-dev/pytest/issues/5502#issuecomment-647157873) 2022-11-27 17:32:24 +02:00
allegroai
65d0e15a74 Fix Task.set_parameters() does not add parameter type when parameter exists but does not have a type 2022-11-24 22:45:21 +02:00
allegroai
762bc5325f Version bump to v1.8.1 2022-11-21 17:31:04 +02:00
allegroai
66cccd22fd Fix examples 2022-11-21 17:14:07 +02:00
allegroai
ed2b8ed850 Support num_workers in dataset operations 
Support max connections setting for Azure storage using the `sdk.azure.storage.max_connection` setting
 2022-11-21 17:12:02 +02:00
allegroai
68467d7288 Fix default clearml logger level cannot be changed (#741) 2022-11-21 17:07:21 +02:00
allegroai
443c6dc814 Fix default method might get updated after default argument was initialized 
Fix default api method does not work when set in configuration
 2022-11-21 17:06:17 +02:00
allegroai
164169b73a Fix Hydra does use get overridden information from ClearML (#751) 2022-11-21 17:00:19 +02:00
allegroai
a841ab7450 Add ModelInfo.weights_object() for store callback access to the actual model object being stored (valid for both pre/post save calls, otherwise None) 2022-11-21 16:31:58 +02:00
allegroai
1729b9019f Fix CLEARML_DEFERRED_TASK_INIT=1 doesn't work 2022-11-21 16:31:23 +02:00
allegroai
d9497dd603 Fix checking backend api version lower than the supported version is meaningless 2022-11-21 16:30:37 +02:00
allegroai
9713f63cb7 Fix ModelsList.keys() is missing 2022-11-21 16:28:28 +02:00
Lavi
1d77b55dde
Raise error on failed uploads (#820) 2022-11-21 15:31:49 +02:00
allegroai
2aba12cf52 Fix docstring 2022-11-19 00:58:35 +02:00