Commit Graph

2187 Commits

Author SHA1 Message Date
allegroai
71c74f977b Add Model archive/unarchive methods 2023-08-31 00:10:38 +03:00
allegroai
713501c611 Fix hydra overrides integration (issue #552) 2023-08-31 00:10:21 +03:00
allegroai
6756dec06a Json serialization error should raise exception 2023-08-31 00:09:36 +03:00
Alex Burlacu
0959974920 Fix fastAI binding not reporting scalars if tensorboard is installed 2023-08-24 13:55:05 +03:00
Alex Burlacu
0b521b00a6 Use os.register_at_fork instead of monkey patching fork for python > 3.6 2023-08-21 14:06:59 +03:00
allegroai
f6ad5e6c06 Fix PyPI Downloads badge 2023-08-17 23:28:03 +03:00
Alex Burlacu
88d036b367 Update PyNVML to the latest NVIDIA version 2023-08-15 13:54:04 +03:00
Alex Burlacu
afe178b002 Bump version to 1.12.2 2023-08-11 19:57:07 +03:00
Alex Burlacu
83a04d438c Adjust for pandas < 2.0 2023-08-11 19:56:08 +03:00
Alex Burlacu
d4b11dfa22 Create OutputModel base model lazily 2023-08-11 13:11:58 +03:00
Alex Burlacu
2c44bff461 Fix Hydra support both Hydra section overrides and 2023-08-11 13:09:19 +03:00
allegroai
c15f012e1b Add PipelineController always_create_from_code=True (False is previous behavior where we deserialize always from backend when running remotely, new flow means the pipeline is always created from code)
Fix pipeline decorator does not read the pipeline arguments back from the backend when running remotely
2023-08-04 19:54:55 +03:00
allegroai
d26ce48dbe Improve artifacts serialization: should now be consistent when serializing pandas object into gzip stream (csv.gz) 2023-08-04 19:08:51 +03:00
allegroai
197894735b Make sure we work on a copy of task objects 2023-08-04 19:08:09 +03:00
allegroai
696c349488 Improve warning message on task execute_remotely 2023-08-04 19:07:35 +03:00
allegroai
b846772138 Fix pipeline monitor must be called after pipeline is completed (just in case we missed something) 2023-08-04 19:07:05 +03:00
allegroai
99c7eecbee Fix pipeline should always use artifacts hash for checking cache hits 2023-08-04 19:06:15 +03:00
allegroai
46c6d2bf0f Fix proxy object support for lists 2023-08-04 19:05:24 +03:00
Alex Burlacu
a8b71de3e4 Adjust a few things in the README 2023-08-04 14:30:10 +03:00
Alex Burlacu
92511efbde Allow setting multiprocessing start method 2023-07-31 21:34:13 +03:00
Alex Burlacu
80ef359f45 Bump version and clarify docs 2023-07-31 21:33:28 +03:00
allegroai
e467c05fb4 Fix S3 uploads fail with LazyEvalWrapper type error (#1081) 2023-07-30 13:04:42 +03:00
Michael Pilosov
b1f99abc96
Raise error if dataset name empty (#1083)
* raise error if dataset name empty.

hidden dataset project when name is an empty string.

if the dataset project happens to match an existing project, it can be quite jarring to have one's history of results suddenly become hidden.

if there's an intent behind this behavior, please let me know and I'd gladly change it to a warning instead.

* move check to top of init, change message

* whitespace
2023-07-27 14:54:19 +03:00
pollfly
c451589298
Edit docstrings (#1084) 2023-07-25 12:19:24 +03:00
Alex Burlacu
09363b0d30 Fix typo 2023-07-21 14:23:32 +03:00
alex-burlacu-clear-ml
05c048d0bd
Fix style and grammar mistakes 2023-07-19 22:55:08 +03:00
alex-burlacu-clear-ml
ac1ae7f447
Update errata, clarify a few points 2023-07-19 20:23:03 +03:00
Alex Burlacu
618a625b74 Bump version to 1.12.0 2023-07-19 17:33:28 +03:00
Alex Burlacu
9b680d1743 Add clarification about breaking changes in sdk 1.11.0 and 1.11.1 2023-07-19 17:29:41 +03:00
Alex Burlacu
cc875f0fbe Fix linter issues 2023-07-19 17:28:58 +03:00
Alex Burlacu
028a835676 Deprecate Task.get_by_name 2023-07-19 02:11:40 +03:00
Alex Burlacu
75b4015fdb Fix misconfigured boto3 bucket credentials verify 2023-07-19 02:09:49 +03:00
Alex Burlacu
c8c8a1224e Add support for .get ing pipelines and enqueue-ing them 2023-07-18 15:03:31 +03:00
achaiah
9d57dad652
AWS credential access fix (#1000)
Fixing AWS credential access that uses a token, instantiation within VPC without AvailabilityZones and ebs volume creation. Note: EBS is attached but never mounted.
2023-07-16 15:22:10 +03:00
Alex Burlacu
f6ae803110 Add default values in .conf files for s3 multipart 2023-07-14 14:24:10 +03:00
alex-burlacu-clear-ml
bae4886412
Merge pull request #1059 from cgaudreau-ubisoft/s3-configure-multipart
Added boto3 parameters for multipart configurations
2023-07-14 14:13:21 +03:00
alex-burlacu-clear-ml
f56a417d5a
Merge pull request #1063 from pktiuk/bump_codeql
Bump version of codeql task
2023-07-14 14:11:03 +03:00
Alex Burlacu
e7edcbb813 Fix #1054, now retring a pipeline step will continue from the correct tf epoch 2023-07-14 14:04:38 +03:00
pollfly
44faf6ef7b
Improve clearml.conf (#1071) 2023-07-11 10:53:19 +03:00
pollfly
f2fbbbd988
Improve clearml.conf (#1070) 2023-07-11 10:22:36 +03:00
natephysics
29227cade1
Add include_archived to optionally exclude archived datasets from dataset.list_datasets() (#1069)
Addresses #1067

* feat(datasets.py):  Added the option `include_archived` to Dataset.list_datasets() class method which, if False, will exclude archived datasets from the list. Defaults to True to maintain the current behavior of the class method.

While it's possible to filter datasets using the get() class method it wasn't possible to do the same for the list_datasets() method. This feature seems useful to include and it's a simple, non-breaking modification.

* style(datasets.py): 🚨 Updated formatting (white spaces/spaces after comma/line breaks) in accordance with the flake8 formatting checks for dataset.py.

As suggesting in the contribution guidelines, fake8 was used to validate the formatting. Several errors were found from prior commits that were fixed.
2023-07-10 20:59:49 +03:00
allegroai
5aa80267d6 Version bump to v1.11.2rc0
Small refactoring
2023-07-10 11:20:27 +03:00
allegroai
3f882c37b9 Fix pipeline steps are not cached when the arguments come from the pipeline controller 2023-07-10 11:18:37 +03:00
allegroai
c394046a2d Fix Task.connect_configuration() removes trailing + sign from configuration key 2023-07-10 11:14:09 +03:00
Alex Burlacu
13f11a68be Improve pipeline caching behaviour 2023-07-08 16:58:41 +03:00
Alex Burlacu
6dc2c8ca8c Fix GCS quoting issue 2023-07-06 12:23:06 +03:00
Paweł Kotiuk
31739dbd84 Bump version of codeql task 2023-06-30 13:29:42 +02:00
Make42
5824e27ada
Correct spelling, code formatting, add deprecation warnings to logger methods (#1052)
* Correct spelling in docstrings and comments in automation controller

* Improve readability by adding line breaks in automation controller

* Add deprecation warnings for logger methods

* Add docstring text regarding deprecation of logger methods

* Format deprecation warnings for logger methods in Black style

* Correct the docstring of query_tasks

* Remove new line in 'pre_execute_callback' docstring

---------

Co-authored-by: Make42 <none@none.net>
2023-06-29 18:10:09 +03:00
AbdulHamid Merii
9e8ed16b3e Added boto3 parameters for multipart configurations
- multipart threshold and chunksize
2023-06-26 12:07:40 -05:00
AbdulHamid Merii
cbd14e3d6a
Fix typo in projects docstring (#1038) 2023-06-25 08:05:53 +03:00