Commit Graph

218 Commits

Author SHA1 Message Date
allegroai
33009cc1c7 Fix flushing on CR timeout (default 10sec) 2021-04-15 00:07:48 +03:00
allegroai
6ed4826c65 Fix hang when leaving process 2021-04-15 00:07:23 +03:00
allegroai
91d63df488 Fix shutdown should be called after python code detected KeyboardInterrupt exception 2021-04-15 00:07:02 +03:00
allegroai
59d531d1c8 Remove unnecessary legacy model design update 2021-04-15 00:06:27 +03:00
allegroai
60b6da5d8d Fix typo 2021-04-13 22:54:37 +03:00
allegroai
4e13d434a1 Version bump 2021-04-12 22:58:55 +03:00
allegroai
28abc9e69a Fix Task.set_base_docker()
Add docker bash script to Task.create()
2021-04-12 22:58:22 +03:00
allegroai
50d620cc9a Add force argument to Task.mark_failed() 2021-04-12 22:56:33 +03:00
allegroai
c4e9a7d387 Fix Model.task 2021-04-12 22:54:52 +03:00
allegroai
f8c28bd98d Fix schema typo 2021-04-12 22:54:23 +03:00
allegroai
86148a928b Support ClearML server API v2.13 2021-04-10 22:32:49 +03:00
allegroai
139c4ffe86 Remove redundant code 2021-04-10 22:26:48 +03:00
allegroai
0013c5851e Improve pipeline controller, add callbacks 2021-04-10 22:26:05 +03:00
allegroai
cf28551d21 Support storing dict with "." in the keys using Task.connect_configuration 2021-04-10 22:22:03 +03:00
allegroai
bf9ec770c6 Add ClearmlJob support for Task parameters override (issue #214) 2021-04-10 22:21:17 +03:00
allegroai
6415722798 Fix dataset create single root plot 2021-04-10 22:20:11 +03:00
allegroai
adf199b43b Add Model query interface 2021-04-10 22:18:58 +03:00
allegroai
5ee6425b4f Fix remove deprecation warning with matplotlib 3.1 2021-04-07 18:38:58 +03:00
allegroai
c07c45d2b3 Add OS env var CLEARML_DEFAULT_OUTPUT_URI to override default output_uri for automatic models upload (issue #328) 2021-04-07 18:38:32 +03:00
allegroai
e8752c54ff Fix docstring 2021-03-31 23:51:48 +03:00
allegroai
31d3b6dbc5 Support stopping instead of resetting in Task.execute_remotely() in case server supports enqueueing stopped tasks 2021-03-31 23:51:25 +03:00
allegroai
1986ec43fd Fix reporting after task closing 2021-03-31 23:47:27 +03:00
allegroai
9b962bae4b Fix \r and \n in debug samples title/series (issue #323) 2021-03-26 12:30:27 +03:00
allegroai
fa77d0f380 Add Task.force_requirements_env_freeze() forcing pip freeze instead of package analysis (issue #304) 2021-03-25 01:03:38 +02:00
allegroai
2a299c51db Fix Task requirements should conform to strings 2021-03-25 01:02:25 +02:00
allegroai
c76fe55c03 Add PipelineController node skip visualization and post execution callback 2021-03-25 01:00:56 +02:00
allegroai
9ff52a8699 Fix Task.execute_remotely() with sub process 2021-03-18 09:50:36 +02:00
allegroai
56825f9e7a Fix Keras h5 model storage 2021-03-18 09:49:53 +02:00
allegroai
20f10f8fbb Allow to continue running from previous execution iteration 2021-03-18 09:48:47 +02:00
allegroai
3f56411bcc Version bump to v0.17.5 2021-03-16 10:20:56 +02:00
allegroai
c3bb260b92 Remove auto comment on new projects 2021-03-15 17:39:10 +02:00
allegroai
d37aa23fbf Fix spawn logger/reporting 2021-03-11 09:42:35 +02:00
allegroai
737ca91d2a Fix TF 2.4 keras load/save model 2021-03-11 09:41:14 +02:00
allegroai
dacf097ebb Fix missing required argument --files in clearml-data remove 2021-03-11 09:40:56 +02:00
allegroai
532010c93d Add tags to Dataset listing 2021-03-11 09:40:31 +02:00
allegroai
b33ac21764 Fix clearml-data sync requires --name 2021-03-11 09:39:56 +02:00
allegroai
880e2b7507 Fix Dataset should set system tag on current_task 2021-03-11 09:38:46 +02:00
H4dr1en
f067caca52
Add force_download argument to Artifact.get() and Artifact.get_local_copy() (#319) 2021-03-09 17:42:45 +02:00
allegroai
41cad87b77 Fix artifact preview limit 64kb 2021-03-06 01:28:33 +02:00
allegroai
0f65d6345d version bump 2021-03-06 00:48:04 +02:00
allegroai
e1d92e2419 Improve background reporting speed 2021-03-06 00:47:58 +02:00
allegroai
4106aa9c49 Fix set_base_docker in remote execution 2021-03-06 00:47:06 +02:00
allegroai
1374543b93 Fix python 2.7 support 2021-03-06 00:46:37 +02:00
allegroai
2682754aaf Fix TF bind keyboard interrupt 2021-03-06 00:46:22 +02:00
allegroai
912f6f5ba2 Fix matplotlib with Agg backend (or in remote execution) 2021-03-03 15:05:22 +02:00
allegroai
ecc539ffb6 Add Dataset.get_logger()
Fix using Dataset on current_task set Task type
2021-02-28 19:49:38 +02:00
allegroai
f91645fdaf Add Dataset.get() dataset_tags argument 2021-02-28 19:49:06 +02:00
allegroai
70a37b9d54 Fix PyYAML scientific notation parsing (issue #313) 2021-02-27 23:53:56 +02:00
allegroai
97a39c9f1a Fix utility nested_from_flat_dictionary 2021-02-27 23:53:27 +02:00
allegroai
88cd7071f2 Change pipeline aborted Task in diff shade of blue 2021-02-27 23:52:33 +02:00
allegroai
a2557c253c Disable progress upload callback at the end of http driver upload until we have full upload progress 2021-02-27 23:52:14 +02:00
allegroai
7e6158dd9b Add Task.add_requirements specify version <>=~ etc. 2021-02-27 23:51:40 +02:00
allegroai
e24a421457 Fix Hydra 1.1 support (argparse description) 2021-02-27 23:51:06 +02:00
allegroai
ae6caf4404 PEP8 2021-02-23 10:38:02 +02:00
allegroai
60b2f5bd74 Dataset remove files should not mark "dirty" flag as there is nothing to upload 2021-02-23 10:37:23 +02:00
allegroai
5641cb5a7c Fix JupyterLab notebook detection 2021-02-23 10:36:55 +02:00
allegroai
cf3c6ba815 PEP8 2021-02-21 15:00:15 +02:00
allegroai
132e76cfb9 Fix multiple Task.init()/close() calls in the same process 2021-02-21 14:59:50 +02:00
allegroai
ee9dfb8b35 Fix TensorBoard multiple Task.init()/close() calls in the same process (issue #312) 2021-02-21 14:58:40 +02:00
allegroai
c6d22c2d0a Add links to Tasks in optimization summary table (not just Task IDs) 2021-02-21 14:57:55 +02:00
allegroai
ff7e55756c Fix server updated with the argparse in remote before Task.init() is called (respect skipped args)
Fix nonstandard argparse with default value that is not of defined type
2021-02-21 14:56:30 +02:00
allegroai
41230ac2c7 Add progress report logging for StorageHelper.upload_from_stream, StorageHelper.upload and StorageHelper.upload_from_stream 2021-02-21 14:55:04 +02:00
allegroai
7dbf5471cc Allow Dataset to be created on a running Task 2021-02-21 14:51:24 +02:00
allegroai
c58e8a4c6a Fix make Pipeline Summary Table link to Task step logs 2021-02-14 13:52:09 +02:00
allegroai
aad9f5c812 Fix Task.create with repo and script that exists locally 2021-02-14 13:51:27 +02:00
allegroai
e5747d587d Add PipelineController disable clone base task option 2021-02-14 13:50:58 +02:00
allegroai
0c017a7331 Add "clearml-data publish" to allow publishing a dataset task 2021-02-11 14:37:41 +02:00
allegroai
1600101f94 Allow publishing a completed task 2021-02-11 14:35:39 +02:00
allegroai
787079669f Fix exception at exit in python 3.8+ on macOS/Windows 2021-02-11 14:28:05 +02:00
allegroai
7a25f8afd9 Fix hydra multi-run support (issue #306) 2021-02-11 14:27:28 +02:00
allegroai
f64d1a0993 Fix clearml-task patching local git diff 2021-02-11 14:27:00 +02:00
allegroai
1b6b1e12ee Fix clearml-task not passing --docker 2021-02-11 14:26:20 +02:00
allegroai
8babddd654 Fix pr_curve in TensorBoard 2+ 2021-02-11 14:25:43 +02:00
allegroai
e9f8fc949d Fix argparser logging always captures defaults (Windows only, ignored cmd) 2021-02-08 13:25:31 +02:00
allegroai
5a76ffd460 Fix Task.connect(object) should always return the same object instance 2021-02-08 13:23:16 +02:00
glemarivero
fbbae0b8bc
Fix Dataset.remove_files() does not match when files are in the root of the dataset (#303)
Co-authored-by: Gabriel Lema <glema@ulta.com>
2021-02-07 17:12:01 +02:00
allegroai
28b85028fe Fix close task after logger is closed 2021-02-04 10:41:51 +02:00
allegroai
71c45fcdd3 Update Auto Scaler default values and configuration format 2021-02-01 23:44:01 +02:00
allegroai
12d51dae92 Fix crash in case get_logger() cannot get the file name 2021-02-01 23:42:41 +02:00
allegroai
0d89497cc9 Clean up TF binding graph execution operator 2021-02-01 23:41:53 +02:00
allegroai
6778b982a7 Fix TF +2.3 mixed eager mode execution summary metrics not reported 2021-02-01 23:41:18 +02:00
allegroai
3890477056 Fix creating subprocess from a daemon process 2021-02-01 23:40:48 +02:00
allegroai
1c1fecf7d0 Improve docstring 2021-02-01 23:39:44 +02:00
allegroai
2f5080a34c Fix python package detection sklearn -> scikit-learn (issue #296) 2021-02-01 23:39:07 +02:00
allegroai
4931429054 Fix argparse with [None] in default parameter (issue #297) 2021-02-01 23:38:21 +02:00
allegroai
e3109c96d8 Add upload HTML preview of jupyter notebook as an artifact 2021-02-01 23:37:44 +02:00
tankeco
ebc0733357
Fix strip remote diff (#295)
Co-authored-by: wjn <wjn@megvii.com>
2021-01-25 13:20:21 +02:00
allegroai
0f401545b8 Replace humanfriendly with utility functions 2021-01-24 09:22:56 +02:00
allegroai
1c84b31056 Fix Dataset generate removed / modified / added of summary table 2021-01-24 09:21:28 +02:00
allegroai
698977d05e Fix reporter from non main tasks should always use threads (not subprocesses) 2021-01-24 09:20:42 +02:00
allegroai
2676e14d4d Fix reporter should skip report if report thread service is closed 2021-01-24 09:20:09 +02:00
allegroai
03f9bf0c2d Add clearml-data CLI sync can now create, sync and close a dataset in a single command 2021-01-24 09:19:33 +02:00
allegroai
088eae0ded Fix closing a dataset with only files removed
Add system_tag `dataset` to a Dataset Project
2021-01-24 09:18:49 +02:00
allegroai
381ae21cef Fix issue #292 pytorch-lighting multi node store 2021-01-24 09:18:18 +02:00
allegroai
828af76ffe Support all reporting using subprocesses instead of threads. Configure using sdk.development.report_use_subprocess 2021-01-24 09:17:52 +02:00
allegroai
4b4fa3eff0 Add Jupyter auto-magic store jupyter notebook as an artifact on the Task. Use sdk.development.store_jupyter_notebook_artifact=True by default 2021-01-24 09:15:24 +02:00
allegroai
0962e53f0b Fix argparse nargs passed in command line --nargs 1 2 should be stored as '[1, 2]' not as "['1', '2']" 2021-01-24 09:14:27 +02:00
allegroai
6b8f21b30e Add support for datetime in scatter plots + matplotlib support 2021-01-24 09:13:32 +02:00
allegroai
dd03ca0d1d Fix issue #291 2021-01-24 09:12:12 +02:00
allegroai
1988cf8adf Fix populate Task called from jupyter notebook. Added packages=True to auto populate based on locally installed packages 2021-01-24 09:11:09 +02:00