Commit Graph

291 Commits

Author SHA1 Message Date
allegroai
332ceab3ea Fix clearml-task failing without a docker script. Issue #378 2021-06-09 02:46:46 +03:00
allegroai
53d25b7675 Fix incorrect check for default value in Config.get() 2021-06-09 02:46:01 +03:00
allegroai
701fca9f39 version bump 2021-06-01 00:20:43 +03:00
allegroai
17b5ec52d0 Fix default_output_uri for Dataset creation (issue #371) 2021-06-01 00:19:28 +03:00
allegroai
e10940d038 Add Task.ignore_requirements 2021-06-01 00:19:06 +03:00
allegroai
d22cf7557d Add support for GIF images in Tensorboard (issue #372) 2021-06-01 00:18:39 +03:00
allegroai
fcc3c12b59 Fix sub-process spawn multi-process 2021-06-01 00:18:20 +03:00
allegroai
ba1b8c403b Add Task.__get_master_process_id 2021-06-01 00:18:01 +03:00
allegroai
5ce5035541 Fix Task.execute_remotely() on created Task (not initialized Task) 2021-06-01 00:17:45 +03:00
allegroai
73595b8e4e Deprecate Logger.tensorboard_single_series_per_graph() 2021-06-01 00:17:23 +03:00
allegroai
cedec58140 Version bump to v1.0.3 2021-05-31 22:23:59 +03:00
allegroai
0454ffcdf4 Add optional ignored packages in script requirements (currently used for pywin32) 2021-05-31 15:44:11 +03:00
allegroai
206d86ec5b Support DummyModel configuration (Slack https://clearml.slack.com/archives/CTK20V944/p1621469235085400) 2021-05-31 15:43:02 +03:00
allegroai
5e6b4ebe5d Fix automation controller overrides nodes clone 2021-05-31 15:40:13 +03:00
allegroai
2e95881c76 PEP8 2021-05-26 18:30:59 +03:00
allegroai
b1ce3e0653 Fix run as module (issue #359) 2021-05-26 18:29:53 +03:00
allegroai
f8a76278bf Fix python2.7 support (issue #366) 2021-05-26 18:28:59 +03:00
allegroai
62437ee3a7 version bump 2021-05-25 00:55:24 +03:00
allegroai
d531b508cb Fix Dataset.finalize() can hang in extreme scenario 2021-05-20 11:36:53 +03:00
allegroai
07a22a38ac Add log nvidia driver and cuda version 2021-05-20 11:35:59 +03:00
allegroai
d3929033c0 Fix background upload retries with Google Storage (gs://) 2021-05-19 15:26:43 +03:00
allegroai
91ff64b1f6 Fix Jupyter Notebook inside VSCode 2021-05-19 15:26:05 +03:00
allegroai
65b838f409 Fix Hydra should not store the full resolved OmegaConf (issue #327) 2021-05-19 15:25:47 +03:00
allegroai
ed75eac6ab Add machine specs in Task.runtime 2021-05-19 15:25:23 +03:00
allegroai
016a5c2d71 Add Logger.matplotlib_force_report_non_interactive() 2021-05-19 15:24:47 +03:00
allegroai
8fb4fb2b5e Fix Task.add_requirements() passing package_version starting with @ or ; or # 2021-05-19 15:24:09 +03:00
allegroai
83fb00ef8b Add report_matplotlib_figure(..., report_interactive=False) allowing to upload a matplotlib as a non-interactive (high quality png) plot 2021-05-19 15:23:34 +03:00
allegroai
444e379e93 Expose docker_args and docker_bash_setup_script in clearml-task CLI 2021-05-19 15:22:44 +03:00
allegroai
350a39b886 Fix shutting down a Task immediately after creation might block 2021-05-14 09:42:42 +03:00
Manoj
bcf344da19
Use default boto credential chain if no keys in the config (#342)
* Use default boto credential chain if no keys in the config

* Add use_credentials_chain config to explicitly enable boto cred chain

* Propagate the new config param in the right way

* PEP8 fixes
2021-05-13 11:34:13 +03:00
Ramon Emiliani
d93937fc36 Pass config and task_function as keyword arguments for Hydra's run_job change in parameter order. 2021-05-13 11:31:46 +03:00
allegroai
55b214c23d Fix direct import of keras save/load model functions (issue #355) 2021-05-12 15:42:59 +03:00
allegroai
1e7b35456d Protect against wrong file object type when auto-binding models 2021-05-12 15:42:02 +03:00
allegroai
228c17e44d Fix support for Dataset.create() argument use_current_task
Add dataset_tags argument to Dataset.create()
2021-05-12 15:41:04 +03:00
allegroai
f46561629f Fix task.execute_remotely from jupyter notebook 2021-05-10 23:52:33 +03:00
allegroai
0e0d86f6d8 Fix python3.8 race condition in task.close() 2021-05-10 20:33:51 +03:00
allegroai
654d484ae9 Remove matplotlib axis range (plotly.js auto-range can adjust it in real-time) 2021-05-08 23:59:15 +03:00
allegroai
607333f770 Fix matplotlib date convertor 2021-05-08 23:58:04 +03:00
allegroai
8c4fa4373a Add CLEARML_AUTH_TOKEN support for directly passing a token (no need for user/pass) 2021-05-08 23:57:50 +03:00
allegroai
05139411b7 Version bump to v1.0.2 2021-05-05 22:26:38 +03:00
allegroai
57373c0ad8 Fix BackgroundMonitor daemon 2021-05-05 22:26:12 +03:00
allegroai
c65a8f802e Fix obsolete docstring terminology "Log"->"Console" 2021-05-05 22:24:57 +03:00
allegroai
8bee23d205 version bump 2021-05-05 01:33:57 +03:00
allegroai
c9c4570569 Fix process hangs at exit waiting for logger subprocess 2021-05-05 01:33:49 +03:00
allegroai
e9bf34b13b Version bump to v1.0.0 2021-05-03 18:33:21 +03:00
allegroai
a3ace2261c Fix docstring 2021-05-03 18:33:12 +03:00
allegroai
799e7f629f Fix PY2 compatibility 2021-05-03 18:32:07 +03:00
allegroai
bd110aed5e Fix docstrings 2021-05-02 09:47:02 +03:00
allegroai
5e660392b5 Fix Task.create_task() script setup 2021-05-02 09:46:19 +03:00
allegroai
b21e932726 Fix set_credentials uses incorrect config file 2021-04-28 18:45:45 +03:00
allegroai
f93c0dddf0 Fix querying class attribute 2021-04-28 18:45:00 +03:00
allegroai
bdd8d224ac Fix get_active_config_file() crashing 2021-04-28 18:44:13 +03:00
allegroai
b1dbc9b7a2 Fix Task.set_comment/name() passing None should be equivalent to '' 2021-04-28 13:13:00 +03:00
allegroai
fe76680eda Fix Task.runtime API v2.13 2021-04-28 13:12:30 +03:00
allegroai
20d91ee16c Add PipelineController into main namespace 2021-04-28 13:11:36 +03:00
allegroai
19c88f93d0 PEP8 2021-04-28 13:11:16 +03:00
allegroai
84025a75b2 Add Task.runtime to API v2.13 2021-04-28 13:10:02 +03:00
allegroai
9d108d855f Add Pipeline controller caching, improve pipeline plot reporting 2021-04-25 10:43:39 +03:00
allegroai
a9f52a468c Rename TF patching functions for better readability 2021-04-25 10:43:11 +03:00
allegroai
dc6c8cfddc Add option to enable/disable tensorboard (default: enable) 2021-04-25 10:42:50 +03:00
allegroai
f9e555b464 Add pipeline step caching 2021-04-25 10:41:51 +03:00
allegroai
696034ac75 Add Task.get_configuration_objects() add Task.get_task() filtering support 2021-04-25 10:41:29 +03:00
allegroai
07fca61572 Fix PyCharm debugger Keyboard interrupt set Task as failed (instead of aborted) 2021-04-25 10:39:10 +03:00
allegroai
b64c43ba54 Change Logger plot iteration argument default to 0 (or None)
Breaking changes! arguments order changed in Logger.report_line_plot(), Logger.report_plotly() and Logger.report_matplotlib_figure()
2021-04-25 10:38:38 +03:00
allegroai
1637c1a270 Improve Task.artifacts for safer Task multi node use cases 2021-04-25 10:37:14 +03:00
allegroai
d3cdb0ac42 Fix ClearmlJob docstrings 2021-04-25 10:36:46 +03:00
allegroai
272ed44c12 Fix Task.set_credetnials() should override config file 2021-04-25 10:35:08 +03:00
allegroai
22d795f68f Fix Matplotlib automagic export legend not showing series names (issue #337) 2021-04-20 18:09:22 +03:00
allegroai
4832de5a65 Wait for subprocess when terminating 2021-04-20 18:09:22 +03:00
allegroai
1c6685e273 Change default metric report flushing to every 5 seconds 2021-04-20 18:09:22 +03:00
allegroai
8417e4f7a0 Add jupyter notebook preview update time stamp 2021-04-20 18:09:22 +03:00
allegroai
8c309afef4 Fix Google API credentials without storage section raises exception on import (issue #331) 2021-04-20 18:09:22 +03:00
allegroai
3e61e3b39b Add hash utility functions 2021-04-15 00:08:16 +03:00
allegroai
33009cc1c7 Fix flushing on CR timeout (default 10sec) 2021-04-15 00:07:48 +03:00
allegroai
6ed4826c65 Fix hang when leaving process 2021-04-15 00:07:23 +03:00
allegroai
91d63df488 Fix shutdown should be called after python code detected KeyboardInterrupt exception 2021-04-15 00:07:02 +03:00
allegroai
59d531d1c8 Remove unnecessary legacy model design update 2021-04-15 00:06:27 +03:00
allegroai
60b6da5d8d Fix typo 2021-04-13 22:54:37 +03:00
allegroai
4e13d434a1 Version bump 2021-04-12 22:58:55 +03:00
allegroai
28abc9e69a Fix Task.set_base_docker()
Add docker bash script to Task.create()
2021-04-12 22:58:22 +03:00
allegroai
50d620cc9a Add force argument to Task.mark_failed() 2021-04-12 22:56:33 +03:00
allegroai
c4e9a7d387 Fix Model.task 2021-04-12 22:54:52 +03:00
allegroai
f8c28bd98d Fix schema typo 2021-04-12 22:54:23 +03:00
allegroai
86148a928b Support ClearML server API v2.13 2021-04-10 22:32:49 +03:00
allegroai
139c4ffe86 Remove redundant code 2021-04-10 22:26:48 +03:00
allegroai
0013c5851e Improve pipeline controller, add callbacks 2021-04-10 22:26:05 +03:00
allegroai
cf28551d21 Support storing dict with "." in the keys using Task.connect_configuration 2021-04-10 22:22:03 +03:00
allegroai
bf9ec770c6 Add ClearmlJob support for Task parameters override (issue #214) 2021-04-10 22:21:17 +03:00
allegroai
6415722798 Fix dataset create single root plot 2021-04-10 22:20:11 +03:00
allegroai
adf199b43b Add Model query interface 2021-04-10 22:18:58 +03:00
allegroai
5ee6425b4f Fix remove deprecation warning with matplotlib 3.1 2021-04-07 18:38:58 +03:00
allegroai
c07c45d2b3 Add OS env var CLEARML_DEFAULT_OUTPUT_URI to override default output_uri for automatic models upload (issue #328) 2021-04-07 18:38:32 +03:00
allegroai
e8752c54ff Fix docstring 2021-03-31 23:51:48 +03:00
allegroai
31d3b6dbc5 Support stopping instead of resetting in Task.execute_remotely() in case server supports enqueueing stopped tasks 2021-03-31 23:51:25 +03:00
allegroai
1986ec43fd Fix reporting after task closing 2021-03-31 23:47:27 +03:00
allegroai
9b962bae4b Fix \r and \n in debug samples title/series (issue #323) 2021-03-26 12:30:27 +03:00
allegroai
fa77d0f380 Add Task.force_requirements_env_freeze() forcing pip freeze instead of package analysis (issue #304) 2021-03-25 01:03:38 +02:00
allegroai
2a299c51db Fix Task requirements should conform to strings 2021-03-25 01:02:25 +02:00
allegroai
c76fe55c03 Add PipelineController node skip visualization and post execution callback 2021-03-25 01:00:56 +02:00
allegroai
9ff52a8699 Fix Task.execute_remotely() with sub process 2021-03-18 09:50:36 +02:00