ClearML/clearml
1
0
Fork 0
mirror of https://github.com/clearml/clearml synced 2025-02-01 17:43:43 +00:00
Code Issues Actions Packages Projects Releases Wiki Activity
758 Commits 4 Branches 178 Tags 51 MiB
299ce14515
Commit Graph

139 Commits

Author SHA1 Message Date
allegroai
3ac7dbdb49 Refactor shutdown sequence 2020-04-09 13:10:29 +03:00
allegroai
d9aa83380f Stop resource monitoring before signaling task stop 2020-04-09 13:07:26 +03:00
allegroai
ab263bb59f Raise ValueError if Task.get_logger() is called after task was closed 2020-04-09 13:06:06 +03:00
allegroai
7f00e45d6c Do not recreate logger after Task was closed/exited 2020-04-09 12:59:00 +03:00
allegroai
aa737e6b5b Make sure task is marked as started in remote execution (just in case) 2020-04-09 12:53:43 +03:00
allegroai
2f395cc76b Use sub-process fork signal hooks instead of os._exit patch 2020-04-09 12:50:04 +03:00
allegroai
9a0a84a83e Do not wait for logs if we are aborting the task manually (i.e. ctrl-C) 2020-04-09 12:41:10 +03:00
allegroai
98ce0bbe43 Change TaskHandler.close() wait default to False as it should not wait for logs to flush 2020-04-09 12:39:09 +03:00
allegroai
b3c9872a3f Intercept SystemExit and do nothing so we could kill the thread 2020-04-09 12:33:16 +03:00
allegroai
337e60a376 Kill repo/package detection thread on exit 2020-04-09 12:28:57 +03:00
allegroai
b2c2002c40 Create dev task manually when constructing the Task 2020-04-09 12:27:13 +03:00
allegroai
07daf8f5e6 Fix logger sometimes getting stuck at end of experiment 2020-04-09 12:05:56 +03:00
allegroai
172ed62d41 Add Task.get_tasks() filtering support 2020-04-01 18:54:16 +03:00
allegroai
c4719f2e2f Add type annotations and fix docstrings 2020-03-23 23:26:46 +02:00
allegroai
766c8ab24f Add Task.models property 2020-03-23 23:25:55 +02:00
allegroai
0211d233d4 Deprecate Task.set_model_config(), Task.get_model_config_text() and Task.get_model_config_dict() 2020-03-23 23:25:16 +02:00
allegroai
023f1721c1 Add Task.get_models() retrieving stored models on previously executed tasks 2020-03-22 18:19:07 +02:00
allegroai
babaf9f1ce Add OpenMPI/Slurm support 2020-03-20 10:23:00 +02:00
allegroai
0adbd79975 Fix StorageHelper upload on shutdown 2020-03-20 10:20:44 +02:00
allegroai
afad6a42ea Add initial slurm support (multiple nodes sharing the same task id) 2020-03-12 18:12:16 +02:00
allegroai
b3dff9a4eb Support setting task initial iteration for continuing previous runs 2020-03-12 17:40:29 +02:00
allegroai
f3531c1af2 Allow Task.set_credentials() to override configuration file in dev mode 2020-03-12 17:22:09 +02:00
allegroai
5bc39271e3 Fix store uncommitted code configuration option 2020-03-12 17:17:39 +02:00
allegroai
2e3820603a Allow argparser override values with command line even in remote execution (essential for sub-process support) 2020-03-05 12:28:36 +02:00
allegroai
1d9e70bd8b Fix signal hooking registeration (cont.) 2020-03-05 12:26:56 +02:00
allegroai
181a0be0af Remove temporary file lock at the end of the execution or in Task.close() 2020-03-05 12:25:17 +02:00
allegroai
b0c602c832 Fix signal hooking registeration 2020-03-05 12:24:14 +02:00
allegroai
bcf97afeb9 Forking processes should not pass along the original File based Lock 2020-03-05 12:22:14 +02:00
allegroai
888c53f67d Allow disabling repository detection when calling Task.init() 2020-03-05 12:19:40 +02:00
allegroai
a2ecb2c75d Only use file based locks for main task. Secondary tasks use traditional multiprocessing lock 2020-03-05 12:10:23 +02:00
allegroai
da804ca75f Add support for Popen subprocesses with task edit protection from multiple processes 2020-03-05 12:05:12 +02:00
allegroai
e3ae4f4e26 Optimize task refresh while pulling task status in local worker and last iteration for Resource Monitoring 2020-03-05 11:40:27 +02:00
Karthikeyan Singaravelan
a97850e5b6 Import ABC from collections.abc instead of collections for Python 3.9 compatibility. 2020-03-03 21:38:03 +05:30
allegroai
cf850020fb Don't print empty line at end of process if there's no artifacts summary 2020-02-26 17:06:17 +02:00
allegroai
8972c1f005 Add Task.[get/set]_parameters_as_dict() to allow interaction with non-main task parameters (no need to connect()) 2020-02-20 18:32:12 +02:00
allegroai
b5168010e9 Make sure Task.connect() returns the same value it is passed 2020-02-18 11:26:52 +02:00
allegroai
1cc0ea6cf3 Fix logs, events and jupyter flushing on exit 2020-01-21 16:41:01 +02:00
allegroai
30eaed79ea Add warning when automatic argument parser binding cannot be turned off 2020-01-06 17:20:15 +02:00
allegroai
bc33ad0da3 Calculate data-audit artifact uniqueness by user-criteria 2020-01-06 17:19:44 +02:00
allegroai
54ae340ccb Use source task id to determine cloned task parent 2020-01-02 12:01:03 +02:00
allegroai
67d9a9e5d4 Do not reuse experiment if it has artifacts 2019-12-15 00:09:36 +02:00
allegroai
f92278750a Fix default_output_uri in remote execution mode 
Fix arguments order in Task.create
 2019-12-04 23:47:26 +02:00
allegroai
8aa86225e2 Add default_output_uri in trains.conf configuration 
Fix Task.set_credentials support for different web/api/files hosts
 2019-11-23 01:27:45 +02:00
allegroai
0a45d2094f Add Task connect_configuration, connect_label_enumeration, and support for nested dictionary with connect 
Add Task.get_tasks
 2019-11-15 22:00:10 +02:00
allegroai
4372dda696 Add Task.init auto_connect_frameworks fine granularity control 2019-11-08 22:30:09 +02:00
allegroai
ac0dfabdfd Improve orchestration pipelines 2019-10-29 22:08:02 +02:00
allegroai
2104c3ec6b Add trains-server new capabilities support 2019-10-25 15:15:22 +03:00
allegroai
cdbf792582 Change second model warning to info 2019-10-15 22:36:04 +03:00
allegroai
e0e6d9159b Fix python 2.7 and Windows support 2019-10-10 21:10:51 +03:00
allegroai
0a5696235b Add exception handling when no output uri credentials are found 2019-10-06 21:57:17 +03:00
allegroai
6aa22e449e Add alias for task type, train/inference 2019-10-04 01:31:57 +03:00
allegroai
a7eb8476ce Add initial Tensorflow v2 support (2.0.0rc1) 2019-09-27 13:24:04 +03:00
allegroai
86655412b0 Add artifacts support for folders/wildcard, include retrieval and extraction 2019-09-25 00:33:00 +03:00
allegroai
0b4f00af4d Restructured Logger with nice clean interface. 
Breaking changes: Logger no longer supports info/error/warning console() replaced with report_text()
 2019-09-23 18:40:13 +03:00
allegroai
24c2f86741 Add upload artifact supports pd.DataFrame 2019-09-15 21:52:57 +03:00
allegroai
8c3f6d254a Fix multiple tasks closing 2019-09-15 01:36:33 +03:00
allegroai
b98c821cf9 Fix task cloning 2019-09-15 00:02:23 +03:00
allegroai
2ba372560e Fix set artifacts storage destination with output_uri 2019-09-14 13:55:17 +03:00
allegroai
d7bdc746b8 Add full artifacts support 2019-09-13 17:09:24 +03:00
allegroai
3f63394b51 Documentation 2019-09-07 23:28:32 +03:00
allegroai
d0b1c6acb5 Sphinx compatibility 2019-09-05 01:54:15 +03:00
allegroai
64ba30df13 Stability and cleanups 2019-09-03 12:58:01 +03:00
allegroai
25e3816484 Add permission check for Task.init(output_uri=) 2019-08-19 21:21:21 +03:00
allegroai
1d6727d2c0 Improve auto package detection 2019-08-07 00:05:51 +03:00
allegroai
fb7dfc49a9 Fix auto-detect git repository 2019-08-01 12:54:11 +03:00
allegroai
2bbf46a273 Fix Windows support 2019-07-31 23:09:53 +03:00
allegroai
4c15613250 Add support for scikit-learn internal joblib implementation 2019-07-31 01:37:06 +03:00
allegroai
19c5f05912 Add scikit-learn support (joblib) and xgboost support 2019-07-31 00:30:12 +03:00
allegroai
62bc54d7be Add initial artifacts support 
Fix sub-process support
Fix delete_after_upload option when uploading images
Add logugu support
Fix subsample plots if they are too big
Fix requests for over 15mb
 2019-07-28 21:04:45 +03:00
allegroai
c80aae0e1e Fix support for sub-process (process pool) 2019-07-20 23:11:54 +03:00
allegroai
7d0bf4838e Add Task.set_credentials for cloud hosted jupyter support 2019-07-13 23:54:47 +03:00
allegroai
339f57f44c Fix Jenkins CI/CD support 2019-07-10 17:25:30 +03:00
allegroai
c4c37c5cef Moved definition 2019-07-09 01:52:06 +03:00
allegroai
22b18e7338 Optimize repository query and requirements analysis 2019-07-08 23:28:55 +03:00
allegroai
e40d4f2f41 Add new task status and support for reuse override 2019-07-06 23:02:58 +03:00
allegroai
f2829e1162 Fix, multiple experiments in the same session 2019-07-04 01:21:34 +03:00
allegroai
8475ecaed8 Python 2 support 2019-07-01 22:23:40 +03:00
Allegro AI
a6e70f783a
Hot fix, release 2019-06-30 10:53:38 +03:00
allegroai
d27dc352cb Changed, resource monitor prefer sync to iterations, over seconds from beginning of experiment 2019-06-27 23:22:28 +03:00
allegroai
85e783cc6b Add resource monitoring ability machine/gpu 2019-06-24 01:02:41 +03:00
allegroai
a77b470500 Refactored binding, better support for matplotlib jupyter binding 2019-06-20 01:50:40 +03:00
allegroai
77e2c32523 Fix timeout for uploading images 2019-06-19 19:47:12 +03:00
allegroai
675dc32528 Add api.verify_certificate to allow non-verified ssl connection (enterprise firewall mitm scenarios), by defaults only secured connections are allowed. 
Add latest package check, as long as we are in pre-release.
 2019-06-19 15:14:28 +03:00
allegroai
06a716fe8b Remove redundant kwargs 2019-06-15 00:31:28 +03:00
allegroai
36c5b2c648 Fix Windows support 2019-06-14 15:10:46 +03:00
allegroai
4ed33474fe Orderly shutdown threads 2019-06-14 01:04:42 +03:00
allegroai
cf1914fa64 Add better signal/exception binding 2019-06-13 01:56:21 +03:00
allegroai
92b8298697 bugfix, remote task stop from web-app 2019-06-11 14:39:18 +03:00
allegroai
f595afe6c8 Initial beta version 2019-06-10 20:02:11 +03:00