Commit Graph

111 Commits

Author SHA1 Message Date
allegroai
7173a16a16 Update docstrings 2020-06-11 21:15:40 +03:00
allegroai
feb82c30a7 Allow providing alternate model ID when getting an output model 2020-06-11 15:07:25 +03:00
H4dr1en
91fbc1cf87
Add set_parent method to Tasks 2020-06-09 11:17:42 +02:00
allegroai
2066d9ff9d Fix type-hints and docstrings 2020-06-01 11:00:42 +03:00
allegroai
2089dde55a Add Task.running_locally() and Task.execute_remotely() 2020-05-31 12:13:54 +03:00
allegroai
dcd16abd3b Add new task types and support for Server API version 2.8 2020-05-31 12:11:48 +03:00
allegroai
b865fc0072 If sys.argv doesn't point into a git repo, take file calling Task.init(). Support running code from a module (i.e. -m module) 2020-05-31 12:05:09 +03:00
allegroai
7440799bb0 Remove deprecated function call StorageHelper._test_bucket_config() 2020-05-31 11:55:58 +03:00
allegroai
96f899d028 Fix documentation and layout (PEP8) 2020-05-24 08:16:12 +03:00
allegroai
91bc4b92cd Limit max requirement size to 0.5mb 2020-05-22 11:02:52 +03:00
allegroai
d48fa33744 Improve task reuse by completely clearing the task when reusing (more efficient than multiple edit/reload calls) 2020-05-22 10:45:46 +03:00
allegroai
0e2265a9ca Add Task.add_requirements() to force requirement package into "installed packages" 2020-05-22 10:35:27 +03:00
allegroai
072abfd6fd Add Task.get_reported_console_output() and Task.get_reported_scalars() 2020-05-22 10:34:45 +03:00
allegroai
2d22efcead Fix TaskTypes/TaskStatusEnum Enum comparison 2020-05-22 10:30:06 +03:00
allegroai
cb8887da72 Task.init argument auto_connect_arg_parser can accept a dictionary disabling specific keys from the argparser 2020-05-13 20:42:33 +03:00
allegroai
d2c9523769 Fix Task.get_task raise proper error on incorrect task_id 2020-05-13 20:35:13 +03:00
allegroai
19a24c4b20 Fix default argument behavior to match argparse behavior (if value is the same as default, use default value and type) 2020-05-13 20:29:35 +03:00
allegroai
617e5f7c1d Improve Jupyter support by ignoring IPython directives in converted python script (like % and ! lines) 2020-04-26 23:13:00 +03:00
allegroai
d9f2f01bbd Make sure trains is included in Jupyter requirements 2020-04-26 23:11:51 +03:00
allegroai
9726f782f2 Add requirement parsing optimization using entry point by default 2020-04-26 22:58:13 +03:00
allegroai
7e4fba9d10 Fix scikit-learn module detection 2020-04-26 22:54:49 +03:00
allegroai
13ce783fa3 Check for updates based on session version 2020-04-26 22:53:18 +03:00
allegroai
4eaa77dbdb Fix single log request exceeds max packet size, set limit to 1MB per request 2020-04-16 16:41:18 +03:00
allegroai
4b9c5c235c Update docstrings 2020-04-13 18:58:39 +03:00
allegroai
7dae058359 Optimize locking for TaskHandler, avoid lock when shutting down 2020-04-09 13:08:46 +03:00
allegroai
5eb4ae6600 Use a daemon thread for the log 2020-04-09 12:56:55 +03:00
allegroai
1b901b7d13 Fix logger in case a packet was dropped before it was overwritten 2020-04-09 12:56:02 +03:00
allegroai
f61cbdeb39 Check if join was successful when waiting for std flush pool 2020-04-09 12:51:34 +03:00
allegroai
9916c93ce0 Add 10sec timeout for stdout/stderr flush at end of process 2020-04-09 12:46:30 +03:00
allegroai
23bd6097a8 Add nicer stdout log flush 2020-04-09 12:42:45 +03:00
allegroai
98ce0bbe43 Change TaskHandler.close() wait default to False as it should not wait for logs to flush 2020-04-09 12:39:09 +03:00
allegroai
b3c9872a3f Intercept SystemExit and do nothing so we could kill the thread 2020-04-09 12:33:16 +03:00
allegroai
b2c2002c40 Create dev task manually when constructing the Task 2020-04-09 12:27:13 +03:00
allegroai
11420adce7 Log reports at the end of the task 2020-04-09 12:24:37 +03:00
allegroai
101e5393d1 Fix TRAINS_VCS_ROOT path conversion 2020-04-01 19:06:30 +03:00
allegroai
01772430d6 Ignore virtual-environment folder that might be inside the project's directory 2020-04-01 19:02:54 +03:00
allegroai
023f1721c1 Add Task.get_models() retrieving stored models on previously executed tasks 2020-03-22 18:19:07 +02:00
allegroai
afad6a42ea Add initial slurm support (multiple nodes sharing the same task id) 2020-03-12 18:12:16 +02:00
allegroai
b3dff9a4eb Support setting task initial iteration for continuing previous runs 2020-03-12 17:40:29 +02:00
allegroai
5bc39271e3 Fix store uncommitted code configuration option 2020-03-12 17:17:39 +02:00
allegroai
9e0ea880ce Add missing import 2020-03-08 18:56:28 +02:00
allegroai
4bca5ccf27 Always reload task section before editing parts of it 2020-03-05 12:11:55 +02:00
allegroai
a2ecb2c75d Only use file based locks for main task. Secondary tasks use traditional multiprocessing lock 2020-03-05 12:10:23 +02:00
allegroai
da804ca75f Add support for Popen subprocesses with task edit protection from multiple processes 2020-03-05 12:05:12 +02:00
allegroai
e3ae4f4e26 Optimize task refresh while pulling task status in local worker and last iteration for Resource Monitoring 2020-03-05 11:40:27 +02:00
Karthikeyan Singaravelan
a97850e5b6 Import ABC from collections.abc instead of collections for Python 3.9 compatibility. 2020-03-03 21:38:03 +05:30
allegroai
146da439e7 Integrate pigar into Trains 2020-03-01 17:12:28 +02:00
allegroai
8ee2bd1844 Retry sending console logs if session.send() fails (applicable only in local mode where we use the logging handler) 2020-02-26 17:07:07 +02:00
allegroai
3ea570cadf Store python binary along with major.minor version in task script section 2020-02-18 11:24:04 +02:00
allegroai
63ffc09ae0 Fix incorrect upgrade message 2020-02-12 14:03:24 +02:00