Commit Graph

119 Commits

Author SHA1 Message Date
allegroai
d642639890 Add fastai binding support 2020-07-11 01:29:29 +03:00
allegroai
8af97dbab1 Add Task export_task / import_task / update_task (Issue #128) 2020-07-06 21:03:12 +03:00
allegroai
934771184d Fix git diff larger than 500kb , git section will contain warning, and entire git diff will be uploaded as artifact named auxiliary_git_diff 2020-07-04 22:53:26 +03:00
allegroai
d1744785b1 flake8 2020-07-04 22:52:09 +03:00
allegroai
b07a17890d Add task.upload_artifact auto_pickle=True #153
Fix multiple argparse calls before task.init
Add mark_started force argument #159
2020-07-02 01:28:15 +03:00
allegroai
f3621feabb Allow Task.get_tasks() to filter by list of project ids 2020-06-21 23:31:14 +03:00
allegroai
2004b64a5b Change Task.wait_for_status() defaults & Add TrainsJob.is_failed() 2020-06-18 01:08:54 +03:00
H4dr1en
547f69da4b
Add task.wait_for_status() 2020-06-15 15:19:58 +02:00
allegroai
7173a16a16 Update docstrings 2020-06-11 21:15:40 +03:00
allegroai
2089dde55a Add Task.running_locally() and Task.execute_remotely() 2020-05-31 12:13:54 +03:00
allegroai
dcd16abd3b Add new task types and support for Server API version 2.8 2020-05-31 12:11:48 +03:00
allegroai
b865fc0072 If sys.argv doesn't point into a git repo, take file calling Task.init(). Support running code from a module (i.e. -m module) 2020-05-31 12:05:09 +03:00
allegroai
9259e4efeb Fix type hints, add ignore/fix pep8 warnings 2020-05-31 11:59:05 +03:00
allegroai
0a0d816bd5 Update docstring 2020-05-25 20:41:15 +03:00
allegroai
96f899d028 Fix documentation and layout (PEP8) 2020-05-24 08:16:12 +03:00
allegroai
70cdb13252 Support Task.get_task() without project name (i.e. all projects) 2020-05-24 08:10:47 +03:00
allegroai
95105cbe6a Add automation support including hyper-parameters optimization 2020-05-22 12:00:07 +03:00
allegroai
03bf764dc7 Make sure Task.close() will wait for repository package analysis (timeout 5 minutes) 2020-05-22 11:04:12 +03:00
allegroai
d48fa33744 Improve task reuse by completely clearing the task when reusing (more efficient than multiple edit/reload calls) 2020-05-22 10:45:46 +03:00
allegroai
2d22efcead Fix TaskTypes/TaskStatusEnum Enum comparison 2020-05-22 10:30:06 +03:00
allegroai
3491646ea9 Fix Task.enqueue() to use an exact queue name match 2020-05-22 10:17:17 +03:00
allegroai
cb8887da72 Task.init argument auto_connect_arg_parser can accept a dictionary disabling specific keys from the argparser 2020-05-13 20:42:33 +03:00
allegroai
966cd6118a Add Model and Task type-annotations 2020-05-08 22:08:48 +03:00
allegroai
f90f8f06e2 Fix Task.get_tasks() return type to Task 2020-05-08 22:07:43 +03:00
allegroai
3de95063ee Remove auto_connect_arg_parser constraint when ArgumentParser.parse_arg() is used before initializing task 2020-05-08 21:33:54 +03:00
allegroai
3d9683f290 Fix logger creation guard 2020-04-28 10:44:40 +03:00
allegroai
7dc27b9a5e Rename utilities dir 2020-04-28 10:43:47 +03:00
allegroai
302a8cbf75 Report memory usage only for the experiment process (and sub-processes) 2020-04-26 23:16:13 +03:00
allegroai
215aa32239 Detect exception in debugger session, set Task to Failed 2020-04-16 16:43:10 +03:00
allegroai
4b9c5c235c Update docstrings 2020-04-13 18:58:39 +03:00
allegroai
3ac7dbdb49 Refactor shutdown sequence 2020-04-09 13:10:29 +03:00
allegroai
d9aa83380f Stop resource monitoring before signaling task stop 2020-04-09 13:07:26 +03:00
allegroai
ab263bb59f Raise ValueError if Task.get_logger() is called after task was closed 2020-04-09 13:06:06 +03:00
allegroai
7f00e45d6c Do not recreate logger after Task was closed/exited 2020-04-09 12:59:00 +03:00
allegroai
aa737e6b5b Make sure task is marked as started in remote execution (just in case) 2020-04-09 12:53:43 +03:00
allegroai
2f395cc76b Use sub-process fork signal hooks instead of os._exit patch 2020-04-09 12:50:04 +03:00
allegroai
9a0a84a83e Do not wait for logs if we are aborting the task manually (i.e. ctrl-C) 2020-04-09 12:41:10 +03:00
allegroai
98ce0bbe43 Change TaskHandler.close() wait default to False as it should not wait for logs to flush 2020-04-09 12:39:09 +03:00
allegroai
b3c9872a3f Intercept SystemExit and do nothing so we could kill the thread 2020-04-09 12:33:16 +03:00
allegroai
337e60a376 Kill repo/package detection thread on exit 2020-04-09 12:28:57 +03:00
allegroai
b2c2002c40 Create dev task manually when constructing the Task 2020-04-09 12:27:13 +03:00
allegroai
07daf8f5e6 Fix logger sometimes getting stuck at end of experiment 2020-04-09 12:05:56 +03:00
allegroai
172ed62d41 Add Task.get_tasks() filtering support 2020-04-01 18:54:16 +03:00
allegroai
c4719f2e2f Add type annotations and fix docstrings 2020-03-23 23:26:46 +02:00
allegroai
766c8ab24f Add Task.models property 2020-03-23 23:25:55 +02:00
allegroai
0211d233d4 Deprecate Task.set_model_config(), Task.get_model_config_text() and Task.get_model_config_dict() 2020-03-23 23:25:16 +02:00
allegroai
023f1721c1 Add Task.get_models() retrieving stored models on previously executed tasks 2020-03-22 18:19:07 +02:00
allegroai
babaf9f1ce Add OpenMPI/Slurm support 2020-03-20 10:23:00 +02:00
allegroai
0adbd79975 Fix StorageHelper upload on shutdown 2020-03-20 10:20:44 +02:00
allegroai
afad6a42ea Add initial slurm support (multiple nodes sharing the same task id) 2020-03-12 18:12:16 +02:00