allegroai
|
dcd16abd3b
|
Add new task types and support for Server API version 2.8
|
2020-05-31 12:11:48 +03:00 |
|
allegroai
|
b865fc0072
|
If sys.argv doesn't point into a git repo, take file calling Task.init(). Support running code from a module (i.e. -m module)
|
2020-05-31 12:05:09 +03:00 |
|
allegroai
|
7b3a554fe9
|
Fix exact_match_regex() in case of empty pattern
|
2020-05-31 12:01:03 +03:00 |
|
allegroai
|
7440799bb0
|
Remove deprecated function call StorageHelper._test_bucket_config()
|
2020-05-31 11:55:58 +03:00 |
|
allegroai
|
96f899d028
|
Fix documentation and layout (PEP8)
|
2020-05-24 08:16:12 +03:00 |
|
allegroai
|
7ad4ec2314
|
Add extra_layout argument for all loggers, setting layout configuration for plotly objects
|
2020-05-24 08:09:33 +03:00 |
|
allegroai
|
b457b9aaad
|
Fix archive support: StorageManager should only try to extract .zip files, Model should not auto extract package
|
2020-05-22 11:54:46 +03:00 |
|
allegroai
|
91bc4b92cd
|
Limit max requirement size to 0.5mb
|
2020-05-22 11:02:52 +03:00 |
|
allegroai
|
88cddcfe1d
|
Add raise_on_error (default=False) argument to Model.get_local_copy()
|
2020-05-22 11:00:17 +03:00 |
|
allegroai
|
163f0c8587
|
Add utilities.attrs using attr<19.2 flags, supporting attr>=19.2 with no deprecation warnings
|
2020-05-22 10:53:13 +03:00 |
|
allegroai
|
d48fa33744
|
Improve task reuse by completely clearing the task when reusing (more efficient than multiple edit/reload calls)
|
2020-05-22 10:45:46 +03:00 |
|
allegroai
|
0e2265a9ca
|
Add Task.add_requirements() to force requirement package into "installed packages"
|
2020-05-22 10:35:27 +03:00 |
|
allegroai
|
072abfd6fd
|
Add Task.get_reported_console_output() and Task.get_reported_scalars()
|
2020-05-22 10:34:45 +03:00 |
|
allegroai
|
2d22efcead
|
Fix TaskTypes/TaskStatusEnum Enum comparison
|
2020-05-22 10:30:06 +03:00 |
|
Elijah Rippeth
|
59874b1620
|
address DeprecationWarning
Fixes DeprecationWarning: The usage of `cmp` is deprecated and will be removed on or after 2021-06-01. Please use `eq` and `order` instead.
|
2020-05-15 21:57:42 -04:00 |
|
allegroai
|
cb8887da72
|
Task.init argument auto_connect_arg_parser can accept a dictionary disabling specific keys from the argparser
|
2020-05-13 20:42:33 +03:00 |
|
allegroai
|
d2c9523769
|
Fix Task.get_task raise proper error on incorrect task_id
|
2020-05-13 20:35:13 +03:00 |
|
allegroai
|
19a24c4b20
|
Fix default argument behavior to match argparse behavior (if value is the same as default, use default value and type)
|
2020-05-13 20:29:35 +03:00 |
|
allegroai
|
a5ff2ba9c8
|
Add Logger histogram mode (stack/group/relative)
|
2020-05-08 22:05:33 +03:00 |
|
allegroai
|
6991e06e14
|
Fix RGBA upload with default JPEG files
|
2020-05-08 21:30:02 +03:00 |
|
allegroai
|
031d26a6cf
|
Support '#' and '?' in image names
|
2020-05-08 21:28:48 +03:00 |
|
allegroai
|
6746144803
|
Use UID in message if user name cannot be retrieved
|
2020-04-26 23:22:46 +03:00 |
|
allegroai
|
6ff3cc0ee4
|
Fix duplicate suffix for artifacts
|
2020-04-26 23:17:51 +03:00 |
|
allegroai
|
617e5f7c1d
|
Improve Jupyter support by ignoring IPython directives in converted python script (like % and ! lines)
|
2020-04-26 23:13:00 +03:00 |
|
allegroai
|
d9f2f01bbd
|
Make sure trains is included in Jupyter requirements
|
2020-04-26 23:11:51 +03:00 |
|
allegroai
|
9726f782f2
|
Add requirement parsing optimization using entry point by default
|
2020-04-26 22:58:13 +03:00 |
|
allegroai
|
7e4fba9d10
|
Fix scikit-learn module detection
|
2020-04-26 22:54:49 +03:00 |
|
allegroai
|
13ce783fa3
|
Check for updates based on session version
|
2020-04-26 22:53:18 +03:00 |
|
allegroai
|
466b2859d9
|
Upload debug assets with series / title including dot or slash did not add iteration index to the filename
|
2020-04-16 16:49:21 +03:00 |
|
allegroai
|
4eaa77dbdb
|
Fix single log request exceeds max packet size, set limit to 1MB per request
|
2020-04-16 16:41:18 +03:00 |
|
allegroai
|
4b9c5c235c
|
Update docstrings
|
2020-04-13 18:58:39 +03:00 |
|
allegroai
|
648779380c
|
Add media (audio) support for both Logger and Tensorboard bind
|
2020-04-09 13:14:14 +03:00 |
|
allegroai
|
7dae058359
|
Optimize locking for TaskHandler, avoid lock when shutting down
|
2020-04-09 13:08:46 +03:00 |
|
allegroai
|
5eb4ae6600
|
Use a daemon thread for the log
|
2020-04-09 12:56:55 +03:00 |
|
allegroai
|
1b901b7d13
|
Fix logger in case a packet was dropped before it was overwritten
|
2020-04-09 12:56:02 +03:00 |
|
allegroai
|
f61cbdeb39
|
Check if join was successful when waiting for std flush pool
|
2020-04-09 12:51:34 +03:00 |
|
allegroai
|
004f925454
|
ThreadPool should be terminated, not closed, otherwise it might hang
|
2020-04-09 12:47:38 +03:00 |
|
allegroai
|
9916c93ce0
|
Add 10sec timeout for stdout/stderr flush at end of process
|
2020-04-09 12:46:30 +03:00 |
|
allegroai
|
23bd6097a8
|
Add nicer stdout log flush
|
2020-04-09 12:42:45 +03:00 |
|
allegroai
|
98ce0bbe43
|
Change TaskHandler.close() wait default to False as it should not wait for logs to flush
|
2020-04-09 12:39:09 +03:00 |
|
allegroai
|
b3c9872a3f
|
Intercept SystemExit and do nothing so we could kill the thread
|
2020-04-09 12:33:16 +03:00 |
|
allegroai
|
5ec4d80493
|
Disconnect stdout/stderr logger on exit
|
2020-04-09 12:31:43 +03:00 |
|
allegroai
|
b2c2002c40
|
Create dev task manually when constructing the Task
|
2020-04-09 12:27:13 +03:00 |
|
allegroai
|
11420adce7
|
Log reports at the end of the task
|
2020-04-09 12:24:37 +03:00 |
|
allegroai
|
07daf8f5e6
|
Fix logger sometimes getting stuck at end of experiment
|
2020-04-09 12:05:56 +03:00 |
|
allegroai
|
e6f29428eb
|
Add StorageManager
|
2020-04-09 12:03:41 +03:00 |
|
allegroai
|
e1fc9b3dc8
|
ThreadPool should be terminated, not closed, otherwise it might hang
|
2020-04-09 11:39:03 +03:00 |
|
allegroai
|
101e5393d1
|
Fix TRAINS_VCS_ROOT path conversion
|
2020-04-01 19:06:30 +03:00 |
|
allegroai
|
01772430d6
|
Ignore virtual-environment folder that might be inside the project's directory
|
2020-04-01 19:02:54 +03:00 |
|
allegroai
|
023f1721c1
|
Add Task.get_models() retrieving stored models on previously executed tasks
|
2020-03-22 18:19:07 +02:00 |
|
allegroai
|
63507c82f7
|
Fix Model.download_model_weights() to reuse previously downloaded file
|
2020-03-22 18:11:30 +02:00 |
|
allegroai
|
477665ee33
|
Fix storage_uri handling in Model.update()
|
2020-03-22 18:05:05 +02:00 |
|
allegroai
|
dc915d0241
|
Fix support for Task init/close multiple times
|
2020-03-20 10:20:06 +02:00 |
|
allegroai
|
afad6a42ea
|
Add initial slurm support (multiple nodes sharing the same task id)
|
2020-03-12 18:12:16 +02:00 |
|
allegroai
|
b3dff9a4eb
|
Support setting task initial iteration for continuing previous runs
|
2020-03-12 17:40:29 +02:00 |
|
allegroai
|
5bc39271e3
|
Fix store uncommitted code configuration option
|
2020-03-12 17:17:39 +02:00 |
|
allegroai
|
30cf6b4834
|
Fix HTTP link quoting in stored links
|
2020-03-12 17:04:31 +02:00 |
|
allegroai
|
98c9a95338
|
Add support for reporting tables
|
2020-03-10 13:30:42 +02:00 |
|
allegroai
|
9e0ea880ce
|
Add missing import
|
2020-03-08 18:56:28 +02:00 |
|
allegroai
|
888c53f67d
|
Allow disabling repository detection when calling Task.init()
|
2020-03-05 12:19:40 +02:00 |
|
allegroai
|
4bca5ccf27
|
Always reload task section before editing parts of it
|
2020-03-05 12:11:55 +02:00 |
|
allegroai
|
a2ecb2c75d
|
Only use file based locks for main task. Secondary tasks use traditional multiprocessing lock
|
2020-03-05 12:10:23 +02:00 |
|
allegroai
|
da804ca75f
|
Add support for Popen subprocesses with task edit protection from multiple processes
|
2020-03-05 12:05:12 +02:00 |
|
allegroai
|
e3ae4f4e26
|
Optimize task refresh while pulling task status in local worker and last iteration for Resource Monitoring
|
2020-03-05 11:40:27 +02:00 |
|
Karthikeyan Singaravelan
|
a97850e5b6
|
Import ABC from collections.abc instead of collections for Python 3.9 compatibility.
|
2020-03-03 21:38:03 +05:30 |
|
allegroai
|
146da439e7
|
Integrate pigar into Trains
|
2020-03-01 17:12:28 +02:00 |
|
allegroai
|
8ee2bd1844
|
Retry sending console logs if session.send() fails (applicable only in local mode where we use the logging handler)
|
2020-02-26 17:07:07 +02:00 |
|
allegroai
|
3ea570cadf
|
Store python binary along with major.minor version in task script section
|
2020-02-18 11:24:04 +02:00 |
|
allegroai
|
63ffc09ae0
|
Fix incorrect upgrade message
|
2020-02-12 14:03:24 +02:00 |
|
allegroai
|
0bc71fbcf4
|
Remove title/series naming restrictions (allow '$' and '.')
|
2020-02-10 10:30:57 +02:00 |
|
allegroai
|
3ee70beea2
|
Fix URL for uploaded files with '%' in their name to allow proper unquote during HTTP serving
|
2020-02-10 10:30:57 +02:00 |
|
allegroai
|
c6849985ea
|
Add Task.set_base_docer() and Task.get_base_docker()
|
2020-02-10 10:30:57 +02:00 |
|
allegroai
|
8c2b36968b
|
Prefer tensorflow_gpu over tensorflow when inspecting installed packages
|
2020-02-04 18:00:39 +02:00 |
|
allegroai
|
7b9e7406ad
|
Fix mutually_exclusive() use of at_least_one()
|
2020-01-27 15:41:19 +02:00 |
|
allegroai
|
9f8e814ca6
|
Support git repositories without ".git" suffix
|
2020-01-27 15:41:19 +02:00 |
|
allegroai
|
923e45bb17
|
Allow reporting a pre-uploaded image url in Logger.report_image using the url parameter
|
2020-01-26 15:29:35 +02:00 |
|
allegroai
|
d03311764e
|
Fix None type as default value in dictionary
|
2020-01-22 11:08:06 +02:00 |
|
allegroai
|
b50bfd5b63
|
Fix default argparser value handling when value is None
|
2020-01-22 11:06:52 +02:00 |
|
allegroai
|
af0b8f4c70
|
Fix type check in hyper-parameters argparser integration
|
2020-01-22 11:03:56 +02:00 |
|
allegroai
|
1cc0ea6cf3
|
Fix logs, events and jupyter flushing on exit
|
2020-01-21 16:41:01 +02:00 |
|
allegroai
|
c5dd762d9b
|
Improve conda support
|
2020-01-21 16:32:57 +02:00 |
|
allegroai
|
66b251a62b
|
Try to make sure tensorboard is available when using torch
|
2020-01-13 11:55:55 +02:00 |
|
allegroai
|
f65ef3e757
|
Support broken Jupyter version on some conda installations (SageMaker)
|
2020-01-10 13:33:19 +02:00 |
|
allegroai
|
7820e0d14a
|
Use an environment variable for setting a default docker image
|
2020-01-06 17:09:45 +02:00 |
|
allegroai
|
7b7b6e487e
|
Fix argparser/subparser support and support unsynced connected hyper parameters in remote execution
|
2020-01-06 17:08:03 +02:00 |
|
allegroai
|
54ae340ccb
|
Use source task id to determine cloned task parent
|
2020-01-02 12:01:03 +02:00 |
|
allegroai
|
4e0f711e39
|
Keep only the input artifacts when cloning a task
|
2019-12-21 18:30:24 +02:00 |
|
allegroai
|
a992591f3c
|
Fix artifacts update in auxiliary task
|
2019-12-15 00:10:12 +02:00 |
|
allegroai
|
7e7329f7a0
|
Improve argparser automagic support
|
2019-11-28 00:49:19 +02:00 |
|
allegroai
|
e1a640d37a
|
Fix support for older git versions (<2)
|
2019-11-23 01:25:37 +02:00 |
|
allegroai
|
15683b5b43
|
Fix support for auto package detection for standalone scripts
|
2019-11-15 21:59:50 +02:00 |
|
allegroai
|
b37aea1839
|
Add Task name and comment setter
|
2019-11-15 21:59:24 +02:00 |
|
allegroai
|
9362831269
|
Add sdk.metric.matplotlib_untitled_history_size to limit number of untitled matplotlib plots (default: 100)
|
2019-11-08 22:29:36 +02:00 |
|
allegroai
|
1bfee56977
|
Improve Windows support
|
2019-11-08 22:28:13 +02:00 |
|
allegroai
|
00e66b5d63
|
Add missing x/y/z axis titles to various logger report
Changed report_surface arguments
|
2019-10-27 00:32:05 +03:00 |
|
allegroai
|
2104c3ec6b
|
Add trains-server new capabilities support
|
2019-10-25 15:15:22 +03:00 |
|
allegroai
|
cb3167bdd8
|
Add x/y/z title for scatter 2d/3d plots
|
2019-10-25 15:11:26 +03:00 |
|
allegroai
|
1a658e9d89
|
Fix output_uri support for local folders
|
2019-10-15 22:35:37 +03:00 |
|
allegroai
|
e0e6d9159b
|
Fix python 2.7 and Windows support
|
2019-10-10 21:10:51 +03:00 |
|
allegroai
|
c1bcce9692
|
Retry suppression
|
2019-10-10 21:10:18 +03:00 |
|