allegroai
fae11edf1b
Fix NaN in plotly plots (matplotlib conversion)
...
Add sdk.metrics.plot_max_num_digits to limit the number of digits in a plot (reduce plot sizes)
2020-09-05 16:28:24 +03:00
allegroai
4c77cd1479
Rename Task.reporter to Task._reporter (deprecated)
2020-09-01 17:47:40 +03:00
allegroai
fd165f7126
Fix docstrings
2020-09-01 17:44:26 +03:00
allegroai
e1bbc03001
Fix artifact upload to only use file stream when not uploading locally stored file. Multi-part upload is not supported on stream upload.
2020-08-23 01:06:20 +03:00
allegroai
b054ba4088
No offline mode when running remotely
2020-08-23 01:05:18 +03:00
allegroai
ce483521ef
Fix Task.get_reported_console_output() for new API v2.9
2020-08-18 11:52:31 +03:00
allegroai
73bd8c2714
Add FastAI example, disable binding if tensorboard is loaded (assume TensorBoradLogger will be used)
2020-08-10 08:01:03 +03:00
allegroai
4628b5eb82
Fix and improve signal handling (disable edit lock on signal callbacks, call before releasing the STD patch)
2020-08-10 07:57:26 +03:00
allegroai
0704cf0c8e
Fix task.connect() dictionary to update the section (not override it) just like in API < 2.9
2020-08-08 12:53:54 +03:00
allegroai
5fc641afc6
Chang default legacy section name to 'Args'
...
Fix generated config file comment
2020-08-08 12:51:29 +03:00
allegroai
65003a168a
Fix hyper-parameter legacy mode (type=='legacy')
...
Add type/description to TF_DEFINES
Cast hyper-parameters to string (if not None)
2020-08-08 12:48:23 +03:00
allegroai
de61dbf54e
Fix offline mode to support python3.5
2020-08-08 12:47:08 +03:00
allegroai
ef83a648eb
Support Task get_model_config/set_model_config legacy model configuration interface
2020-08-08 12:38:46 +03:00
allegroai
f4f53902ed
Add sdk.development.log_os_environments to match TRAINS_LOG_ENVIRONMENT
...
Support logging OS environments into Environment section
2020-08-08 12:37:42 +03:00
allegroai
e378de1e41
Add multi configuration section support (hyperparams and configurations)
...
Support setting offline mode API version using TRAINS_OFFLINE_MODE env var
2020-08-08 12:35:03 +03:00
allegroai
6dca60aef2
Fix duplicate argument
2020-07-30 15:15:21 +03:00
allegroai
619be3dc75
Fix requirements detection:
...
- multiple -e packages were not detected (only the first one)
- trains installed from git + running with trains in python path resulted in double entry of trains
- Do not add -e to packages installed from git repositories, Trains-Agent doesn't like it
2020-07-30 15:12:46 +03:00
allegroai
1d277d01d3
Fix large git diff preview (artifact auxiliary_git_diff) is a single line per file, add option to control the artifact preview
2020-07-30 15:10:41 +03:00
allegroai
23394a265d
flake8 + change ModuleNotFoundError to ImportError (support py 2.7/3.5)
2020-07-30 15:07:25 +03:00
allegroai
a8d6380696
Add offline support using Task.set_offline() and Task.import_offline_session()
2020-07-30 15:03:22 +03:00
allegroai
2ec5726812
Fix filename too long bug (trains-server #54 )
2020-07-30 14:58:48 +03:00
allegroai
00ccadf591
Fix Task.get_reported_scalars(): do not raise exception, set max_request to 1, retrieve all scalars by default
2020-07-30 14:53:33 +03:00
allegroai
925450c7ef
Add Task.init() argument continue_last_task to continue a previously used Task (issue #160 )
2020-07-14 23:36:03 +03:00
allegroai
79799d3efd
Add logger.report_confusion_matrix arg yaxis_reversed (when True flip the confusion matrix, default False). Issue #165
2020-07-11 01:37:02 +03:00
allegroai
a3c191742b
Add Task.get_projects
2020-07-11 01:34:50 +03:00
allegroai
25fd425bf7
Support requirements detection using pip freeze (development.detect_with_pip_freeze configuration setting)
2020-07-11 01:31:47 +03:00
allegroai
8af97dbab1
Add Task export_task / import_task / update_task (Issue #128 )
2020-07-06 21:03:12 +03:00
allegroai
df143f1b4e
Fix add UTC to time stamp in comment #152
2020-07-06 21:00:47 +03:00
allegroai
2f5b519cd8
Tensorboard text logging report as debug samples (.txt files), instead of as console output.
2020-07-04 22:55:29 +03:00
allegroai
934771184d
Fix git diff larger than 500kb , git section will contain warning, and entire git diff will be uploaded as artifact named auxiliary_git_diff
2020-07-04 22:53:26 +03:00
allegroai
d1744785b1
flake8
2020-07-04 22:52:09 +03:00
allegroai
87f7b5d50f
Fix limit git diff to 500kb
2020-07-02 01:28:15 +03:00
allegroai
59b78b288e
Add TRAINS_SUPPRESS_UPDATE_MESSAGE #157
2020-07-02 01:28:15 +03:00
allegroai
575f391ba7
Fix ssh://user@domain@server.com/ in git repo link (Issue #149 )
2020-06-20 22:15:08 +03:00
allegroai
d2d3e595af
Fix incorrect entry point detection when called from Trains wrapper (such as TrainsLogger Ignite/Lightning)
2020-06-19 20:51:46 +03:00
allegroai
20a9f0997d
Add direct plotly figure reporting (see issue #136 )
2020-06-14 00:01:30 +03:00
allegroai
8a5f6b7d02
Fix Google CoLab code/package detection
2020-06-13 22:12:28 +03:00
allegroai
a5b1ed0330
Improve matplotlib integration, issue #140
2020-06-13 22:09:45 +03:00
allegroai
7173a16a16
Update docstrings
2020-06-11 21:15:40 +03:00
allegroai
feb82c30a7
Allow providing alternate model ID when getting an output model
2020-06-11 15:07:25 +03:00
H4dr1en
91fbc1cf87
Add set_parent method to Tasks
2020-06-09 11:17:42 +02:00
allegroai
2066d9ff9d
Fix type-hints and docstrings
2020-06-01 11:00:42 +03:00
allegroai
2089dde55a
Add Task.running_locally() and Task.execute_remotely()
2020-05-31 12:13:54 +03:00
allegroai
dcd16abd3b
Add new task types and support for Server API version 2.8
2020-05-31 12:11:48 +03:00
allegroai
b865fc0072
If sys.argv doesn't point into a git repo, take file calling Task.init(). Support running code from a module (i.e. -m module)
2020-05-31 12:05:09 +03:00
allegroai
7b3a554fe9
Fix exact_match_regex() in case of empty pattern
2020-05-31 12:01:03 +03:00
allegroai
7440799bb0
Remove deprecated function call StorageHelper._test_bucket_config()
2020-05-31 11:55:58 +03:00
allegroai
96f899d028
Fix documentation and layout (PEP8)
2020-05-24 08:16:12 +03:00
allegroai
7ad4ec2314
Add extra_layout argument for all loggers, setting layout configuration for plotly objects
2020-05-24 08:09:33 +03:00
allegroai
b457b9aaad
Fix archive support: StorageManager should only try to extract .zip files, Model should not auto extract package
2020-05-22 11:54:46 +03:00
allegroai
91bc4b92cd
Limit max requirement size to 0.5mb
2020-05-22 11:02:52 +03:00
allegroai
88cddcfe1d
Add raise_on_error (default=False) argument to Model.get_local_copy()
2020-05-22 11:00:17 +03:00
allegroai
163f0c8587
Add utilities.attrs using attr<19.2 flags, supporting attr>=19.2 with no deprecation warnings
2020-05-22 10:53:13 +03:00
allegroai
d48fa33744
Improve task reuse by completely clearing the task when reusing (more efficient than multiple edit/reload calls)
2020-05-22 10:45:46 +03:00
allegroai
0e2265a9ca
Add Task.add_requirements() to force requirement package into "installed packages"
2020-05-22 10:35:27 +03:00
allegroai
072abfd6fd
Add Task.get_reported_console_output() and Task.get_reported_scalars()
2020-05-22 10:34:45 +03:00
allegroai
2d22efcead
Fix TaskTypes/TaskStatusEnum Enum comparison
2020-05-22 10:30:06 +03:00
Elijah Rippeth
59874b1620
address DeprecationWarning
...
Fixes DeprecationWarning: The usage of `cmp` is deprecated and will be removed on or after 2021-06-01. Please use `eq` and `order` instead.
2020-05-15 21:57:42 -04:00
allegroai
cb8887da72
Task.init argument auto_connect_arg_parser can accept a dictionary disabling specific keys from the argparser
2020-05-13 20:42:33 +03:00
allegroai
d2c9523769
Fix Task.get_task raise proper error on incorrect task_id
2020-05-13 20:35:13 +03:00
allegroai
19a24c4b20
Fix default argument behavior to match argparse behavior (if value is the same as default, use default value and type)
2020-05-13 20:29:35 +03:00
allegroai
a5ff2ba9c8
Add Logger histogram mode (stack/group/relative)
2020-05-08 22:05:33 +03:00
allegroai
6991e06e14
Fix RGBA upload with default JPEG files
2020-05-08 21:30:02 +03:00
allegroai
031d26a6cf
Support '#' and '?' in image names
2020-05-08 21:28:48 +03:00
allegroai
6746144803
Use UID in message if user name cannot be retrieved
2020-04-26 23:22:46 +03:00
allegroai
6ff3cc0ee4
Fix duplicate suffix for artifacts
2020-04-26 23:17:51 +03:00
allegroai
617e5f7c1d
Improve Jupyter support by ignoring IPython directives in converted python script (like % and ! lines)
2020-04-26 23:13:00 +03:00
allegroai
d9f2f01bbd
Make sure trains is included in Jupyter requirements
2020-04-26 23:11:51 +03:00
allegroai
9726f782f2
Add requirement parsing optimization using entry point by default
2020-04-26 22:58:13 +03:00
allegroai
7e4fba9d10
Fix scikit-learn module detection
2020-04-26 22:54:49 +03:00
allegroai
13ce783fa3
Check for updates based on session version
2020-04-26 22:53:18 +03:00
allegroai
466b2859d9
Upload debug assets with series / title including dot or slash did not add iteration index to the filename
2020-04-16 16:49:21 +03:00
allegroai
4eaa77dbdb
Fix single log request exceeds max packet size, set limit to 1MB per request
2020-04-16 16:41:18 +03:00
allegroai
4b9c5c235c
Update docstrings
2020-04-13 18:58:39 +03:00
allegroai
648779380c
Add media (audio) support for both Logger and Tensorboard bind
2020-04-09 13:14:14 +03:00
allegroai
7dae058359
Optimize locking for TaskHandler, avoid lock when shutting down
2020-04-09 13:08:46 +03:00
allegroai
5eb4ae6600
Use a daemon thread for the log
2020-04-09 12:56:55 +03:00
allegroai
1b901b7d13
Fix logger in case a packet was dropped before it was overwritten
2020-04-09 12:56:02 +03:00
allegroai
f61cbdeb39
Check if join was successful when waiting for std flush pool
2020-04-09 12:51:34 +03:00
allegroai
004f925454
ThreadPool should be terminated, not closed, otherwise it might hang
2020-04-09 12:47:38 +03:00
allegroai
9916c93ce0
Add 10sec timeout for stdout/stderr flush at end of process
2020-04-09 12:46:30 +03:00
allegroai
23bd6097a8
Add nicer stdout log flush
2020-04-09 12:42:45 +03:00
allegroai
98ce0bbe43
Change TaskHandler.close() wait default to False as it should not wait for logs to flush
2020-04-09 12:39:09 +03:00
allegroai
b3c9872a3f
Intercept SystemExit and do nothing so we could kill the thread
2020-04-09 12:33:16 +03:00
allegroai
5ec4d80493
Disconnect stdout/stderr logger on exit
2020-04-09 12:31:43 +03:00
allegroai
b2c2002c40
Create dev task manually when constructing the Task
2020-04-09 12:27:13 +03:00
allegroai
11420adce7
Log reports at the end of the task
2020-04-09 12:24:37 +03:00
allegroai
07daf8f5e6
Fix logger sometimes getting stuck at end of experiment
2020-04-09 12:05:56 +03:00
allegroai
e6f29428eb
Add StorageManager
2020-04-09 12:03:41 +03:00
allegroai
e1fc9b3dc8
ThreadPool should be terminated, not closed, otherwise it might hang
2020-04-09 11:39:03 +03:00
allegroai
101e5393d1
Fix TRAINS_VCS_ROOT path conversion
2020-04-01 19:06:30 +03:00
allegroai
01772430d6
Ignore virtual-environment folder that might be inside the project's directory
2020-04-01 19:02:54 +03:00
allegroai
023f1721c1
Add Task.get_models() retrieving stored models on previously executed tasks
2020-03-22 18:19:07 +02:00
allegroai
63507c82f7
Fix Model.download_model_weights() to reuse previously downloaded file
2020-03-22 18:11:30 +02:00
allegroai
477665ee33
Fix storage_uri handling in Model.update()
2020-03-22 18:05:05 +02:00
allegroai
dc915d0241
Fix support for Task init/close multiple times
2020-03-20 10:20:06 +02:00
allegroai
afad6a42ea
Add initial slurm support (multiple nodes sharing the same task id)
2020-03-12 18:12:16 +02:00
allegroai
b3dff9a4eb
Support setting task initial iteration for continuing previous runs
2020-03-12 17:40:29 +02:00
allegroai
5bc39271e3
Fix store uncommitted code configuration option
2020-03-12 17:17:39 +02:00
allegroai
30cf6b4834
Fix HTTP link quoting in stored links
2020-03-12 17:04:31 +02:00
