allegroai
|
95105cbe6a
|
Add automation support including hyper-parameters optimization
|
2020-05-22 12:00:07 +03:00 |
|
allegroai
|
b457b9aaad
|
Fix archive support: StorageManager should only try to extract .zip files, Model should not auto extract package
|
2020-05-22 11:54:46 +03:00 |
|
allegroai
|
2393ac5f7f
|
Add raise_on_error (default=False) argument to Artifat.get_local_copy()
|
2020-05-22 11:13:13 +03:00 |
|
allegroai
|
03bf764dc7
|
Make sure Task.close() will wait for repository package analysis (timeout 5 minutes)
|
2020-05-22 11:04:12 +03:00 |
|
allegroai
|
91bc4b92cd
|
Limit max requirement size to 0.5mb
|
2020-05-22 11:02:52 +03:00 |
|
allegroai
|
11443e20f8
|
Fix report histogram xlabels without labels will add "trace 0" in legend instead of series name
|
2020-05-22 11:01:54 +03:00 |
|
allegroai
|
88cddcfe1d
|
Add raise_on_error (default=False) argument to Model.get_local_copy()
|
2020-05-22 11:00:17 +03:00 |
|
allegroai
|
163f0c8587
|
Add utilities.attrs using attr<19.2 flags, supporting attr>=19.2 with no deprecation warnings
|
2020-05-22 10:53:13 +03:00 |
|
allegroai
|
2848e9190e
|
Fix NaN, Inf and -Inf values in reported table (not supported by JSON)
|
2020-05-22 10:49:49 +03:00 |
|
allegroai
|
d48fa33744
|
Improve task reuse by completely clearing the task when reusing (more efficient than multiple edit/reload calls)
|
2020-05-22 10:45:46 +03:00 |
|
allegroai
|
93fa3bfbbd
|
Add plotly index header
|
2020-05-22 10:36:36 +03:00 |
|
allegroai
|
0e2265a9ca
|
Add Task.add_requirements() to force requirement package into "installed packages"
|
2020-05-22 10:35:27 +03:00 |
|
allegroai
|
072abfd6fd
|
Add Task.get_reported_console_output() and Task.get_reported_scalars()
|
2020-05-22 10:34:45 +03:00 |
|
allegroai
|
2d22efcead
|
Fix TaskTypes/TaskStatusEnum Enum comparison
|
2020-05-22 10:30:06 +03:00 |
|
allegroai
|
63ca84a84f
|
Allow worker_id override using environment variable
|
2020-05-22 10:20:43 +03:00 |
|
allegroai
|
3491646ea9
|
Fix Task.enqueue() to use an exact queue name match
|
2020-05-22 10:17:17 +03:00 |
|
allegroai
|
5c4cfa9643
|
Add StorageManager to trains scope
|
2020-05-22 10:15:02 +03:00 |
|
Elijah Rippeth
|
59874b1620
|
address DeprecationWarning
Fixes DeprecationWarning: The usage of `cmp` is deprecated and will be removed on or after 2021-06-01. Please use `eq` and `order` instead.
|
2020-05-15 21:57:42 -04:00 |
|
allegroai
|
cb8887da72
|
Task.init argument auto_connect_arg_parser can accept a dictionary disabling specific keys from the argparser
|
2020-05-13 20:42:33 +03:00 |
|
allegroai
|
d2c9523769
|
Fix Task.get_task raise proper error on incorrect task_id
|
2020-05-13 20:35:13 +03:00 |
|
allegroai
|
31a78d27d7
|
Ignore plotly custom warnings
|
2020-05-13 20:33:50 +03:00 |
|
allegroai
|
0dec7c0e9e
|
Add Parquet framework and model type
|
2020-05-13 20:32:49 +03:00 |
|
allegroai
|
9130a06210
|
OutputModel with task=None should use current task, if exists
|
2020-05-13 20:31:58 +03:00 |
|
allegroai
|
99f987aafb
|
Fix model package was not recursive when packaging a folder
|
2020-05-13 20:31:31 +03:00 |
|
allegroai
|
19a24c4b20
|
Fix default argument behavior to match argparse behavior (if value is the same as default, use default value and type)
|
2020-05-13 20:29:35 +03:00 |
|
allegroai
|
e1f6e5ec6a
|
Fix typo in warning
|
2020-05-13 20:26:43 +03:00 |
|
allegroai
|
cb6ecb458a
|
Version bump to v0.14.3
|
2020-05-10 09:49:14 +03:00 |
|
allegroai
|
7962b041c0
|
Fix code examples in docstrings
|
2020-05-08 22:16:20 +03:00 |
|
allegroai
|
5d04b21a79
|
Fix upload_object_via_stream() in Azure storage driver
|
2020-05-08 22:13:39 +03:00 |
|
allegroai
|
0298b84030
|
Refactor histogram code for PyTorch Ignite integration
|
2020-05-08 22:12:49 +03:00 |
|
allegroai
|
966cd6118a
|
Add Model and Task type-annotations
|
2020-05-08 22:08:48 +03:00 |
|
allegroai
|
f90f8f06e2
|
Fix Task.get_tasks() return type to Task
|
2020-05-08 22:07:43 +03:00 |
|
allegroai
|
a5ff2ba9c8
|
Add Logger histogram mode (stack/group/relative)
|
2020-05-08 22:05:33 +03:00 |
|
allegroai
|
5a85d40fc7
|
Add Logger type-annotations
|
2020-05-08 21:34:47 +03:00 |
|
allegroai
|
3de95063ee
|
Remove auto_connect_arg_parser constraint when ArgumentParser.parse_arg() is used before initializing task
|
2020-05-08 21:33:54 +03:00 |
|
allegroai
|
8b5377ee4f
|
Add PEP610 support for new pip>=20.1 git reference feature
|
2020-05-08 21:31:34 +03:00 |
|
allegroai
|
6991e06e14
|
Fix RGBA upload with default JPEG files
|
2020-05-08 21:30:02 +03:00 |
|
allegroai
|
031d26a6cf
|
Support '#' and '?' in image names
|
2020-05-08 21:28:48 +03:00 |
|
allegroai
|
3f52a6088a
|
Version bump to v0.14.2
|
2020-04-28 15:32:33 +03:00 |
|
allegroai
|
3d9683f290
|
Fix logger creation guard
|
2020-04-28 10:44:40 +03:00 |
|
allegroai
|
7dc27b9a5e
|
Rename utilities dir
|
2020-04-28 10:43:47 +03:00 |
|
allegroai
|
6746144803
|
Use UID in message if user name cannot be retrieved
|
2020-04-26 23:22:46 +03:00 |
|
allegroai
|
7085a2bb74
|
Report GPU memory usage per process (and sub-process)
|
2020-04-26 23:21:27 +03:00 |
|
allegroai
|
0a7a32f2eb
|
Support caching of extracted zip artifacts
|
2020-04-26 23:19:42 +03:00 |
|
allegroai
|
6ff3cc0ee4
|
Fix duplicate suffix for artifacts
|
2020-04-26 23:17:51 +03:00 |
|
allegroai
|
302a8cbf75
|
Report memory usage only for the experiment process (and sub-processes)
|
2020-04-26 23:16:13 +03:00 |
|
allegroai
|
7e839204d1
|
Raise error in case of missing artifact directory
|
2020-04-26 23:14:33 +03:00 |
|
allegroai
|
617e5f7c1d
|
Improve Jupyter support by ignoring IPython directives in converted python script (like % and ! lines)
|
2020-04-26 23:13:00 +03:00 |
|
allegroai
|
d9f2f01bbd
|
Make sure trains is included in Jupyter requirements
|
2020-04-26 23:11:51 +03:00 |
|
allegroai
|
dbb3346332
|
Improve module requirements detection
|
2020-04-26 23:10:45 +03:00 |
|
allegroai
|
9726f782f2
|
Add requirement parsing optimization using entry point by default
|
2020-04-26 22:58:13 +03:00 |
|
allegroai
|
7e4fba9d10
|
Fix scikit-learn module detection
|
2020-04-26 22:54:49 +03:00 |
|
allegroai
|
13ce783fa3
|
Check for updates based on session version
|
2020-04-26 22:53:18 +03:00 |
|
allegroai
|
466b2859d9
|
Upload debug assets with series / title including dot or slash did not add iteration index to the filename
|
2020-04-16 16:49:21 +03:00 |
|
allegroai
|
f7b80a0da2
|
matplotlib with no logger should not use the last iteration reported by the resource monitor
|
2020-04-16 16:48:19 +03:00 |
|
allegroai
|
cb139f2d17
|
Fix Tensorflow V1/V2 audio support
|
2020-04-16 16:46:02 +03:00 |
|
allegroai
|
215aa32239
|
Detect exception in debugger session, set Task to Failed
|
2020-04-16 16:43:10 +03:00 |
|
allegroai
|
4eaa77dbdb
|
Fix single log request exceeds max packet size, set limit to 1MB per request
|
2020-04-16 16:41:18 +03:00 |
|
allegroai
|
7f4b100042
|
Fix text encoding utf-8 and pr_curve broken in Tensorboard support
|
2020-04-16 16:40:14 +03:00 |
|
allegroai
|
4bb17ca420
|
Fix renaming/deleting model file right after saving will break async upload (trains/issues#123)
|
2020-04-13 19:03:15 +03:00 |
|
allegroai
|
12659307a8
|
Fix update_weights() to use model upload target file when passed
|
2020-04-13 19:00:35 +03:00 |
|
allegroai
|
4b9c5c235c
|
Update docstrings
|
2020-04-13 18:58:39 +03:00 |
|
allegroai
|
648779380c
|
Add media (audio) support for both Logger and Tensorboard bind
|
2020-04-09 13:14:14 +03:00 |
|
allegroai
|
7ac7e088a1
|
Add trace feature
|
2020-04-09 13:12:50 +03:00 |
|
allegroai
|
0df3d38862
|
Fix self references in configuration when environment variables exist
|
2020-04-09 13:11:21 +03:00 |
|
allegroai
|
3ac7dbdb49
|
Refactor shutdown sequence
|
2020-04-09 13:10:29 +03:00 |
|
allegroai
|
7dae058359
|
Optimize locking for TaskHandler, avoid lock when shutting down
|
2020-04-09 13:08:46 +03:00 |
|
allegroai
|
d9aa83380f
|
Stop resource monitoring before signaling task stop
|
2020-04-09 13:07:26 +03:00 |
|
allegroai
|
ab263bb59f
|
Raise ValueError if Task.get_logger() is called after task was closed
|
2020-04-09 13:06:06 +03:00 |
|
allegroai
|
3c4925d605
|
Fix resource monitor and check if task is valid
|
2020-04-09 13:00:24 +03:00 |
|
allegroai
|
7f00e45d6c
|
Do not recreate logger after Task was closed/exited
|
2020-04-09 12:59:00 +03:00 |
|
allegroai
|
3f6fb5379a
|
Revert fork patching as signal is not enough and is not called from forked processes
|
2020-04-09 12:57:50 +03:00 |
|
allegroai
|
5eb4ae6600
|
Use a daemon thread for the log
|
2020-04-09 12:56:55 +03:00 |
|
allegroai
|
1b901b7d13
|
Fix logger in case a packet was dropped before it was overwritten
|
2020-04-09 12:56:02 +03:00 |
|
allegroai
|
aa737e6b5b
|
Make sure task is marked as started in remote execution (just in case)
|
2020-04-09 12:53:43 +03:00 |
|
allegroai
|
f61cbdeb39
|
Check if join was successful when waiting for std flush pool
|
2020-04-09 12:51:34 +03:00 |
|
allegroai
|
2f395cc76b
|
Use sub-process fork signal hooks instead of os._exit patch
|
2020-04-09 12:50:04 +03:00 |
|
allegroai
|
004f925454
|
ThreadPool should be terminated, not closed, otherwise it might hang
|
2020-04-09 12:47:38 +03:00 |
|
allegroai
|
9916c93ce0
|
Add 10sec timeout for stdout/stderr flush at end of process
|
2020-04-09 12:46:30 +03:00 |
|
allegroai
|
1718aa20d4
|
Add thread_waited_join waited join for Thread/Process Pools
|
2020-04-09 12:45:06 +03:00 |
|
allegroai
|
23bd6097a8
|
Add nicer stdout log flush
|
2020-04-09 12:42:45 +03:00 |
|
allegroai
|
9a0a84a83e
|
Do not wait for logs if we are aborting the task manually (i.e. ctrl-C)
|
2020-04-09 12:41:10 +03:00 |
|
allegroai
|
98ce0bbe43
|
Change TaskHandler.close() wait default to False as it should not wait for logs to flush
|
2020-04-09 12:39:09 +03:00 |
|
allegroai
|
b3c9872a3f
|
Intercept SystemExit and do nothing so we could kill the thread
|
2020-04-09 12:33:16 +03:00 |
|
allegroai
|
5ec4d80493
|
Disconnect stdout/stderr logger on exit
|
2020-04-09 12:31:43 +03:00 |
|
allegroai
|
de9c88bc2d
|
Do not try to wait for Lock
|
2020-04-09 12:30:42 +03:00 |
|
allegroai
|
337e60a376
|
Kill repo/package detection thread on exit
|
2020-04-09 12:28:57 +03:00 |
|
allegroai
|
b2c2002c40
|
Create dev task manually when constructing the Task
|
2020-04-09 12:27:13 +03:00 |
|
allegroai
|
11420adce7
|
Log reports at the end of the task
|
2020-04-09 12:24:37 +03:00 |
|
allegroai
|
ffedb219d5
|
Local modules (except trains) imported from a folder inside the git project should not be logged as "local packages", they should be ignored
|
2020-04-09 12:21:37 +03:00 |
|
allegroai
|
07daf8f5e6
|
Fix logger sometimes getting stuck at end of experiment
|
2020-04-09 12:05:56 +03:00 |
|
allegroai
|
e6f29428eb
|
Add StorageManager
|
2020-04-09 12:03:41 +03:00 |
|
allegroai
|
e1fc9b3dc8
|
ThreadPool should be terminated, not closed, otherwise it might hang
|
2020-04-09 11:39:03 +03:00 |
|
allegroai
|
070fd8149a
|
Store the version that matching the Session API so we do not reload every time
|
2020-04-09 11:35:51 +03:00 |
|
allegroai
|
a425a70fc6
|
Add api.ssl_error_count_verbosity and make sure SSL retries are taken care by the session
|
2020-04-09 11:33:55 +03:00 |
|
allegroai
|
101e5393d1
|
Fix TRAINS_VCS_ROOT path conversion
|
2020-04-01 19:06:30 +03:00 |
|
allegroai
|
41ca1a2e49
|
Fix requirements detection to make sure trains is detected even if we execute without actually being installed
|
2020-04-01 19:04:57 +03:00 |
|
allegroai
|
01772430d6
|
Ignore virtual-environment folder that might be inside the project's directory
|
2020-04-01 19:02:54 +03:00 |
|
allegroai
|
6de3d4b6fd
|
Ignore local modules imported from a folder inside the git project
|
2020-04-01 19:01:21 +03:00 |
|
allegroai
|
172ed62d41
|
Add Task.get_tasks() filtering support
|
2020-04-01 18:54:16 +03:00 |
|
allegroai
|
581edf1098
|
Version bump to v0.14.1
|
2020-03-24 20:36:57 +02:00 |
|
allegroai
|
c4719f2e2f
|
Add type annotations and fix docstrings
|
2020-03-23 23:26:46 +02:00 |
|
allegroai
|
766c8ab24f
|
Add Task.models property
|
2020-03-23 23:25:55 +02:00 |
|
allegroai
|
0211d233d4
|
Deprecate Task.set_model_config(), Task.get_model_config_text() and Task.get_model_config_dict()
|
2020-03-23 23:25:16 +02:00 |
|
allegroai
|
023f1721c1
|
Add Task.get_models() retrieving stored models on previously executed tasks
|
2020-03-22 18:19:07 +02:00 |
|
allegroai
|
332e9e2f63
|
Fix Tensorflow direct V2.1 multiple FileWriters
|
2020-03-22 18:17:16 +02:00 |
|
allegroai
|
493cce443a
|
Reuse Model objects if we are storing local files (reduce clutter)
|
2020-03-22 18:15:32 +02:00 |
|
allegroai
|
4e2564cd3a
|
Support reusing Models. Use trains.Model as general purpose registered Model.
|
2020-03-22 18:13:56 +02:00 |
|
allegroai
|
63507c82f7
|
Fix Model.download_model_weights() to reuse previously downloaded file
|
2020-03-22 18:11:30 +02:00 |
|
allegroai
|
477665ee33
|
Fix storage_uri handling in Model.update()
|
2020-03-22 18:05:05 +02:00 |
|
allegroai
|
abc9b512f7
|
Fix logging typos
|
2020-03-22 18:03:25 +02:00 |
|
allegroai
|
7817ef5cda
|
Fix joblib binding
|
2020-03-20 10:30:13 +02:00 |
|
allegroai
|
5db53ba643
|
Support multiple EventWriter in TensorFlow eager mode (TF 2.0+)
|
2020-03-20 10:29:18 +02:00 |
|
allegroai
|
b4050ecf25
|
Fix TensorFlow NaN/Inf values support
|
2020-03-20 10:27:52 +02:00 |
|
allegroai
|
babaf9f1ce
|
Add OpenMPI/Slurm support
|
2020-03-20 10:23:00 +02:00 |
|
allegroai
|
0adbd79975
|
Fix StorageHelper upload on shutdown
|
2020-03-20 10:20:44 +02:00 |
|
allegroai
|
dc915d0241
|
Fix support for Task init/close multiple times
|
2020-03-20 10:20:06 +02:00 |
|
allegroai
|
667ddcab88
|
Fix import for services that do not exist in old versions
|
2020-03-20 10:16:48 +02:00 |
|
allegroai
|
3b1d2d3258
|
Version bump to v0.14.0
|
2020-03-12 19:42:48 +02:00 |
|
allegroai
|
afad6a42ea
|
Add initial slurm support (multiple nodes sharing the same task id)
|
2020-03-12 18:12:16 +02:00 |
|
allegroai
|
5b29aa194c
|
Make sure artifact temporary files names are valid file names
|
2020-03-12 18:10:03 +02:00 |
|
allegroai
|
84a34428b6
|
Add trains-init support for config file env override (as well as argument)
|
2020-03-12 18:09:03 +02:00 |
|
allegroai
|
b3dff9a4eb
|
Support setting task initial iteration for continuing previous runs
|
2020-03-12 17:40:29 +02:00 |
|
allegroai
|
f3531c1af2
|
Allow Task.set_credentials() to override configuration file in dev mode
|
2020-03-12 17:22:09 +02:00 |
|
allegroai
|
5bc39271e3
|
Fix store uncommitted code configuration option
|
2020-03-12 17:17:39 +02:00 |
|
allegroai
|
461fbd9df0
|
Better warning messages for storage errors
|
2020-03-12 17:13:36 +02:00 |
|
allegroai
|
30cf6b4834
|
Fix HTTP link quoting in stored links
|
2020-03-12 17:04:31 +02:00 |
|
allegroai
|
98c9a95338
|
Add support for reporting tables
|
2020-03-10 13:30:42 +02:00 |
|
allegroai
|
9e0ea880ce
|
Add missing import
|
2020-03-08 18:56:28 +02:00 |
|
allegroai
|
b7358d7fef
|
Add portalocker for inter-process lock
|
2020-03-05 12:31:22 +02:00 |
|
allegroai
|
2e3820603a
|
Allow argparser override values with command line even in remote execution (essential for sub-process support)
|
2020-03-05 12:28:36 +02:00 |
|
allegroai
|
1d9e70bd8b
|
Fix signal hooking registeration (cont.)
|
2020-03-05 12:26:56 +02:00 |
|
allegroai
|
181a0be0af
|
Remove temporary file lock at the end of the execution or in Task.close()
|
2020-03-05 12:25:17 +02:00 |
|
allegroai
|
b0c602c832
|
Fix signal hooking registeration
|
2020-03-05 12:24:14 +02:00 |
|
allegroai
|
bcf97afeb9
|
Forking processes should not pass along the original File based Lock
|
2020-03-05 12:22:14 +02:00 |
|
allegroai
|
888c53f67d
|
Allow disabling repository detection when calling Task.init()
|
2020-03-05 12:19:40 +02:00 |
|
allegroai
|
4bca5ccf27
|
Always reload task section before editing parts of it
|
2020-03-05 12:11:55 +02:00 |
|
allegroai
|
a2ecb2c75d
|
Only use file based locks for main task. Secondary tasks use traditional multiprocessing lock
|
2020-03-05 12:10:23 +02:00 |
|
allegroai
|
da804ca75f
|
Add support for Popen subprocesses with task edit protection from multiple processes
|
2020-03-05 12:05:12 +02:00 |
|
allegroai
|
e3ae4f4e26
|
Optimize task refresh while pulling task status in local worker and last iteration for Resource Monitoring
|
2020-03-05 11:40:27 +02:00 |
|
Karthikeyan Singaravelan
|
a97850e5b6
|
Import ABC from collections.abc instead of collections for Python 3.9 compatibility.
|
2020-03-03 21:38:03 +05:30 |
|
allegroai
|
146da439e7
|
Integrate pigar into Trains
|
2020-03-01 17:12:28 +02:00 |
|
allegroai
|
8ee2bd1844
|
Retry sending console logs if session.send() fails (applicable only in local mode where we use the logging handler)
|
2020-02-26 17:07:07 +02:00 |
|
allegroai
|
cf850020fb
|
Don't print empty line at end of process if there's no artifacts summary
|
2020-02-26 17:06:17 +02:00 |
|
allegroai
|
baf5fc9e54
|
version bump to v0.13.3
|
2020-02-23 11:20:21 +02:00 |
|
allegroai
|
8972c1f005
|
Add Task.[get/set]_parameters_as_dict() to allow interaction with non-main task parameters (no need to connect())
|
2020-02-20 18:32:12 +02:00 |
|
allegroai
|
98e6c2004c
|
Use standard os environment variables to obtain default credentials for AWS, Google and Azure
|
2020-02-20 18:29:53 +02:00 |
|
allegroai
|
b5168010e9
|
Make sure Task.connect() returns the same value it is passed
|
2020-02-18 11:26:52 +02:00 |
|
allegroai
|
14588e6dec
|
Refactor utility function
|
2020-02-18 11:25:29 +02:00 |
|
allegroai
|
3ea570cadf
|
Store python binary along with major.minor version in task script section
|
2020-02-18 11:24:04 +02:00 |
|
allegroai
|
9fd3b98b24
|
Fix session error to print the instance host and not the class host
|
2020-02-18 11:23:06 +02:00 |
|
allegroai
|
edc237dad4
|
Improve support for tensorboard.summarywriter.addscalars binding
|
2020-02-18 11:21:47 +02:00 |
|
allegroai
|
f5f13658c3
|
Add binding for tensorboard.summarywriter.addscalars as well as scalars grouping configuration option
|
2020-02-12 14:04:53 +02:00 |
|
allegroai
|
63ffc09ae0
|
Fix incorrect upgrade message
|
2020-02-12 14:03:24 +02:00 |
|
allegroai
|
0bc71fbcf4
|
Remove title/series naming restrictions (allow '$' and '.')
|
2020-02-10 10:30:57 +02:00 |
|
allegroai
|
3ee70beea2
|
Fix URL for uploaded files with '%' in their name to allow proper unquote during HTTP serving
|
2020-02-10 10:30:57 +02:00 |
|
allegroai
|
c6849985ea
|
Add Task.set_base_docer() and Task.get_base_docker()
|
2020-02-10 10:30:57 +02:00 |
|
allegroai
|
8c2b36968b
|
Prefer tensorflow_gpu over tensorflow when inspecting installed packages
|
2020-02-04 18:00:39 +02:00 |
|
allegroai
|
0c71889ca5
|
Fix printout during init
|
2020-02-04 17:59:50 +02:00 |
|
allegroai
|
34d9402abb
|
version bump to v0.13.2
|
2020-01-27 19:45:56 +02:00 |
|
allegroai
|
7b9e7406ad
|
Fix mutually_exclusive() use of at_least_one()
|
2020-01-27 15:41:19 +02:00 |
|
allegroai
|
9f8e814ca6
|
Support git repositories without ".git" suffix
|
2020-01-27 15:41:19 +02:00 |
|
allegroai
|
923e45bb17
|
Allow reporting a pre-uploaded image url in Logger.report_image using the url parameter
|
2020-01-26 15:29:35 +02:00 |
|
allegroai
|
8772bc2755
|
Version bump
|
2020-01-22 11:08:41 +02:00 |
|
allegroai
|
d03311764e
|
Fix None type as default value in dictionary
|
2020-01-22 11:08:06 +02:00 |
|
allegroai
|
b50bfd5b63
|
Fix default argparser value handling when value is None
|
2020-01-22 11:06:52 +02:00 |
|
allegroai
|
af0b8f4c70
|
Fix type check in hyper-parameters argparser integration
|
2020-01-22 11:03:56 +02:00 |
|
allegroai
|
1e011e10a2
|
Version bump
|
2020-01-21 16:41:14 +02:00 |
|
allegroai
|
1cc0ea6cf3
|
Fix logs, events and jupyter flushing on exit
|
2020-01-21 16:41:01 +02:00 |
|
allegroai
|
f0a27127bf
|
Fix matplotlib savefig patching
|
2020-01-21 16:37:26 +02:00 |
|
allegroai
|
c5dd762d9b
|
Improve conda support
|
2020-01-21 16:32:57 +02:00 |
|
allegroai
|
9a3e130700
|
version bump to v0.13.1
|
2020-01-13 17:29:17 +02:00 |
|
allegroai
|
fcaff82980
|
Add support for pylab.savefig in matplotlib binding
|
2020-01-13 17:16:56 +02:00 |
|
allegroai
|
0ecd734fd1
|
Support multi-line paste of credentials in configuration wizard
|
2020-01-13 17:16:25 +02:00 |
|
allegroai
|
1c6be01e38
|
Add support for savefig in matplotlib binding
|
2020-01-13 12:06:47 +02:00 |
|
allegroai
|
66b251a62b
|
Try to make sure tensorboard is available when using torch
|
2020-01-13 11:55:55 +02:00 |
|
Allegro AI
|
affd6050f6
|
Merge pull request #79 from danmalowany-allegro/master
Fix type hint in Logger.report_scatter3d()
|
2020-01-12 12:50:10 +02:00 |
|
allegroai
|
5fdb2398df
|
Version bump
|
2020-01-10 13:42:24 +02:00 |
|
allegroai
|
8da8053726
|
Do not store keras model network design if it cannot be serialized
|
2020-01-10 13:41:06 +02:00 |
|
allegroai
|
073f4c308d
|
Convert ndarray to histogram for axis to get rid of warning in tensorflow binding
|
2020-01-10 13:39:31 +02:00 |
|
allegroai
|
163ace8856
|
Display matplotlib low version warning only once
|
2020-01-10 13:36:27 +02:00 |
|
allegroai
|
70624f469b
|
Fix matplotlib binding support
|
2020-01-10 13:35:07 +02:00 |
|
allegroai
|
f65ef3e757
|
Support broken Jupyter version on some conda installations (SageMaker)
|
2020-01-10 13:33:19 +02:00 |
|
danmalowany-allegro
|
b9ee824877
|
Changed List to list
|
2020-01-06 18:27:56 +02:00 |
|
danmalowany-allegro
|
457f0b71c8
|
Fixed scatter type in report_scatter3d to Union
|
2020-01-06 18:12:00 +02:00 |
|
allegroai
|
80f3dc6790
|
version bump to v0.13.0
|
2020-01-06 17:44:28 +02:00 |
|
Allegro AI
|
be8d100e33
|
Merge pull request #78 from szymonmaszke/patch-1
Add .pt file extension as PyTorch
|
2020-01-06 17:30:31 +02:00 |
|
allegroai
|
30eaed79ea
|
Add warning when automatic argument parser binding cannot be turned off
|
2020-01-06 17:20:15 +02:00 |
|
allegroai
|
bc33ad0da3
|
Calculate data-audit artifact uniqueness by user-criteria
|
2020-01-06 17:19:44 +02:00 |
|
allegroai
|
a169b43885
|
Add Task.upload_artifact support for external URLs
|
2020-01-06 17:16:51 +02:00 |
|
allegroai
|
7820e0d14a
|
Use an environment variable for setting a default docker image
|
2020-01-06 17:09:45 +02:00 |
|
allegroai
|
7b7b6e487e
|
Fix argparser/subparser support and support unsynced connected hyper parameters in remote execution
|
2020-01-06 17:08:03 +02:00 |
|
allegroai
|
8585d7e134
|
Avoid retries when verifying invalid credentials
|
2020-01-06 17:05:37 +02:00 |
|
Szymon Maszke
|
6815dd5410
|
Add .pt file extension as PyTorch
Usually `.pt` is used as pytorch's extension, see [this StackOverflow question](https://stackoverflow.com/questions/59095824/what-is-difference-between-pt-pth-and-pwf-extentions-in-pytorch).
Furthermore `.pth` is used by Python to list additional package search paths (see [this PyTorch issue](https://github.com/pytorch/pytorch/issues/14864)) so IMO it might be worth reconsidering existence of it extension. AFAIK `.pt` is advised and used throughout most projects.
|
2020-01-06 13:08:54 +01:00 |
|
allegroai
|
54ae340ccb
|
Use source task id to determine cloned task parent
|
2020-01-02 12:01:03 +02:00 |
|
allegroai
|
62d5535351
|
Fix requests issue in python 2.7 that can cause a deadlock when importing netrc
|
2020-01-02 11:58:02 +02:00 |
|
allegroai
|
f4be527a21
|
Fix typo
|
2020-01-02 11:55:59 +02:00 |
|
allegroai
|
7110b938ae
|
Fix matplotlib import binding when imported before trains
|
2019-12-30 18:37:17 +02:00 |
|
allegroai
|
ddeece1f57
|
Add support for API v2.5
|
2019-12-30 18:34:28 +02:00 |
|
allegroai
|
ba79471848
|
Update documentation
|
2019-12-24 18:20:16 +02:00 |
|
allegroai
|
e4024e01d5
|
Make sure ProxyDictPreWrite and ProxyDictPostWrite are pickled correctly
|
2019-12-21 18:33:15 +02:00 |
|
allegroai
|
4e0f711e39
|
Keep only the input artifacts when cloning a task
|
2019-12-21 18:30:24 +02:00 |
|
allegroai
|
0be981fbc1
|
Fix check_min_api_version to use a default session if none was created
|
2019-12-21 18:28:10 +02:00 |
|
allegroai
|
085eebc6b9
|
version bump
|
2019-12-15 15:13:44 +02:00 |
|
allegroai
|
14ce1e925e
|
version bump
|
2019-12-15 00:11:26 +02:00 |
|
allegroai
|
3bd997c4dc
|
Improve trains-init configuration wizard
|
2019-12-15 00:11:01 +02:00 |
|
allegroai
|
c1cc80ba1b
|
Optimize artifacts threading
|
2019-12-15 00:10:34 +02:00 |
|
allegroai
|
a992591f3c
|
Fix artifacts update in auxiliary task
|
2019-12-15 00:10:12 +02:00 |
|
allegroai
|
67d9a9e5d4
|
Do not reuse experiment if it has artifacts
|
2019-12-15 00:09:36 +02:00 |
|
allegroai
|
9add031fe8
|
Improve trains-init wizard
|
2019-12-04 23:47:39 +02:00 |
|
allegroai
|
f92278750a
|
Fix default_output_uri in remote execution mode
Fix arguments order in Task.create
|
2019-12-04 23:47:26 +02:00 |
|
allegroai
|
03fbfb8237
|
version bump
|
2019-11-28 00:49:27 +02:00 |
|
allegroai
|
7e7329f7a0
|
Improve argparser automagic support
|
2019-11-28 00:49:19 +02:00 |
|
allegroai
|
09257b7247
|
Fix files http/s host ending with /
|
2019-11-28 00:48:48 +02:00 |
|
allegroai
|
8aa86225e2
|
Add default_output_uri in trains.conf configuration
Fix Task.set_credentials support for different web/api/files hosts
|
2019-11-23 01:27:45 +02:00 |
|
allegroai
|
8ab982cbc9
|
Fix support for uploading large files over slow http connection
|
2019-11-23 01:26:18 +02:00 |
|
allegroai
|
e1a640d37a
|
Fix support for older git versions (<2)
|
2019-11-23 01:25:37 +02:00 |
|
allegroai
|
7af2d0c9d7
|
Improve trains-init configuration wizard
|
2019-11-23 01:25:17 +02:00 |
|
allegroai
|
9f59346c33
|
version bump
|
2019-11-15 22:00:31 +02:00 |
|
allegroai
|
603d42792d
|
Fix jsonschema deprecation warning
|
2019-11-15 22:00:21 +02:00 |
|
allegroai
|
0a45d2094f
|
Add Task connect_configuration, connect_label_enumeration, and support for nested dictionary with connect
Add Task.get_tasks
|
2019-11-15 22:00:10 +02:00 |
|
allegroai
|
15683b5b43
|
Fix support for auto package detection for standalone scripts
|
2019-11-15 21:59:50 +02:00 |
|
allegroai
|
d19fde7041
|
Add artifact get() returning the artifact object (after downloading and loading)
|
2019-11-15 21:59:36 +02:00 |
|
allegroai
|
b37aea1839
|
Add Task name and comment setter
|
2019-11-15 21:59:24 +02:00 |
|
李波
|
f88b9e69f8
|
fix vdict keys
|
2019-11-13 15:54:58 +08:00 |
|
allegroai
|
0ccdd5db48
|
version bump
|
2019-11-08 22:30:19 +02:00 |
|
allegroai
|
4372dda696
|
Add Task.init auto_connect_frameworks fine granularity control
|
2019-11-08 22:30:09 +02:00 |
|
allegroai
|
9362831269
|
Add sdk.metric.matplotlib_untitled_history_size to limit number of untitled matplotlib plots (default: 100)
|
2019-11-08 22:29:36 +02:00 |
|
allegroai
|
1bfee56977
|
Improve Windows support
|
2019-11-08 22:28:13 +02:00 |
|
allegroai
|
cef3cbaa08
|
version bump
|
2019-10-29 22:08:25 +02:00 |
|
allegroai
|
8b11fa18ea
|
typo
|
2019-10-29 22:08:10 +02:00 |
|
allegroai
|
ac0dfabdfd
|
Improve orchestration pipelines
|
2019-10-29 22:08:02 +02:00 |
|
allegroai
|
ff0a52c6d1
|
version bump
|
2019-10-28 22:01:11 +02:00 |
|
allegroai
|
3527f743a6
|
Improved check trains package updates
|
2019-10-28 22:01:01 +02:00 |
|
allegroai
|
bfa22ae82a
|
Fix report surface support for TF
|
2019-10-28 22:00:11 +02:00 |
|
allegroai
|
492c8dbecb
|
version bump
|
2019-10-27 00:32:34 +03:00 |
|
allegroai
|
00e66b5d63
|
Add missing x/y/z axis titles to various logger report
Changed report_surface arguments
|
2019-10-27 00:32:05 +03:00 |
|
allegroai
|
55dcdfce5a
|
version bump
|
2019-10-25 15:16:28 +03:00 |
|
allegroai
|
81cf2d2261
|
Embed pyhocon into package, and extend parsing capabilities.
|
2019-10-25 15:16:18 +03:00 |
|
allegroai
|
2104c3ec6b
|
Add trains-server new capabilities support
|
2019-10-25 15:15:22 +03:00 |
|
allegroai
|
ac2ea09403
|
Add trains-server api version 2.4 support
|
2019-10-25 15:13:41 +03:00 |
|
allegroai
|
6fffb33931
|
Fix artifacts support on Windows
|
2019-10-25 15:12:53 +03:00 |
|
allegroai
|
adbe02b62b
|
Optimize scatter 2d plot storage
|
2019-10-25 15:12:01 +03:00 |
|
allegroai
|
cb3167bdd8
|
Add x/y/z title for scatter 2d/3d plots
|
2019-10-25 15:11:26 +03:00 |
|
allegroai
|
07f4b86d51
|
version bump
|
2019-10-16 23:36:12 +03:00 |
|
allegroai
|
607a3a8331
|
version bump
|
2019-10-15 22:36:13 +03:00 |
|
allegroai
|
cdbf792582
|
Change second model warning to info
|
2019-10-15 22:36:04 +03:00 |
|
allegroai
|
1a658e9d89
|
Fix output_uri support for local folders
|
2019-10-15 22:35:37 +03:00 |
|
allegroai
|
67fc8e3eb0
|
Add support for NVIDIA_VISIBLE_DEVICES / CUDA_VISIBLE_DEVICES
|
2019-10-15 22:34:56 +03:00 |
|
allegroai
|
913a3b5d1b
|
version bump
|
2019-10-10 21:11:00 +03:00 |
|
allegroai
|
e0e6d9159b
|
Fix python 2.7 and Windows support
|
2019-10-10 21:10:51 +03:00 |
|
allegroai
|
c1bcce9692
|
Retry suppression
|
2019-10-10 21:10:18 +03:00 |
|
allegroai
|
0b875a2dea
|
Changed report_image matrix argument to image (with backwards support)
|
2019-10-10 21:09:44 +03:00 |
|
allegroai
|
aedd3fc87e
|
version bump
|
2019-10-06 22:05:55 +03:00 |
|
allegroai
|
0a5696235b
|
Add exception handling when no output uri credentials are found
|
2019-10-06 21:57:17 +03:00 |
|
allegroai
|
8f0bec5861
|
Fix windows support for time stamp based sorting
|
2019-10-06 21:56:46 +03:00 |
|
allegroai
|
79cf18b2b8
|
version bump
|
2019-10-06 01:43:48 +03:00 |
|
allegroai
|
02c2a12449
|
Fix deprecated warning on imports from sklearn
|
2019-10-06 01:43:37 +03:00 |
|
allegroai
|
c44f3ff11c
|
version bump
|
2019-10-05 15:26:34 +03:00 |
|
allegroai
|
cfd0344784
|
Add gpu statistics embedded into package, no need for external packages
|
2019-10-05 15:26:28 +03:00 |
|
allegroai
|
99a702d149
|
Add artifacts upload retries (default 3)
|
2019-10-05 15:25:48 +03:00 |
|
allegroai
|
005f445600
|
version bump
|
2019-10-04 01:34:38 +03:00 |
|
allegroai
|
9f73dbabdb
|
Better multi-processing, switching to to multiprocess Lock
|
2019-10-04 01:34:22 +03:00 |
|
allegroai
|
9e930a6894
|
Fix urllib retry warning suppression
|
2019-10-04 01:33:37 +03:00 |
|
allegroai
|
e5c0a738c3
|
Fix multi-processing issue with Task of type inference
|
2019-10-04 01:32:59 +03:00 |
|
allegroai
|
6aa22e449e
|
Add alias for task type, train/inference
|
2019-10-04 01:31:57 +03:00 |
|
allegroai
|
4a42345561
|
Add support for tuples in hyper-parameters dict
|
2019-10-04 01:31:26 +03:00 |
|
allegroai
|
a7eb8476ce
|
Add initial Tensorflow v2 support (2.0.0rc1)
|
2019-09-27 13:24:04 +03:00 |
|
allegroai
|
c44638c8d9
|
Fix python package analysis timed out before sending git repo detials.
|
2019-09-27 13:23:32 +03:00 |
|
allegroai
|
3eba23f1a3
|
Fix multiple matplotlib windows with Agg backend interactive mode, caused duplicate graphs to be sent.
|
2019-09-27 13:22:17 +03:00 |
|
allegroai
|
b720895307
|
Fix S3 warning
|
2019-09-27 13:21:04 +03:00 |
|
allegroai
|
c0ab9a2f52
|
Fix resource monitor fall back to seconds since experiment started, will keep waiting for any reporting for 30min, while sending monitor report after 3min
|
2019-09-27 13:20:41 +03:00 |
|
allegroai
|
85c11052c1
|
version bump
|
2019-09-25 00:33:12 +03:00 |
|
allegroai
|
86655412b0
|
Add artifacts support for folders/wildcard, include retrieval and extraction
|
2019-09-25 00:33:00 +03:00 |
|
allegroai
|
e6ed09664f
|
Fix force flush logs at exit
|
2019-09-25 00:32:08 +03:00 |
|
allegroai
|
44ffb2985d
|
Change tensorboard default scalar grouping (now False)
|
2019-09-25 00:31:23 +03:00 |
|
allegroai
|
0cbc99b16d
|
Removed deprecated call
|
2019-09-25 00:30:46 +03:00 |
|
allegroai
|
dada40dd73
|
version bump
|
2019-09-23 18:42:05 +03:00 |
|
allegroai
|
b1d3fc9694
|
Add Full Artifacts support, including local files/folders, pandas, numpy, images. requires train-server 0.11 and above
|
2019-09-23 18:41:53 +03:00 |
|
allegroai
|
4f1eeb49c6
|
Add StorageHelper.get_local_copy to quickly download and provide local path to remote files (http/s3/gs/azure support)
|
2019-09-23 18:40:56 +03:00 |
|
allegroai
|
0b4f00af4d
|
Restructured Logger with nice clean interface.
Breaking changes: Logger no longer supports info/error/warning console() replaced with report_text()
|
2019-09-23 18:40:13 +03:00 |
|
allegroai
|
1dbe962879
|
version bump
|
2019-09-15 21:53:04 +03:00 |
|
allegroai
|
24c2f86741
|
Add upload artifact supports pd.DataFrame
|
2019-09-15 21:52:57 +03:00 |
|
allegroai
|
406536d105
|
version bump
|
2019-09-15 01:36:42 +03:00 |
|
allegroai
|
8c3f6d254a
|
Fix multiple tasks closing
|
2019-09-15 01:36:33 +03:00 |
|
allegroai
|
61fb17266f
|
version bump
|
2019-09-15 00:02:51 +03:00 |
|
allegroai
|
df53ed5577
|
Fix safe YAML loading
|
2019-09-15 00:02:42 +03:00 |
|
allegroai
|
b98c821cf9
|
Fix task cloning
|
2019-09-15 00:02:23 +03:00 |
|
allegroai
|
c7a687b4a5
|
version bump
|
2019-09-14 13:55:54 +03:00 |
|
allegroai
|
933a9ad12e
|
Add trains-init verifies credentials
|
2019-09-14 13:55:45 +03:00 |
|
allegroai
|
2ba372560e
|
Fix set artifacts storage destination with output_uri
|
2019-09-14 13:55:17 +03:00 |
|
allegroai
|
648a972199
|
version bump
|
2019-09-13 19:08:56 +03:00 |
|
allegroai
|
13dd130c7d
|
Fix always order by created time
|
2019-09-13 19:08:49 +03:00 |
|
allegroai
|
289063e345
|
version bump
|
2019-09-13 17:10:58 +03:00 |
|
allegroai
|
76ea73a780
|
Removed apache-libcloud
|
2019-09-13 17:09:58 +03:00 |
|
allegroai
|
d7bdc746b8
|
Add full artifacts support
|
2019-09-13 17:09:24 +03:00 |
|
allegroai
|
27ca36687a
|
Add support for upcoming trains-server
|
2019-09-13 17:08:27 +03:00 |
|
allegroai
|
5b48322b55
|
Add support for upcoming trains-server
|
2019-09-13 17:07:48 +03:00 |
|
allegroai
|
64aabbe7d5
|
version bump
|
2019-09-09 21:50:26 +03:00 |
|
allegroai
|
9ffee412d7
|
Add overwriting artifacts
|
2019-09-09 21:50:18 +03:00 |
|