Commit Graph

672 Commits

Author SHA1 Message Date
allegroai
994ed1a5ae Add AWS auto-scaler multi-line support for both extra bash script and extra trains.conf data 2020-10-12 11:07:01 +03:00
allegroai
0c3745ea3f Fix Task.clone support for trains-server < 0.16 2020-10-12 11:04:41 +03:00
allegroai
07bdc37dcb When using "detect_with_pip_freeze" make sure that "package @ file://" lines are replaced with "package==x.y.z" because local file will probably not be available 2020-10-12 11:03:33 +03:00
allegroai
89034233ed Fix AWS autoscaler typos 2020-10-12 11:01:08 +03:00
allegroai
79df2be26c Don't strip the output of diff command 2020-10-12 10:52:49 +03:00
allegroai
0b5c22d6dd Make sure local packages with multi-files are marked as "package" 2020-10-12 10:50:46 +03:00
allegroai
1e4ab0510c Add system_tags and tags to Model 2020-10-12 10:50:38 +03:00
allegroai
5d20a0fa98 Fix set_base_docker should be skipped when running remotely 2020-10-12 10:49:20 +03:00
allegroai
0eb1bb4492 Fix type annotation and PEP8 2020-10-11 11:16:19 +03:00
allegroai
f65e64aebe Fix ArgParser binding handling of string argument with boolean default value (this affects Pytorch Lightning integration) 2020-10-11 11:15:14 +03:00
allegroai
f8ba0495fb Version bump to 0.16.2 2020-10-04 18:03:03 +03:00
allegroai
64e10b2f62 Add PyTorch Lightning save/restore model binding (issue #212) 2020-10-04 17:00:01 +03:00
allegroai
1a39973cb9 Fix ArgParse auto-connect to support default function type (stored as empty string, ignored when running remotely) and type string with default value None (ignored when running remotely and None value is kept) 2020-10-04 16:58:50 +03:00
allegroai
765afcbb64 Fix Task.execute_remotely() not clearing development tag resulting in experiment not being editable in the UI 2020-10-04 16:54:24 +03:00
allegroai
ce09a78578 Use specific default_demo_host (default_host may be overridden by Task.set_credentials) 2020-10-04 16:52:28 +03:00
Shaked Klein Orbach
7590d601f7 add support for TRAINS_NO_DEFAULT_SERVER issue #209 2020-10-01 19:54:05 +03:00
Shaked Klein Orbach
e1c5aeed06 add support for TRAINS_NO_DEFAULT_SERVER issue #209 2020-10-01 19:54:05 +03:00
allegroai
8adfa3ebd2 Fix Task.clone() did not copy the configuration section 2020-10-01 16:17:02 +03:00
allegroai
75a88f0d6e Safer code 2020-10-01 16:15:37 +03:00
allegroai
b84a781860 version bump 2020-09-29 19:28:54 +03:00
allegroai
295b33857c Fix optimizer monitor 2020-09-29 19:28:42 +03:00
allegroai
be099f42f9 Support Keras restructuring for Network, Model and Sequential 2020-09-29 19:27:43 +03:00
allegroai
5094ede309 Don't add pandas artifact unnamed:0 column, return original pandas object. 2020-09-29 19:21:37 +03:00
allegroai
30a08ee937 Add set ResourceMonitor iteration wait duration timeout (issue #208) 2020-09-29 19:19:35 +03:00
allegroai
86da29b560 Fix TrainsJob hyperparams overriding order was not guaranteed 2020-09-29 19:18:49 +03:00
allegroai
55ac24aa9a Exclude argsparser arguments and copy hyperparms in Task.clone() if API < 2.9 2020-09-29 19:18:04 +03:00
allegroai
cd77f0b8c8 Add ArgParser default help (if not provided) 2020-09-29 19:15:11 +03:00
allegroai
2065288a90 Add improved trace filtering capabilities 2020-09-29 19:14:10 +03:00
allegroai
8e859503f6 Don't raise error for batch requests with no items 2020-09-29 19:10:00 +03:00
allegroai
ab9487c4e0 Update Session API version according to max server reported version 2020-09-29 19:09:07 +03:00
allegroai
8ec6bba4d9 Fix Optimizer limits and values, update trains version in examples 2020-09-15 19:14:45 +03:00
allegroai
ab5059e8e1 Fix Task.init() casts init task_type None to str 2020-09-15 18:15:02 +03:00
allegroai
6bc9d705a0 Fix available versions loading 2020-09-15 18:14:05 +03:00
allegroai
2a249c41f0 If possible, do not use api tasks object directly (use Task instead) 2020-09-15 18:13:07 +03:00
allegroai
d36f6c26da Fix auto model logging using relative path (use full absolute path) 2020-09-15 18:11:31 +03:00
allegroai
2a2d4b6114 Add git diff on repository submodule (requires git 2.14 or above) 2020-09-15 18:10:02 +03:00
allegroai
3466cc0789 Fix scatter2d sub-sampling and rounding 2020-09-15 18:08:57 +03:00
allegroai
10ec4d56fb version bump 2020-09-09 22:11:45 +03:00
allegroai
0797f23f36 pep8 2020-09-09 22:11:29 +03:00
allegroai
e206232126 Improve pipeline controller 2020-09-09 22:11:18 +03:00
allegroai
2c47e9f248 Fix joblib auto logging models failing on compressed streams, issue #203 2020-09-09 22:10:59 +03:00
allegroai
299ce14515 Fix sending empty reports, issue #205 2020-09-09 22:10:59 +03:00
allegroai
f4917572bb Remove warning on skipped auto-magic model logging 2020-09-09 22:09:02 +03:00
allegroai
fede603a7b Fix upload message 2020-09-09 22:08:22 +03:00
allegroai
33f42def54 pep8 2020-09-09 22:07:50 +03:00
allegroai
24ab1ecc2d Fix Windows support for install package analysis 2020-09-09 22:07:35 +03:00
allegroai
7eedd30097 pep8 2020-09-09 22:06:04 +03:00
allegroai
03e7ebd48c Add pipeline controller tag-per-step option. Pipeline controller parameters can now be any type. 2020-09-05 16:31:01 +03:00
allegroai
86aa3aaa98 Fix docstrings 2020-09-05 16:30:00 +03:00
allegroai
fae11edf1b Fix NaN in plotly plots (matplotlib conversion)
Add sdk.metrics.plot_max_num_digits to limit the number of digits in a plot (reduce plot sizes)
2020-09-05 16:28:24 +03:00
allegroai
c30b6d27e8 Fix failed controller pipeline tasks were considered completed 2020-09-05 16:26:40 +03:00
allegroai
646163a2cb Fix matplotlib _reporter refactoring 2020-09-05 16:25:28 +03:00
allegroai
5beecbb078 Add Pipeline Controller automation and example 2020-09-01 18:00:19 +03:00
allegroai
4f06ab1c59 Fix thread wait Ctrl-C interrupt did not exit process 2020-09-01 17:58:42 +03:00
allegroai
134fabb7a2 Add Task.logger property 2020-09-01 17:56:38 +03:00
allegroai
4c77cd1479 Rename Task.reporter to Task._reporter (deprecated) 2020-09-01 17:47:40 +03:00
allegroai
99a8724bec Fix Task.wait_for_status() to reload after it ends 2020-09-01 17:46:24 +03:00
allegroai
d148fe8042 Add TrainsJob.is_completed()/is_aborted() 2020-09-01 17:45:08 +03:00
allegroai
fd165f7126 Fix docstrings 2020-09-01 17:44:26 +03:00
allegroai
19822419b6 Version bump to v0.16.1 2020-08-27 15:07:05 +03:00
allegroai
f11c6f5f27 Improve HyperParameterOptimizer 2020-08-27 15:05:21 +03:00
allegroai
b25ca9b384 Fix double-escaped design when connecting OutputModel 2020-08-27 15:04:03 +03:00
allegroai
838c9cb0d2 Fix HyperParameter optimizer to create Task of type optimizer 2020-08-23 01:06:59 +03:00
allegroai
e1bbc03001 Fix artifact upload to only use file stream when not uploading locally stored file. Multi-part upload is not supported on stream upload. 2020-08-23 01:06:20 +03:00
allegroai
b054ba4088 No offline mode when running remotely 2020-08-23 01:05:18 +03:00
allegroai
de068cc390 Fix cache handling for different partitions/drives/devices 2020-08-18 11:53:40 +03:00
allegroai
ce483521ef Fix Task.get_reported_console_output() for new API v2.9 2020-08-18 11:52:31 +03:00
allegroai
df0e5deb02 Fix git+https requirements handling, resolve top_level.txt package name (kerastuner from git was not detected) 2020-08-18 11:51:04 +03:00
allegroai
ffdf2e5c4c Version bump to v0.16.0 2020-08-10 17:25:47 +03:00
allegroai
4fbf0b9d4a Fix TF binding to preserve previous behavior 2020-08-10 17:25:33 +03:00
allegroai
9a561964e5 PEP8 2020-08-10 08:18:38 +03:00
Allegro AI
abb875cedb
Merge pull request #182 from guyfre/fix/tf_img_summary
Fix saving image summary in tensorflow binding
2020-08-10 08:13:36 +03:00
allegroai
73bd8c2714 Add FastAI example, disable binding if tensorboard is loaded (assume TensorBoradLogger will be used) 2020-08-10 08:01:03 +03:00
allegroai
4628b5eb82 Fix and improve signal handling (disable edit lock on signal callbacks, call before releasing the STD patch) 2020-08-10 07:57:26 +03:00
guyfre
dc036fd51d Fix in saving image summary in tensorflow bindings 2020-08-09 12:56:46 +03:00
allegroai
0704cf0c8e Fix task.connect() dictionary to update the section (not override it) just like in API < 2.9 2020-08-08 12:53:54 +03:00
allegroai
d56eb03381 Fix plotly support for matplotlib 3.3 2020-08-08 12:52:54 +03:00
allegroai
5fc641afc6 Chang default legacy section name to 'Args'
Fix generated config file comment
2020-08-08 12:51:29 +03:00
allegroai
b710c2f19d Fix OS env var TRAINS_OFFLINE_MODE set to API version (e.g. 2.9) 2020-08-08 12:49:33 +03:00
allegroai
65003a168a Fix hyper-parameter legacy mode (type=='legacy')
Add type/description to TF_DEFINES
Cast hyper-parameters to string (if not None)
2020-08-08 12:48:23 +03:00
allegroai
de61dbf54e Fix offline mode to support python3.5 2020-08-08 12:47:08 +03:00
allegroai
2c68a188d9 Fix multiprocessing Pool throw exception in pool would hang the program. Call original signal handler and re-flush stdout.
Add py2.7 support for get_current_thread_id.
2020-08-08 12:45:15 +03:00
allegroai
48ef50d41d Add session API version to exported tasks 2020-08-08 12:43:12 +03:00
allegroai
fa4803cb82 Fix log level for trains submodules 2020-08-08 12:42:32 +03:00
allegroai
ff736a76c9 Fix GPU stats on Windows machines (issue #177) 2020-08-08 12:40:32 +03:00
allegroai
35fa4f010a Add Optimizer min_iteration_per_job for all SearchStrategies 2020-08-08 12:39:56 +03:00
allegroai
ef83a648eb Support Task get_model_config/set_model_config legacy model configuration interface 2020-08-08 12:38:46 +03:00
allegroai
f4f53902ed Add sdk.development.log_os_environments to match TRAINS_LOG_ENVIRONMENT
Support logging OS environments into Environment section
2020-08-08 12:37:42 +03:00
allegroai
f89ec8cbac Avoid using "tasks." outside of a function as it triggers a Session 2020-08-08 12:35:57 +03:00
allegroai
e378de1e41 Add multi configuration section support (hyperparams and configurations)
Support setting offline mode API version using TRAINS_OFFLINE_MODE env var
2020-08-08 12:35:03 +03:00
allegroai
6d4e85de0a Add Trains Server API v2.9 support 2020-08-08 12:31:20 +03:00
allegroai
e4801542f5 Moved dict parsing in/out (hocon) into utilities.config 2020-08-08 12:28:59 +03:00
allegroai
6dca60aef2 Fix duplicate argument 2020-07-30 15:15:21 +03:00
allegroai
619be3dc75 Fix requirements detection:
- multiple -e packages were not detected (only the first one)
- trains installed from git + running with trains in python path resulted in double entry of trains
- Do not add -e to packages installed from git repositories, Trains-Agent doesn't like it
2020-07-30 15:12:46 +03:00
allegroai
1d277d01d3 Fix large git diff preview (artifact auxiliary_git_diff) is a single line per file, add option to control the artifact preview 2020-07-30 15:10:41 +03:00
allegroai
0a5c10b4b0 Fix user input wizard, support python 3.5 / 2.7 2020-07-30 15:08:27 +03:00
allegroai
23394a265d flake8 + change ModuleNotFoundError to ImportError (support py 2.7/3.5) 2020-07-30 15:07:25 +03:00
allegroai
a8d6380696 Add offline support using Task.set_offline() and Task.import_offline_session() 2020-07-30 15:03:22 +03:00
allegroai
2ec5726812 Fix filename too long bug (trains-server #54) 2020-07-30 14:58:48 +03:00
allegroai
d8671beb89 Fix StorageHelper to stream StringIO into file (tensorboard add_text support) 2020-07-30 14:57:35 +03:00