Commit Graph

413 Commits

Author SHA1 Message Date
allegroai
0a45d2094f Add Task connect_configuration, connect_label_enumeration, and support for nested dictionary with connect
Add Task.get_tasks
2019-11-15 22:00:10 +02:00
allegroai
15683b5b43 Fix support for auto package detection for standalone scripts 2019-11-15 21:59:50 +02:00
allegroai
d19fde7041 Add artifact get() returning the artifact object (after downloading and loading) 2019-11-15 21:59:36 +02:00
allegroai
b37aea1839 Add Task name and comment setter 2019-11-15 21:59:24 +02:00
李波
f88b9e69f8 fix vdict keys 2019-11-13 15:54:58 +08:00
allegroai
0ccdd5db48 version bump 2019-11-08 22:30:19 +02:00
allegroai
4372dda696 Add Task.init auto_connect_frameworks fine granularity control 2019-11-08 22:30:09 +02:00
allegroai
9362831269 Add sdk.metric.matplotlib_untitled_history_size to limit number of untitled matplotlib plots (default: 100) 2019-11-08 22:29:36 +02:00
allegroai
1bfee56977 Improve Windows support 2019-11-08 22:28:13 +02:00
allegroai
cef3cbaa08 version bump 2019-10-29 22:08:25 +02:00
allegroai
8b11fa18ea typo 2019-10-29 22:08:10 +02:00
allegroai
ac0dfabdfd Improve orchestration pipelines 2019-10-29 22:08:02 +02:00
allegroai
ff0a52c6d1 version bump 2019-10-28 22:01:11 +02:00
allegroai
3527f743a6 Improved check trains package updates 2019-10-28 22:01:01 +02:00
allegroai
bfa22ae82a Fix report surface support for TF 2019-10-28 22:00:11 +02:00
allegroai
492c8dbecb version bump 2019-10-27 00:32:34 +03:00
allegroai
00e66b5d63 Add missing x/y/z axis titles to various logger report
Changed report_surface arguments
2019-10-27 00:32:05 +03:00
allegroai
55dcdfce5a version bump 2019-10-25 15:16:28 +03:00
allegroai
81cf2d2261 Embed pyhocon into package, and extend parsing capabilities. 2019-10-25 15:16:18 +03:00
allegroai
2104c3ec6b Add trains-server new capabilities support 2019-10-25 15:15:22 +03:00
allegroai
ac2ea09403 Add trains-server api version 2.4 support 2019-10-25 15:13:41 +03:00
allegroai
6fffb33931 Fix artifacts support on Windows 2019-10-25 15:12:53 +03:00
allegroai
adbe02b62b Optimize scatter 2d plot storage 2019-10-25 15:12:01 +03:00
allegroai
cb3167bdd8 Add x/y/z title for scatter 2d/3d plots 2019-10-25 15:11:26 +03:00
allegroai
07f4b86d51 version bump 2019-10-16 23:36:12 +03:00
allegroai
607a3a8331 version bump 2019-10-15 22:36:13 +03:00
allegroai
cdbf792582 Change second model warning to info 2019-10-15 22:36:04 +03:00
allegroai
1a658e9d89 Fix output_uri support for local folders 2019-10-15 22:35:37 +03:00
allegroai
67fc8e3eb0 Add support for NVIDIA_VISIBLE_DEVICES / CUDA_VISIBLE_DEVICES 2019-10-15 22:34:56 +03:00
allegroai
913a3b5d1b version bump 2019-10-10 21:11:00 +03:00
allegroai
e0e6d9159b Fix python 2.7 and Windows support 2019-10-10 21:10:51 +03:00
allegroai
c1bcce9692 Retry suppression 2019-10-10 21:10:18 +03:00
allegroai
0b875a2dea Changed report_image matrix argument to image (with backwards support) 2019-10-10 21:09:44 +03:00
allegroai
aedd3fc87e version bump 2019-10-06 22:05:55 +03:00
allegroai
0a5696235b Add exception handling when no output uri credentials are found 2019-10-06 21:57:17 +03:00
allegroai
8f0bec5861 Fix windows support for time stamp based sorting 2019-10-06 21:56:46 +03:00
allegroai
79cf18b2b8 version bump 2019-10-06 01:43:48 +03:00
allegroai
02c2a12449 Fix deprecated warning on imports from sklearn 2019-10-06 01:43:37 +03:00
allegroai
c44f3ff11c version bump 2019-10-05 15:26:34 +03:00
allegroai
cfd0344784 Add gpu statistics embedded into package, no need for external packages 2019-10-05 15:26:28 +03:00
allegroai
99a702d149 Add artifacts upload retries (default 3) 2019-10-05 15:25:48 +03:00
allegroai
005f445600 version bump 2019-10-04 01:34:38 +03:00
allegroai
9f73dbabdb Better multi-processing, switching to to multiprocess Lock 2019-10-04 01:34:22 +03:00
allegroai
9e930a6894 Fix urllib retry warning suppression 2019-10-04 01:33:37 +03:00
allegroai
e5c0a738c3 Fix multi-processing issue with Task of type inference 2019-10-04 01:32:59 +03:00
allegroai
6aa22e449e Add alias for task type, train/inference 2019-10-04 01:31:57 +03:00
allegroai
4a42345561 Add support for tuples in hyper-parameters dict 2019-10-04 01:31:26 +03:00
allegroai
a7eb8476ce Add initial Tensorflow v2 support (2.0.0rc1) 2019-09-27 13:24:04 +03:00
allegroai
c44638c8d9 Fix python package analysis timed out before sending git repo detials. 2019-09-27 13:23:32 +03:00
allegroai
3eba23f1a3 Fix multiple matplotlib windows with Agg backend interactive mode, caused duplicate graphs to be sent. 2019-09-27 13:22:17 +03:00
allegroai
b720895307 Fix S3 warning 2019-09-27 13:21:04 +03:00
allegroai
c0ab9a2f52 Fix resource monitor fall back to seconds since experiment started, will keep waiting for any reporting for 30min, while sending monitor report after 3min 2019-09-27 13:20:41 +03:00
allegroai
85c11052c1 version bump 2019-09-25 00:33:12 +03:00
allegroai
86655412b0 Add artifacts support for folders/wildcard, include retrieval and extraction 2019-09-25 00:33:00 +03:00
allegroai
e6ed09664f Fix force flush logs at exit 2019-09-25 00:32:08 +03:00
allegroai
44ffb2985d Change tensorboard default scalar grouping (now False) 2019-09-25 00:31:23 +03:00
allegroai
0cbc99b16d Removed deprecated call 2019-09-25 00:30:46 +03:00
allegroai
dada40dd73 version bump 2019-09-23 18:42:05 +03:00
allegroai
b1d3fc9694 Add Full Artifacts support, including local files/folders, pandas, numpy, images. requires train-server 0.11 and above 2019-09-23 18:41:53 +03:00
allegroai
4f1eeb49c6 Add StorageHelper.get_local_copy to quickly download and provide local path to remote files (http/s3/gs/azure support) 2019-09-23 18:40:56 +03:00
allegroai
0b4f00af4d Restructured Logger with nice clean interface.
Breaking changes: Logger no longer supports info/error/warning console() replaced with report_text()
2019-09-23 18:40:13 +03:00
allegroai
1dbe962879 version bump 2019-09-15 21:53:04 +03:00
allegroai
24c2f86741 Add upload artifact supports pd.DataFrame 2019-09-15 21:52:57 +03:00
allegroai
406536d105 version bump 2019-09-15 01:36:42 +03:00
allegroai
8c3f6d254a Fix multiple tasks closing 2019-09-15 01:36:33 +03:00
allegroai
61fb17266f version bump 2019-09-15 00:02:51 +03:00
allegroai
df53ed5577 Fix safe YAML loading 2019-09-15 00:02:42 +03:00
allegroai
b98c821cf9 Fix task cloning 2019-09-15 00:02:23 +03:00
allegroai
c7a687b4a5 version bump 2019-09-14 13:55:54 +03:00
allegroai
933a9ad12e Add trains-init verifies credentials 2019-09-14 13:55:45 +03:00
allegroai
2ba372560e Fix set artifacts storage destination with output_uri 2019-09-14 13:55:17 +03:00
allegroai
648a972199 version bump 2019-09-13 19:08:56 +03:00
allegroai
13dd130c7d Fix always order by created time 2019-09-13 19:08:49 +03:00
allegroai
289063e345 version bump 2019-09-13 17:10:58 +03:00
allegroai
76ea73a780 Removed apache-libcloud 2019-09-13 17:09:58 +03:00
allegroai
d7bdc746b8 Add full artifacts support 2019-09-13 17:09:24 +03:00
allegroai
27ca36687a Add support for upcoming trains-server 2019-09-13 17:08:27 +03:00
allegroai
5b48322b55 Add support for upcoming trains-server 2019-09-13 17:07:48 +03:00
allegroai
64aabbe7d5 version bump 2019-09-09 21:50:26 +03:00
allegroai
9ffee412d7 Add overwriting artifacts 2019-09-09 21:50:18 +03:00
allegroai
1a5ed1132a Fix broken Keras binding support 2019-09-09 21:49:55 +03:00
allegroai
9dfe36db9e version bump 2019-09-07 23:28:41 +03:00
allegroai
3f63394b51 Documentation 2019-09-07 23:28:32 +03:00
allegroai
dc632e160f Improve artifacts support 2019-09-07 23:27:16 +03:00
allegroai
7cb7d891b3 version bump 2019-09-05 01:54:21 +03:00
allegroai
d0b1c6acb5 Sphinx compatibility 2019-09-05 01:54:15 +03:00
allegroai
2fb69ae951 Improve httpdriver authentication feature 2019-09-05 01:53:43 +03:00
allegroai
05364f0796 version bump 2019-09-03 12:59:42 +03:00
allegroai
64ba30df13 Stability and cleanups 2019-09-03 12:58:01 +03:00
allegroai
d4358af1e8 version bump 2019-08-19 21:23:54 +03:00
allegroai
25e3816484 Add permission check for Task.init(output_uri=) 2019-08-19 21:21:21 +03:00
allegroai
1f81a109b7 Simplify Logger interface 2019-08-19 21:20:25 +03:00
allegroai
ad5a44e906 Fix support for plotly 4.0 and matplotlib compatibility 2019-08-19 21:19:44 +03:00
allegroai
a896f5b465 Improve frameworks binding 2019-08-19 21:18:44 +03:00
allegroai
3bc1ec2362 Improve stability and resilience on intermittent network connection 2019-08-19 21:17:53 +03:00
allegroai
0a8cf706bd Add initial Azure storage support 2019-08-19 21:15:31 +03:00
allegroai
dcfd694d4a version bump 2019-08-09 02:20:52 +03:00
allegroai
761082b474 Replace opencv-python with more standard Pillow 2019-08-09 02:18:01 +03:00
allegroai
7beddf97da Optimize version update check 2019-08-09 02:11:00 +03:00
allegroai
c7c0bac5b9 version bump 2019-08-07 00:39:05 +03:00
allegroai
f22278b233 Fix matplotlib support 2019-08-07 00:38:58 +03:00
allegroai
66515eab14 version bump 2019-08-07 00:14:41 +03:00
allegroai
1d6727d2c0 Improve auto package detection 2019-08-07 00:05:51 +03:00
allegroai
3ab1c261e7 Fix matplotlib support 2019-08-07 00:05:24 +03:00
allegroai
fb7dfc49a9 Fix auto-detect git repository 2019-08-01 12:54:11 +03:00
allegroai
e9ad8c7c7f version bump 2019-07-31 23:10:03 +03:00
allegroai
2bbf46a273 Fix Windows support 2019-07-31 23:09:53 +03:00
allegroai
4c15613250 Add support for scikit-learn internal joblib implementation 2019-07-31 01:37:06 +03:00
allegroai
19c5f05912 Add scikit-learn support (joblib) and xgboost support 2019-07-31 00:30:12 +03:00
allegroai
1bb06c0190 version bump 2019-07-28 23:03:42 +03:00
allegroai
67df9774e1 Fix Matplotlib figure.show support
Improve Matplotlib support, plt.show will show under plots tabs, and plt.imshow under debug images
2019-07-28 21:06:47 +03:00
allegroai
787da4798b version bump 2019-07-28 21:04:57 +03:00
allegroai
62bc54d7be Add initial artifacts support
Fix sub-process support
Fix delete_after_upload option when uploading images
Add logugu support
Fix subsample plots if they are too big
Fix requests for over 15mb
2019-07-28 21:04:45 +03:00
allegroai
120de5c24f Fix PR 2019-07-24 01:44:09 +03:00
Erez Schanider
94642af4a1 Merge remote-tracking branch 'upstream/master' 2019-07-21 08:48:35 +03:00
allegroai
f19401da39 version bump 2019-07-20 23:55:46 +03:00
allegroai
c93d030109 Fix support for sub-process (process pool) 2019-07-20 23:55:14 +03:00
allegroai
c80aae0e1e Fix support for sub-process (process pool) 2019-07-20 23:11:54 +03:00
allegroai
50ce49a3dd Add separate api/web/file server configuration (backward support included).
OS environment override with:  TRAINS_API_HOST / TRAINS_WEB_HOST / TRAINS_FILES_HOST
2019-07-20 23:09:44 +03:00
allegroai
00f873081a Add support for multiple event writers in the same session 2019-07-20 22:02:19 +03:00
allegroai
51cc50e239 Add separate api/web/file server configuration (backward support included).
OS environment override with:  TRAINS_API_HOST / TRAINS_WEB_HOST / TRAINS_FILES_HOST
2019-07-20 22:01:27 +03:00
Erez Schanider
a0e42c66a1 fix deprecation warning 2019-07-17 09:10:32 +03:00
allegroai
66e5d89268 version bump 2019-07-14 19:55:43 +03:00
allegroai
44aaa39ccf Fix Tensorboard RGB channel order 2019-07-14 19:04:01 +03:00
allegroai
7199dc5d55 version bump 2019-07-14 00:08:54 +03:00
allegroai
f11da65d4a Fix pre-release version should not be recommended 2019-07-14 00:06:31 +03:00
allegroai
ddf1dc2c5a version bump 2019-07-13 23:56:37 +03:00
allegroai
e655dd6cdf Fix pycharm plugin support large git diff over OS environment 2019-07-13 23:56:27 +03:00
allegroai
9c7e0747fb Add support for Azure notebook and google colab 2019-07-13 23:55:34 +03:00
allegroai
7d0bf4838e Add Task.set_credentials for cloud hosted jupyter support 2019-07-13 23:54:47 +03:00
allegroai
cac4ac12b8 Add seaborn support and SVG support for matplotlib 2019-07-13 23:53:19 +03:00
allegroai
c9221e3fbb Add TRAINS_LOG_ENVIRONMENT for OS environment logging 2019-07-13 23:51:27 +03:00
allegroai
c997f6a95a Change warnings to debug messages 2019-07-13 23:50:43 +03:00
allegroai
a4c181e777 version bump 2019-07-10 17:25:38 +03:00
allegroai
339f57f44c Fix Jenkins CI/CD support 2019-07-10 17:25:30 +03:00
allegroai
2e7c2a9292 version bump 2019-07-09 10:14:09 +03:00
allegroai
d5a2383b75 Removed colorama / coloredlogs, they are now optional packages dynamically loaded 2019-07-09 03:05:33 +03:00
allegroai
c4c37c5cef Moved definition 2019-07-09 01:52:06 +03:00
allegroai
d9d5c6cb3c version bump 2019-07-08 23:29:20 +03:00
allegroai
22b18e7338 Optimize repository query and requirements analysis 2019-07-08 23:28:55 +03:00
allegroai
96abe3ef04 Documentation 2019-07-08 23:28:08 +03:00
allegroai
8a1e31c4f0 Add exception guard 2019-07-08 23:27:53 +03:00
allegroai
02ba0e28d5 Fix support non-linear iteration reporting 2019-07-08 23:27:25 +03:00
allegroai
31a0867ac9 Optimize requirements 2019-07-08 23:26:57 +03:00
allegroai
7eb27096ee version bump 2019-07-06 23:03:27 +03:00
allegroai
a1cf210896 Fix python 2.7 support 2019-07-06 23:03:14 +03:00
allegroai
e40d4f2f41 Add new task status and support for reuse override 2019-07-06 23:02:58 +03:00
allegroai
bcb10d7adb Changed, async repository detection and auto-requirements generation. 2019-07-06 23:02:24 +03:00
allegroai
577010c421 Add auto requirement.txt generation 2019-07-06 23:01:15 +03:00
allegroai
3050bf1476 Fix OS environment repository detection override 2019-07-06 23:00:28 +03:00
allegroai
c3eb5fd8b0 Add new API backward compatibility support 2019-07-06 22:59:56 +03:00
allegroai
e7f1e3de86 Add OS environment "TRAINS_TASK_NO_REUSE" forcing new experiment to be created every time 2019-07-06 22:59:20 +03:00
allegroai
7b1c0d8c21 Fix, gpu resource monitoring fail safety mechanism 2019-07-06 22:58:36 +03:00
allegroai
22a65abdc1 Add new task state support 2019-07-06 22:58:01 +03:00
allegroai
b5219d98de Add new API backward compatibility support 2019-07-06 22:57:21 +03:00
allegroai
d38f0ec14d Add new API backward compatibility support 2019-07-06 22:56:55 +03:00
allegroai
2f3ff16e67 Add new API version support 2019-07-06 22:56:17 +03:00
allegroai
f2829e1162 Fix, multiple experiments in the same session 2019-07-04 01:21:34 +03:00
allegroai
700a927f42 version bump 2019-07-02 00:00:14 +03:00
allegroai
738f00340a Fix resource monitor fall back to seconds-from-start 2019-07-02 00:00:05 +03:00
allegroai
4099efc26b version bump 2019-07-01 22:23:50 +03:00
allegroai
8475ecaed8 Python 2 support 2019-07-01 22:23:40 +03:00
Allegro AI
8894981a19
Hot fix, version bump 2019-06-30 10:55:44 +03:00
Allegro AI
a6e70f783a
Hot fix, release 2019-06-30 10:53:38 +03:00
eyalto
161d086d67
changes enum in requirements txt 2019-06-30 10:39:32 +03:00
allegroai
6a69b935d4 version bump 2019-06-27 23:23:03 +03:00
allegroai
d27dc352cb Changed, resource monitor prefer sync to iterations, over seconds from beginning of experiment 2019-06-27 23:22:28 +03:00
allegroai
85e783cc6b Add resource monitoring ability machine/gpu 2019-06-24 01:02:41 +03:00
allegroai
85f702d594 version bump 2019-06-20 19:04:54 +03:00
allegroai
e18964b5df version bump 2019-06-20 03:34:08 +03:00
allegroai
2c1e314fbf Fix python 2.7 debugger threading issues 2019-06-20 03:33:57 +03:00
allegroai
39ba074b70 Add report_histogram is the same as report_vector 2019-06-20 03:32:15 +03:00
allegroai
74fe96f17c Refactored binding, better support for matplotlib jupyter binding 2019-06-20 03:31:22 +03:00
allegroai
2d3d532b11 version bump 2019-06-20 01:50:52 +03:00
allegroai
a77b470500 Refactored binding, better support for matplotlib jupyter binding 2019-06-20 01:50:40 +03:00
allegroai
ff8652f39f Fix support for local git branch, without matching remote branch 2019-06-20 01:49:37 +03:00
allegroai
77e2c32523 Fix timeout for uploading images 2019-06-19 19:47:12 +03:00
allegroai
cc536a8f3f Add latest package check, as long as we are in pre-release. 2019-06-19 19:46:47 +03:00
allegroai
45c2c612b0 version bump 2019-06-19 15:14:41 +03:00
allegroai
675dc32528 Add api.verify_certificate to allow non-verified ssl connection (enterprise firewall mitm scenarios), by defaults only secured connections are allowed.
Add latest package check, as long as we are in pre-release.
2019-06-19 15:14:28 +03:00
allegroai
fdc767c1c5 Documentation 2019-06-19 15:11:22 +03:00
Allegro AI
dce1f6b7d1
Merge pull request #8 from raviv/master
Fix for division by zero in model download speed calculation
2019-06-19 15:10:00 +03:00
Raviv Pavel
ce596c0266 Fix for division by zero in model download speed calculation 2019-06-19 11:40:27 +03:00
allegroai
4c082038c5 version bump 2019-06-17 01:00:17 +03:00
allegroai
005e521da1 Support absl command line arguments 2019-06-17 01:00:06 +03:00
allegroai
fc43ca5ed8 typo 2019-06-17 00:59:46 +03:00
allegroai
ac37cfc55d Fix matplotlib titles 2019-06-17 00:59:37 +03:00
allegroai
089a4c66ff Fix Jupyter support on Windows host 2019-06-16 02:29:05 +03:00
allegroai
e452709492 Extend support for Keras/Tensorflow mix binding 2019-06-16 02:28:27 +03:00
allegroai
3112769ad9 Better support for connecting dictionary parameters 2019-06-16 02:27:47 +03:00
allegroai
06a716fe8b Remove redundant kwargs 2019-06-15 00:31:28 +03:00
allegroai
f8fa394f43 Changed log warning to debug 2019-06-15 00:30:51 +03:00
allegroai
ac9aba9242 Support parameter auto casting int/float 2019-06-15 00:30:32 +03:00
allegroai
3f035ba6ba version bump 2019-06-14 15:11:09 +03:00
allegroai
36c5b2c648 Fix Windows support 2019-06-14 15:10:46 +03:00
allegroai
1a35db241e pep8 2019-06-14 15:10:22 +03:00
allegroai
09c7665bfd Optimize package import time 2019-06-14 15:09:51 +03:00
allegroai
60b2246966 Add Windows conda-less support 2019-06-14 15:09:23 +03:00
allegroai
e24abf2153 Fix config-less defaults 2019-06-14 14:09:35 +03:00
allegroai
600bbbf535 Python 2.7 support 2019-06-14 02:05:17 +03:00
allegroai
4ed33474fe Orderly shutdown threads 2019-06-14 01:04:42 +03:00
allegroai
82103e05e0 Default demo server credentials 2019-06-14 01:02:46 +03:00
allegroai
a1896f5d37 Python 2.7 support 2019-06-14 01:02:23 +03:00
allegroai
225685cede version bump 2019-06-13 01:56:44 +03:00
allegroai
cf1914fa64 Add better signal/exception binding 2019-06-13 01:56:21 +03:00
allegroai
ea3b5856fd Python 2.7 support 2019-06-13 01:55:36 +03:00
allegroai
f7e5f932cd version bump 2019-06-11 20:27:11 +03:00
allegroai
229e0501f9 version bump 2019-06-11 15:16:28 +03:00
allegroai
ac61344648 version bump 2019-06-11 14:50:39 +03:00
allegroai
92b8298697 bugfix, remote task stop from web-app 2019-06-11 14:39:18 +03:00
allegroai
fbfa701b96 add support for demoapp.trainsai.io default host 2019-06-11 14:38:50 +03:00
allegroai
0133298d1b Add easier trains-init configuration 2019-06-11 14:37:06 +03:00
allegroai
f595afe6c8 Initial beta version 2019-06-10 20:02:11 +03:00