Commit Graph

294 Commits

Author SHA1 Message Date
allegroai
a169b43885 Add Task.upload_artifact support for external URLs 2020-01-06 17:16:51 +02:00
allegroai
7820e0d14a Use an environment variable for setting a default docker image 2020-01-06 17:09:45 +02:00
allegroai
7b7b6e487e Fix argparser/subparser support and support unsynced connected hyper parameters in remote execution 2020-01-06 17:08:03 +02:00
allegroai
8585d7e134 Avoid retries when verifying invalid credentials 2020-01-06 17:05:37 +02:00
Szymon Maszke
6815dd5410
Add .pt file extension as PyTorch
Usually `.pt` is used as pytorch's extension, see [this StackOverflow question](https://stackoverflow.com/questions/59095824/what-is-difference-between-pt-pth-and-pwf-extentions-in-pytorch).

Furthermore `.pth` is used by Python to list additional package search paths (see [this PyTorch issue](https://github.com/pytorch/pytorch/issues/14864)) so IMO it might be worth reconsidering existence of it extension. AFAIK `.pt` is advised and used throughout most projects.
2020-01-06 13:08:54 +01:00
allegroai
54ae340ccb Use source task id to determine cloned task parent 2020-01-02 12:01:03 +02:00
allegroai
62d5535351 Fix requests issue in python 2.7 that can cause a deadlock when importing netrc 2020-01-02 11:58:02 +02:00
allegroai
f4be527a21 Fix typo 2020-01-02 11:55:59 +02:00
allegroai
7110b938ae Fix matplotlib import binding when imported before trains 2019-12-30 18:37:17 +02:00
allegroai
ddeece1f57 Add support for API v2.5 2019-12-30 18:34:28 +02:00
allegroai
ba79471848 Update documentation 2019-12-24 18:20:16 +02:00
allegroai
e4024e01d5 Make sure ProxyDictPreWrite and ProxyDictPostWrite are pickled correctly 2019-12-21 18:33:15 +02:00
allegroai
4e0f711e39 Keep only the input artifacts when cloning a task 2019-12-21 18:30:24 +02:00
allegroai
0be981fbc1 Fix check_min_api_version to use a default session if none was created 2019-12-21 18:28:10 +02:00
allegroai
085eebc6b9 version bump 2019-12-15 15:13:44 +02:00
allegroai
14ce1e925e version bump 2019-12-15 00:11:26 +02:00
allegroai
3bd997c4dc Improve trains-init configuration wizard 2019-12-15 00:11:01 +02:00
allegroai
c1cc80ba1b Optimize artifacts threading 2019-12-15 00:10:34 +02:00
allegroai
a992591f3c Fix artifacts update in auxiliary task 2019-12-15 00:10:12 +02:00
allegroai
67d9a9e5d4 Do not reuse experiment if it has artifacts 2019-12-15 00:09:36 +02:00
allegroai
9add031fe8 Improve trains-init wizard 2019-12-04 23:47:39 +02:00
allegroai
f92278750a Fix default_output_uri in remote execution mode
Fix arguments order in Task.create
2019-12-04 23:47:26 +02:00
allegroai
03fbfb8237 version bump 2019-11-28 00:49:27 +02:00
allegroai
7e7329f7a0 Improve argparser automagic support 2019-11-28 00:49:19 +02:00
allegroai
09257b7247 Fix files http/s host ending with / 2019-11-28 00:48:48 +02:00
allegroai
8aa86225e2 Add default_output_uri in trains.conf configuration
Fix Task.set_credentials support for different web/api/files hosts
2019-11-23 01:27:45 +02:00
allegroai
8ab982cbc9 Fix support for uploading large files over slow http connection 2019-11-23 01:26:18 +02:00
allegroai
e1a640d37a Fix support for older git versions (<2) 2019-11-23 01:25:37 +02:00
allegroai
7af2d0c9d7 Improve trains-init configuration wizard 2019-11-23 01:25:17 +02:00
allegroai
9f59346c33 version bump 2019-11-15 22:00:31 +02:00
allegroai
603d42792d Fix jsonschema deprecation warning 2019-11-15 22:00:21 +02:00
allegroai
0a45d2094f Add Task connect_configuration, connect_label_enumeration, and support for nested dictionary with connect
Add Task.get_tasks
2019-11-15 22:00:10 +02:00
allegroai
15683b5b43 Fix support for auto package detection for standalone scripts 2019-11-15 21:59:50 +02:00
allegroai
d19fde7041 Add artifact get() returning the artifact object (after downloading and loading) 2019-11-15 21:59:36 +02:00
allegroai
b37aea1839 Add Task name and comment setter 2019-11-15 21:59:24 +02:00
李波
f88b9e69f8 fix vdict keys 2019-11-13 15:54:58 +08:00
allegroai
0ccdd5db48 version bump 2019-11-08 22:30:19 +02:00
allegroai
4372dda696 Add Task.init auto_connect_frameworks fine granularity control 2019-11-08 22:30:09 +02:00
allegroai
9362831269 Add sdk.metric.matplotlib_untitled_history_size to limit number of untitled matplotlib plots (default: 100) 2019-11-08 22:29:36 +02:00
allegroai
1bfee56977 Improve Windows support 2019-11-08 22:28:13 +02:00
allegroai
cef3cbaa08 version bump 2019-10-29 22:08:25 +02:00
allegroai
8b11fa18ea typo 2019-10-29 22:08:10 +02:00
allegroai
ac0dfabdfd Improve orchestration pipelines 2019-10-29 22:08:02 +02:00
allegroai
ff0a52c6d1 version bump 2019-10-28 22:01:11 +02:00
allegroai
3527f743a6 Improved check trains package updates 2019-10-28 22:01:01 +02:00
allegroai
bfa22ae82a Fix report surface support for TF 2019-10-28 22:00:11 +02:00
allegroai
492c8dbecb version bump 2019-10-27 00:32:34 +03:00
allegroai
00e66b5d63 Add missing x/y/z axis titles to various logger report
Changed report_surface arguments
2019-10-27 00:32:05 +03:00
allegroai
55dcdfce5a version bump 2019-10-25 15:16:28 +03:00
allegroai
81cf2d2261 Embed pyhocon into package, and extend parsing capabilities. 2019-10-25 15:16:18 +03:00
allegroai
2104c3ec6b Add trains-server new capabilities support 2019-10-25 15:15:22 +03:00
allegroai
ac2ea09403 Add trains-server api version 2.4 support 2019-10-25 15:13:41 +03:00
allegroai
6fffb33931 Fix artifacts support on Windows 2019-10-25 15:12:53 +03:00
allegroai
adbe02b62b Optimize scatter 2d plot storage 2019-10-25 15:12:01 +03:00
allegroai
cb3167bdd8 Add x/y/z title for scatter 2d/3d plots 2019-10-25 15:11:26 +03:00
allegroai
07f4b86d51 version bump 2019-10-16 23:36:12 +03:00
allegroai
607a3a8331 version bump 2019-10-15 22:36:13 +03:00
allegroai
cdbf792582 Change second model warning to info 2019-10-15 22:36:04 +03:00
allegroai
1a658e9d89 Fix output_uri support for local folders 2019-10-15 22:35:37 +03:00
allegroai
67fc8e3eb0 Add support for NVIDIA_VISIBLE_DEVICES / CUDA_VISIBLE_DEVICES 2019-10-15 22:34:56 +03:00
allegroai
913a3b5d1b version bump 2019-10-10 21:11:00 +03:00
allegroai
e0e6d9159b Fix python 2.7 and Windows support 2019-10-10 21:10:51 +03:00
allegroai
c1bcce9692 Retry suppression 2019-10-10 21:10:18 +03:00
allegroai
0b875a2dea Changed report_image matrix argument to image (with backwards support) 2019-10-10 21:09:44 +03:00
allegroai
aedd3fc87e version bump 2019-10-06 22:05:55 +03:00
allegroai
0a5696235b Add exception handling when no output uri credentials are found 2019-10-06 21:57:17 +03:00
allegroai
8f0bec5861 Fix windows support for time stamp based sorting 2019-10-06 21:56:46 +03:00
allegroai
79cf18b2b8 version bump 2019-10-06 01:43:48 +03:00
allegroai
02c2a12449 Fix deprecated warning on imports from sklearn 2019-10-06 01:43:37 +03:00
allegroai
c44f3ff11c version bump 2019-10-05 15:26:34 +03:00
allegroai
cfd0344784 Add gpu statistics embedded into package, no need for external packages 2019-10-05 15:26:28 +03:00
allegroai
99a702d149 Add artifacts upload retries (default 3) 2019-10-05 15:25:48 +03:00
allegroai
005f445600 version bump 2019-10-04 01:34:38 +03:00
allegroai
9f73dbabdb Better multi-processing, switching to to multiprocess Lock 2019-10-04 01:34:22 +03:00
allegroai
9e930a6894 Fix urllib retry warning suppression 2019-10-04 01:33:37 +03:00
allegroai
e5c0a738c3 Fix multi-processing issue with Task of type inference 2019-10-04 01:32:59 +03:00
allegroai
6aa22e449e Add alias for task type, train/inference 2019-10-04 01:31:57 +03:00
allegroai
4a42345561 Add support for tuples in hyper-parameters dict 2019-10-04 01:31:26 +03:00
allegroai
a7eb8476ce Add initial Tensorflow v2 support (2.0.0rc1) 2019-09-27 13:24:04 +03:00
allegroai
c44638c8d9 Fix python package analysis timed out before sending git repo detials. 2019-09-27 13:23:32 +03:00
allegroai
3eba23f1a3 Fix multiple matplotlib windows with Agg backend interactive mode, caused duplicate graphs to be sent. 2019-09-27 13:22:17 +03:00
allegroai
b720895307 Fix S3 warning 2019-09-27 13:21:04 +03:00
allegroai
c0ab9a2f52 Fix resource monitor fall back to seconds since experiment started, will keep waiting for any reporting for 30min, while sending monitor report after 3min 2019-09-27 13:20:41 +03:00
allegroai
85c11052c1 version bump 2019-09-25 00:33:12 +03:00
allegroai
86655412b0 Add artifacts support for folders/wildcard, include retrieval and extraction 2019-09-25 00:33:00 +03:00
allegroai
e6ed09664f Fix force flush logs at exit 2019-09-25 00:32:08 +03:00
allegroai
44ffb2985d Change tensorboard default scalar grouping (now False) 2019-09-25 00:31:23 +03:00
allegroai
0cbc99b16d Removed deprecated call 2019-09-25 00:30:46 +03:00
allegroai
dada40dd73 version bump 2019-09-23 18:42:05 +03:00
allegroai
b1d3fc9694 Add Full Artifacts support, including local files/folders, pandas, numpy, images. requires train-server 0.11 and above 2019-09-23 18:41:53 +03:00
allegroai
4f1eeb49c6 Add StorageHelper.get_local_copy to quickly download and provide local path to remote files (http/s3/gs/azure support) 2019-09-23 18:40:56 +03:00
allegroai
0b4f00af4d Restructured Logger with nice clean interface.
Breaking changes: Logger no longer supports info/error/warning console() replaced with report_text()
2019-09-23 18:40:13 +03:00
allegroai
1dbe962879 version bump 2019-09-15 21:53:04 +03:00
allegroai
24c2f86741 Add upload artifact supports pd.DataFrame 2019-09-15 21:52:57 +03:00
allegroai
406536d105 version bump 2019-09-15 01:36:42 +03:00
allegroai
8c3f6d254a Fix multiple tasks closing 2019-09-15 01:36:33 +03:00
allegroai
61fb17266f version bump 2019-09-15 00:02:51 +03:00
allegroai
df53ed5577 Fix safe YAML loading 2019-09-15 00:02:42 +03:00
allegroai
b98c821cf9 Fix task cloning 2019-09-15 00:02:23 +03:00
allegroai
c7a687b4a5 version bump 2019-09-14 13:55:54 +03:00