ClearML/clearml
1
0
Fork 0
mirror of https://github.com/clearml/clearml synced 2025-02-13 16:14:47 +00:00
Code Issues Actions Packages Projects Releases Wiki Activity
899 Commits 4 Branches 178 Tags 51 MiB
85f6e48d52
Commit Graph

709 Commits

Author SHA1 Message Date
allegroai
19a24c4b20 Fix default argument behavior to match argparse behavior (if value is the same as default, use default value and type) 2020-05-13 20:29:35 +03:00
allegroai
e1f6e5ec6a Fix typo in warning 2020-05-13 20:26:43 +03:00
allegroai
cb6ecb458a Version bump to v0.14.3 2020-05-10 09:49:14 +03:00
allegroai
7962b041c0 Fix code examples in docstrings 2020-05-08 22:16:20 +03:00
allegroai
5d04b21a79 Fix upload_object_via_stream() in Azure storage driver 2020-05-08 22:13:39 +03:00
allegroai
0298b84030 Refactor histogram code for PyTorch Ignite integration 2020-05-08 22:12:49 +03:00
allegroai
966cd6118a Add Model and Task type-annotations 2020-05-08 22:08:48 +03:00
allegroai
f90f8f06e2 Fix Task.get_tasks() return type to Task 2020-05-08 22:07:43 +03:00
allegroai
a5ff2ba9c8 Add Logger histogram mode (stack/group/relative) 2020-05-08 22:05:33 +03:00
allegroai
5a85d40fc7 Add Logger type-annotations 2020-05-08 21:34:47 +03:00
allegroai
3de95063ee Remove auto_connect_arg_parser constraint when ArgumentParser.parse_arg() is used before initializing task 2020-05-08 21:33:54 +03:00
allegroai
8b5377ee4f Add PEP610 support for new pip>=20.1 git reference feature 2020-05-08 21:31:34 +03:00
allegroai
6991e06e14 Fix RGBA upload with default JPEG files 2020-05-08 21:30:02 +03:00
allegroai
031d26a6cf Support '#' and '?' in image names 2020-05-08 21:28:48 +03:00
allegroai
3f52a6088a Version bump to v0.14.2 2020-04-28 15:32:33 +03:00
allegroai
3d9683f290 Fix logger creation guard 2020-04-28 10:44:40 +03:00
allegroai
7dc27b9a5e Rename utilities dir 2020-04-28 10:43:47 +03:00
allegroai
6746144803 Use UID in message if user name cannot be retrieved 2020-04-26 23:22:46 +03:00
allegroai
7085a2bb74 Report GPU memory usage per process (and sub-process) 2020-04-26 23:21:27 +03:00
allegroai
0a7a32f2eb Support caching of extracted zip artifacts 2020-04-26 23:19:42 +03:00
allegroai
6ff3cc0ee4 Fix duplicate suffix for artifacts 2020-04-26 23:17:51 +03:00
allegroai
302a8cbf75 Report memory usage only for the experiment process (and sub-processes) 2020-04-26 23:16:13 +03:00
allegroai
7e839204d1 Raise error in case of missing artifact directory 2020-04-26 23:14:33 +03:00
allegroai
617e5f7c1d Improve Jupyter support by ignoring IPython directives in converted python script (like % and ! lines) 2020-04-26 23:13:00 +03:00
allegroai
d9f2f01bbd Make sure trains is included in Jupyter requirements 2020-04-26 23:11:51 +03:00
allegroai
dbb3346332 Improve module requirements detection 2020-04-26 23:10:45 +03:00
allegroai
9726f782f2 Add requirement parsing optimization using entry point by default 2020-04-26 22:58:13 +03:00
allegroai
7e4fba9d10 Fix scikit-learn module detection 2020-04-26 22:54:49 +03:00
allegroai
13ce783fa3 Check for updates based on session version 2020-04-26 22:53:18 +03:00
allegroai
466b2859d9 Upload debug assets with series / title including dot or slash did not add iteration index to the filename 2020-04-16 16:49:21 +03:00
allegroai
f7b80a0da2 matplotlib with no logger should not use the last iteration reported by the resource monitor 2020-04-16 16:48:19 +03:00
allegroai
cb139f2d17 Fix Tensorflow V1/V2 audio support 2020-04-16 16:46:02 +03:00
allegroai
215aa32239 Detect exception in debugger session, set Task to Failed 2020-04-16 16:43:10 +03:00
allegroai
4eaa77dbdb Fix single log request exceeds max packet size, set limit to 1MB per request 2020-04-16 16:41:18 +03:00
allegroai
7f4b100042 Fix text encoding utf-8 and pr_curve broken in Tensorboard support 2020-04-16 16:40:14 +03:00
allegroai
4bb17ca420 Fix renaming/deleting model file right after saving will break async upload (trains/issues#123) 2020-04-13 19:03:15 +03:00
allegroai
12659307a8 Fix update_weights() to use model upload target file when passed 2020-04-13 19:00:35 +03:00
allegroai
4b9c5c235c Update docstrings 2020-04-13 18:58:39 +03:00
allegroai
648779380c Add media (audio) support for both Logger and Tensorboard bind 2020-04-09 13:14:14 +03:00
allegroai
7ac7e088a1 Add trace feature 2020-04-09 13:12:50 +03:00
allegroai
0df3d38862 Fix self references in configuration when environment variables exist 2020-04-09 13:11:21 +03:00
allegroai
3ac7dbdb49 Refactor shutdown sequence 2020-04-09 13:10:29 +03:00
allegroai
7dae058359 Optimize locking for TaskHandler, avoid lock when shutting down 2020-04-09 13:08:46 +03:00
allegroai
d9aa83380f Stop resource monitoring before signaling task stop 2020-04-09 13:07:26 +03:00
allegroai
ab263bb59f Raise ValueError if Task.get_logger() is called after task was closed 2020-04-09 13:06:06 +03:00
allegroai
3c4925d605 Fix resource monitor and check if task is valid 2020-04-09 13:00:24 +03:00
allegroai
7f00e45d6c Do not recreate logger after Task was closed/exited 2020-04-09 12:59:00 +03:00
allegroai
3f6fb5379a Revert fork patching as signal is not enough and is not called from forked processes 2020-04-09 12:57:50 +03:00
allegroai
5eb4ae6600 Use a daemon thread for the log 2020-04-09 12:56:55 +03:00
allegroai
1b901b7d13 Fix logger in case a packet was dropped before it was overwritten 2020-04-09 12:56:02 +03:00
allegroai
aa737e6b5b Make sure task is marked as started in remote execution (just in case) 2020-04-09 12:53:43 +03:00
allegroai
f61cbdeb39 Check if join was successful when waiting for std flush pool 2020-04-09 12:51:34 +03:00
allegroai
2f395cc76b Use sub-process fork signal hooks instead of os._exit patch 2020-04-09 12:50:04 +03:00
allegroai
004f925454 ThreadPool should be terminated, not closed, otherwise it might hang 2020-04-09 12:47:38 +03:00
allegroai
9916c93ce0 Add 10sec timeout for stdout/stderr flush at end of process 2020-04-09 12:46:30 +03:00
allegroai
1718aa20d4 Add thread_waited_join waited join for Thread/Process Pools 2020-04-09 12:45:06 +03:00
allegroai
23bd6097a8 Add nicer stdout log flush 2020-04-09 12:42:45 +03:00
allegroai
9a0a84a83e Do not wait for logs if we are aborting the task manually (i.e. ctrl-C) 2020-04-09 12:41:10 +03:00
allegroai
98ce0bbe43 Change TaskHandler.close() wait default to False as it should not wait for logs to flush 2020-04-09 12:39:09 +03:00
allegroai
b3c9872a3f Intercept SystemExit and do nothing so we could kill the thread 2020-04-09 12:33:16 +03:00
allegroai
5ec4d80493 Disconnect stdout/stderr logger on exit 2020-04-09 12:31:43 +03:00
allegroai
de9c88bc2d Do not try to wait for Lock 2020-04-09 12:30:42 +03:00
allegroai
337e60a376 Kill repo/package detection thread on exit 2020-04-09 12:28:57 +03:00
allegroai
b2c2002c40 Create dev task manually when constructing the Task 2020-04-09 12:27:13 +03:00
allegroai
11420adce7 Log reports at the end of the task 2020-04-09 12:24:37 +03:00
allegroai
ffedb219d5 Local modules (except trains) imported from a folder inside the git project should not be logged as "local packages", they should be ignored 2020-04-09 12:21:37 +03:00
allegroai
07daf8f5e6 Fix logger sometimes getting stuck at end of experiment 2020-04-09 12:05:56 +03:00
allegroai
e6f29428eb Add StorageManager 2020-04-09 12:03:41 +03:00
allegroai
e1fc9b3dc8 ThreadPool should be terminated, not closed, otherwise it might hang 2020-04-09 11:39:03 +03:00
allegroai
070fd8149a Store the version that matching the Session API so we do not reload every time 2020-04-09 11:35:51 +03:00
allegroai
a425a70fc6 Add api.ssl_error_count_verbosity and make sure SSL retries are taken care by the session 2020-04-09 11:33:55 +03:00
allegroai
101e5393d1 Fix TRAINS_VCS_ROOT path conversion 2020-04-01 19:06:30 +03:00
allegroai
41ca1a2e49 Fix requirements detection to make sure trains is detected even if we execute without actually being installed 2020-04-01 19:04:57 +03:00
allegroai
01772430d6 Ignore virtual-environment folder that might be inside the project's directory 2020-04-01 19:02:54 +03:00
allegroai
6de3d4b6fd Ignore local modules imported from a folder inside the git project 2020-04-01 19:01:21 +03:00
allegroai
172ed62d41 Add Task.get_tasks() filtering support 2020-04-01 18:54:16 +03:00
allegroai
581edf1098 Version bump to v0.14.1 2020-03-24 20:36:57 +02:00
allegroai
c4719f2e2f Add type annotations and fix docstrings 2020-03-23 23:26:46 +02:00
allegroai
766c8ab24f Add Task.models property 2020-03-23 23:25:55 +02:00
allegroai
0211d233d4 Deprecate Task.set_model_config(), Task.get_model_config_text() and Task.get_model_config_dict() 2020-03-23 23:25:16 +02:00
allegroai
023f1721c1 Add Task.get_models() retrieving stored models on previously executed tasks 2020-03-22 18:19:07 +02:00
allegroai
332e9e2f63 Fix Tensorflow direct V2.1 multiple FileWriters 2020-03-22 18:17:16 +02:00
allegroai
493cce443a Reuse Model objects if we are storing local files (reduce clutter) 2020-03-22 18:15:32 +02:00
allegroai
4e2564cd3a Support reusing Models. Use trains.Model as general purpose registered Model. 2020-03-22 18:13:56 +02:00
allegroai
63507c82f7 Fix Model.download_model_weights() to reuse previously downloaded file 2020-03-22 18:11:30 +02:00
allegroai
477665ee33 Fix storage_uri handling in Model.update() 2020-03-22 18:05:05 +02:00
allegroai
abc9b512f7 Fix logging typos 2020-03-22 18:03:25 +02:00
allegroai
7817ef5cda Fix joblib binding 2020-03-20 10:30:13 +02:00
allegroai
5db53ba643 Support multiple EventWriter in TensorFlow eager mode (TF 2.0+) 2020-03-20 10:29:18 +02:00
allegroai
b4050ecf25 Fix TensorFlow NaN/Inf values support 2020-03-20 10:27:52 +02:00
allegroai
babaf9f1ce Add OpenMPI/Slurm support 2020-03-20 10:23:00 +02:00
allegroai
0adbd79975 Fix StorageHelper upload on shutdown 2020-03-20 10:20:44 +02:00
allegroai
dc915d0241 Fix support for Task init/close multiple times 2020-03-20 10:20:06 +02:00
allegroai
667ddcab88 Fix import for services that do not exist in old versions 2020-03-20 10:16:48 +02:00
allegroai
3b1d2d3258 Version bump to v0.14.0 2020-03-12 19:42:48 +02:00
allegroai
afad6a42ea Add initial slurm support (multiple nodes sharing the same task id) 2020-03-12 18:12:16 +02:00
allegroai
5b29aa194c Make sure artifact temporary files names are valid file names 2020-03-12 18:10:03 +02:00
allegroai
84a34428b6 Add trains-init support for config file env override (as well as argument) 2020-03-12 18:09:03 +02:00
allegroai
b3dff9a4eb Support setting task initial iteration for continuing previous runs 2020-03-12 17:40:29 +02:00
allegroai
f3531c1af2 Allow Task.set_credentials() to override configuration file in dev mode 2020-03-12 17:22:09 +02:00
allegroai
5bc39271e3 Fix store uncommitted code configuration option 2020-03-12 17:17:39 +02:00
allegroai
461fbd9df0 Better warning messages for storage errors 2020-03-12 17:13:36 +02:00
allegroai
30cf6b4834 Fix HTTP link quoting in stored links 2020-03-12 17:04:31 +02:00
allegroai
98c9a95338 Add support for reporting tables 2020-03-10 13:30:42 +02:00
allegroai
9e0ea880ce Add missing import 2020-03-08 18:56:28 +02:00
allegroai
b7358d7fef Add portalocker for inter-process lock 2020-03-05 12:31:22 +02:00
allegroai
2e3820603a Allow argparser override values with command line even in remote execution (essential for sub-process support) 2020-03-05 12:28:36 +02:00
allegroai
1d9e70bd8b Fix signal hooking registeration (cont.) 2020-03-05 12:26:56 +02:00
allegroai
181a0be0af Remove temporary file lock at the end of the execution or in Task.close() 2020-03-05 12:25:17 +02:00
allegroai
b0c602c832 Fix signal hooking registeration 2020-03-05 12:24:14 +02:00
allegroai
bcf97afeb9 Forking processes should not pass along the original File based Lock 2020-03-05 12:22:14 +02:00
allegroai
888c53f67d Allow disabling repository detection when calling Task.init() 2020-03-05 12:19:40 +02:00
allegroai
4bca5ccf27 Always reload task section before editing parts of it 2020-03-05 12:11:55 +02:00
allegroai
a2ecb2c75d Only use file based locks for main task. Secondary tasks use traditional multiprocessing lock 2020-03-05 12:10:23 +02:00
allegroai
da804ca75f Add support for Popen subprocesses with task edit protection from multiple processes 2020-03-05 12:05:12 +02:00
allegroai
e3ae4f4e26 Optimize task refresh while pulling task status in local worker and last iteration for Resource Monitoring 2020-03-05 11:40:27 +02:00
Karthikeyan Singaravelan
a97850e5b6 Import ABC from collections.abc instead of collections for Python 3.9 compatibility. 2020-03-03 21:38:03 +05:30
allegroai
146da439e7 Integrate pigar into Trains 2020-03-01 17:12:28 +02:00
allegroai
8ee2bd1844 Retry sending console logs if session.send() fails (applicable only in local mode where we use the logging handler) 2020-02-26 17:07:07 +02:00
allegroai
cf850020fb Don't print empty line at end of process if there's no artifacts summary 2020-02-26 17:06:17 +02:00
allegroai
baf5fc9e54 version bump to v0.13.3 2020-02-23 11:20:21 +02:00
allegroai
8972c1f005 Add Task.[get/set]_parameters_as_dict() to allow interaction with non-main task parameters (no need to connect()) 2020-02-20 18:32:12 +02:00
allegroai
98e6c2004c Use standard os environment variables to obtain default credentials for AWS, Google and Azure 2020-02-20 18:29:53 +02:00
allegroai
b5168010e9 Make sure Task.connect() returns the same value it is passed 2020-02-18 11:26:52 +02:00
allegroai
14588e6dec Refactor utility function 2020-02-18 11:25:29 +02:00
allegroai
3ea570cadf Store python binary along with major.minor version in task script section 2020-02-18 11:24:04 +02:00
allegroai
9fd3b98b24 Fix session error to print the instance host and not the class host 2020-02-18 11:23:06 +02:00
allegroai
edc237dad4 Improve support for tensorboard.summarywriter.addscalars binding 2020-02-18 11:21:47 +02:00
allegroai
f5f13658c3 Add binding for tensorboard.summarywriter.addscalars as well as scalars grouping configuration option 2020-02-12 14:04:53 +02:00
allegroai
63ffc09ae0 Fix incorrect upgrade message 2020-02-12 14:03:24 +02:00
allegroai
0bc71fbcf4 Remove title/series naming restrictions (allow '$' and '.') 2020-02-10 10:30:57 +02:00
allegroai
3ee70beea2 Fix URL for uploaded files with '%' in their name to allow proper unquote during HTTP serving 2020-02-10 10:30:57 +02:00
allegroai
c6849985ea Add Task.set_base_docer() and Task.get_base_docker() 2020-02-10 10:30:57 +02:00
allegroai
8c2b36968b Prefer tensorflow_gpu over tensorflow when inspecting installed packages 2020-02-04 18:00:39 +02:00
allegroai
0c71889ca5 Fix printout during init 2020-02-04 17:59:50 +02:00
allegroai
34d9402abb version bump to v0.13.2 2020-01-27 19:45:56 +02:00
allegroai
7b9e7406ad Fix mutually_exclusive() use of at_least_one() 2020-01-27 15:41:19 +02:00
allegroai
9f8e814ca6 Support git repositories without ".git" suffix 2020-01-27 15:41:19 +02:00
allegroai
923e45bb17 Allow reporting a pre-uploaded image url in Logger.report_image using the url parameter 2020-01-26 15:29:35 +02:00
allegroai
8772bc2755 Version bump 2020-01-22 11:08:41 +02:00
allegroai
d03311764e Fix None type as default value in dictionary 2020-01-22 11:08:06 +02:00
allegroai
b50bfd5b63 Fix default argparser value handling when value is None 2020-01-22 11:06:52 +02:00
allegroai
af0b8f4c70 Fix type check in hyper-parameters argparser integration 2020-01-22 11:03:56 +02:00
allegroai
1e011e10a2 Version bump 2020-01-21 16:41:14 +02:00
allegroai
1cc0ea6cf3 Fix logs, events and jupyter flushing on exit 2020-01-21 16:41:01 +02:00
allegroai
f0a27127bf Fix matplotlib savefig patching 2020-01-21 16:37:26 +02:00
allegroai
c5dd762d9b Improve conda support 2020-01-21 16:32:57 +02:00
allegroai
9a3e130700 version bump to v0.13.1 2020-01-13 17:29:17 +02:00
allegroai
fcaff82980 Add support for pylab.savefig in matplotlib binding 2020-01-13 17:16:56 +02:00
allegroai
0ecd734fd1 Support multi-line paste of credentials in configuration wizard 2020-01-13 17:16:25 +02:00
allegroai
1c6be01e38 Add support for savefig in matplotlib binding 2020-01-13 12:06:47 +02:00
allegroai
66b251a62b Try to make sure tensorboard is available when using torch 2020-01-13 11:55:55 +02:00
Allegro AI
affd6050f6
Merge pull request #79 from danmalowany-allegro/master 
Fix type hint in Logger.report_scatter3d()
 2020-01-12 12:50:10 +02:00
allegroai
5fdb2398df Version bump 2020-01-10 13:42:24 +02:00
allegroai
8da8053726 Do not store keras model network design if it cannot be serialized 2020-01-10 13:41:06 +02:00
allegroai
073f4c308d Convert ndarray to histogram for axis to get rid of warning in tensorflow binding 2020-01-10 13:39:31 +02:00
allegroai
163ace8856 Display matplotlib low version warning only once 2020-01-10 13:36:27 +02:00
allegroai
70624f469b Fix matplotlib binding support 2020-01-10 13:35:07 +02:00
allegroai
f65ef3e757 Support broken Jupyter version on some conda installations (SageMaker) 2020-01-10 13:33:19 +02:00
danmalowany-allegro
b9ee824877
Changed List to list 2020-01-06 18:27:56 +02:00
danmalowany-allegro
457f0b71c8
Fixed scatter type in report_scatter3d to Union 2020-01-06 18:12:00 +02:00
allegroai
80f3dc6790 version bump to v0.13.0 2020-01-06 17:44:28 +02:00
Allegro AI
be8d100e33
Merge pull request #78 from szymonmaszke/patch-1 
Add .pt file extension as PyTorch
 2020-01-06 17:30:31 +02:00
allegroai
30eaed79ea Add warning when automatic argument parser binding cannot be turned off 2020-01-06 17:20:15 +02:00
allegroai
bc33ad0da3 Calculate data-audit artifact uniqueness by user-criteria 2020-01-06 17:19:44 +02:00
allegroai
a169b43885 Add Task.upload_artifact support for external URLs 2020-01-06 17:16:51 +02:00
allegroai
7820e0d14a Use an environment variable for setting a default docker image 2020-01-06 17:09:45 +02:00
allegroai
7b7b6e487e Fix argparser/subparser support and support unsynced connected hyper parameters in remote execution 2020-01-06 17:08:03 +02:00
allegroai
8585d7e134 Avoid retries when verifying invalid credentials 2020-01-06 17:05:37 +02:00
Szymon Maszke
6815dd5410
Add .pt file extension as PyTorch 
Usually `.pt` is used as pytorch's extension, see [this StackOverflow question](https://stackoverflow.com/questions/59095824/what-is-difference-between-pt-pth-and-pwf-extentions-in-pytorch).

Furthermore `.pth` is used by Python to list additional package search paths (see [this PyTorch issue](https://github.com/pytorch/pytorch/issues/14864)) so IMO it might be worth reconsidering existence of it extension. AFAIK `.pt` is advised and used throughout most projects.
 2020-01-06 13:08:54 +01:00
allegroai
54ae340ccb Use source task id to determine cloned task parent 2020-01-02 12:01:03 +02:00
allegroai
62d5535351 Fix requests issue in python 2.7 that can cause a deadlock when importing netrc 2020-01-02 11:58:02 +02:00
allegroai
f4be527a21 Fix typo 2020-01-02 11:55:59 +02:00
allegroai
7110b938ae Fix matplotlib import binding when imported before trains 2019-12-30 18:37:17 +02:00
allegroai
ddeece1f57 Add support for API v2.5 2019-12-30 18:34:28 +02:00
allegroai
ba79471848 Update documentation 2019-12-24 18:20:16 +02:00
allegroai
e4024e01d5 Make sure ProxyDictPreWrite and ProxyDictPostWrite are pickled correctly 2019-12-21 18:33:15 +02:00
allegroai
4e0f711e39 Keep only the input artifacts when cloning a task 2019-12-21 18:30:24 +02:00
allegroai
0be981fbc1 Fix check_min_api_version to use a default session if none was created 2019-12-21 18:28:10 +02:00
allegroai
085eebc6b9 version bump 2019-12-15 15:13:44 +02:00
allegroai
14ce1e925e version bump 2019-12-15 00:11:26 +02:00
allegroai
3bd997c4dc Improve trains-init configuration wizard 2019-12-15 00:11:01 +02:00
allegroai
c1cc80ba1b Optimize artifacts threading 2019-12-15 00:10:34 +02:00
allegroai
a992591f3c Fix artifacts update in auxiliary task 2019-12-15 00:10:12 +02:00
allegroai
67d9a9e5d4 Do not reuse experiment if it has artifacts 2019-12-15 00:09:36 +02:00
allegroai
9add031fe8 Improve trains-init wizard 2019-12-04 23:47:39 +02:00
allegroai
f92278750a Fix default_output_uri in remote execution mode 
Fix arguments order in Task.create
 2019-12-04 23:47:26 +02:00
allegroai
03fbfb8237 version bump 2019-11-28 00:49:27 +02:00
allegroai
7e7329f7a0 Improve argparser automagic support 2019-11-28 00:49:19 +02:00
allegroai
09257b7247 Fix files http/s host ending with / 2019-11-28 00:48:48 +02:00
allegroai
8aa86225e2 Add default_output_uri in trains.conf configuration 
Fix Task.set_credentials support for different web/api/files hosts
 2019-11-23 01:27:45 +02:00
allegroai
8ab982cbc9 Fix support for uploading large files over slow http connection 2019-11-23 01:26:18 +02:00
allegroai
e1a640d37a Fix support for older git versions (<2) 2019-11-23 01:25:37 +02:00
allegroai
7af2d0c9d7 Improve trains-init configuration wizard 2019-11-23 01:25:17 +02:00
allegroai
9f59346c33 version bump 2019-11-15 22:00:31 +02:00
allegroai
603d42792d Fix jsonschema deprecation warning 2019-11-15 22:00:21 +02:00
allegroai
0a45d2094f Add Task connect_configuration, connect_label_enumeration, and support for nested dictionary with connect 
Add Task.get_tasks
 2019-11-15 22:00:10 +02:00
allegroai
15683b5b43 Fix support for auto package detection for standalone scripts 2019-11-15 21:59:50 +02:00
allegroai
d19fde7041 Add artifact get() returning the artifact object (after downloading and loading) 2019-11-15 21:59:36 +02:00
allegroai
b37aea1839 Add Task name and comment setter 2019-11-15 21:59:24 +02:00
李波
f88b9e69f8 fix vdict keys 2019-11-13 15:54:58 +08:00
allegroai
0ccdd5db48 version bump 2019-11-08 22:30:19 +02:00
allegroai
4372dda696 Add Task.init auto_connect_frameworks fine granularity control 2019-11-08 22:30:09 +02:00
allegroai
9362831269 Add sdk.metric.matplotlib_untitled_history_size to limit number of untitled matplotlib plots (default: 100) 2019-11-08 22:29:36 +02:00
allegroai
1bfee56977 Improve Windows support 2019-11-08 22:28:13 +02:00
allegroai
cef3cbaa08 version bump 2019-10-29 22:08:25 +02:00
allegroai
8b11fa18ea typo 2019-10-29 22:08:10 +02:00
allegroai
ac0dfabdfd Improve orchestration pipelines 2019-10-29 22:08:02 +02:00
allegroai
ff0a52c6d1 version bump 2019-10-28 22:01:11 +02:00
allegroai
3527f743a6 Improved check trains package updates 2019-10-28 22:01:01 +02:00
allegroai
bfa22ae82a Fix report surface support for TF 2019-10-28 22:00:11 +02:00
allegroai
492c8dbecb version bump 2019-10-27 00:32:34 +03:00
allegroai
00e66b5d63 Add missing x/y/z axis titles to various logger report 
Changed report_surface arguments
 2019-10-27 00:32:05 +03:00
allegroai
55dcdfce5a version bump 2019-10-25 15:16:28 +03:00
allegroai
81cf2d2261 Embed pyhocon into package, and extend parsing capabilities. 2019-10-25 15:16:18 +03:00
allegroai
2104c3ec6b Add trains-server new capabilities support 2019-10-25 15:15:22 +03:00
allegroai
ac2ea09403 Add trains-server api version 2.4 support 2019-10-25 15:13:41 +03:00
allegroai
6fffb33931 Fix artifacts support on Windows 2019-10-25 15:12:53 +03:00
allegroai
adbe02b62b Optimize scatter 2d plot storage 2019-10-25 15:12:01 +03:00
allegroai
cb3167bdd8 Add x/y/z title for scatter 2d/3d plots 2019-10-25 15:11:26 +03:00
allegroai
07f4b86d51 version bump 2019-10-16 23:36:12 +03:00
allegroai
607a3a8331 version bump 2019-10-15 22:36:13 +03:00
allegroai
cdbf792582 Change second model warning to info 2019-10-15 22:36:04 +03:00
allegroai
1a658e9d89 Fix output_uri support for local folders 2019-10-15 22:35:37 +03:00
allegroai
67fc8e3eb0 Add support for NVIDIA_VISIBLE_DEVICES / CUDA_VISIBLE_DEVICES 2019-10-15 22:34:56 +03:00
allegroai
913a3b5d1b version bump 2019-10-10 21:11:00 +03:00
allegroai
e0e6d9159b Fix python 2.7 and Windows support 2019-10-10 21:10:51 +03:00
allegroai
c1bcce9692 Retry suppression 2019-10-10 21:10:18 +03:00
allegroai
0b875a2dea Changed report_image matrix argument to image (with backwards support) 2019-10-10 21:09:44 +03:00
allegroai
aedd3fc87e version bump 2019-10-06 22:05:55 +03:00
allegroai
0a5696235b Add exception handling when no output uri credentials are found 2019-10-06 21:57:17 +03:00
allegroai
8f0bec5861 Fix windows support for time stamp based sorting 2019-10-06 21:56:46 +03:00
allegroai
79cf18b2b8 version bump 2019-10-06 01:43:48 +03:00
allegroai
02c2a12449 Fix deprecated warning on imports from sklearn 2019-10-06 01:43:37 +03:00
allegroai
c44f3ff11c version bump 2019-10-05 15:26:34 +03:00
allegroai
cfd0344784 Add gpu statistics embedded into package, no need for external packages 2019-10-05 15:26:28 +03:00
allegroai
99a702d149 Add artifacts upload retries (default 3) 2019-10-05 15:25:48 +03:00
allegroai
005f445600 version bump 2019-10-04 01:34:38 +03:00
allegroai
9f73dbabdb Better multi-processing, switching to to multiprocess Lock 2019-10-04 01:34:22 +03:00
allegroai
9e930a6894 Fix urllib retry warning suppression 2019-10-04 01:33:37 +03:00
allegroai
e5c0a738c3 Fix multi-processing issue with Task of type inference 2019-10-04 01:32:59 +03:00
allegroai
6aa22e449e Add alias for task type, train/inference 2019-10-04 01:31:57 +03:00
allegroai
4a42345561 Add support for tuples in hyper-parameters dict 2019-10-04 01:31:26 +03:00
allegroai
a7eb8476ce Add initial Tensorflow v2 support (2.0.0rc1) 2019-09-27 13:24:04 +03:00
allegroai
c44638c8d9 Fix python package analysis timed out before sending git repo detials. 2019-09-27 13:23:32 +03:00
allegroai
3eba23f1a3 Fix multiple matplotlib windows with Agg backend interactive mode, caused duplicate graphs to be sent. 2019-09-27 13:22:17 +03:00
allegroai
b720895307 Fix S3 warning 2019-09-27 13:21:04 +03:00
allegroai
c0ab9a2f52 Fix resource monitor fall back to seconds since experiment started, will keep waiting for any reporting for 30min, while sending monitor report after 3min 2019-09-27 13:20:41 +03:00
allegroai
85c11052c1 version bump 2019-09-25 00:33:12 +03:00
allegroai
86655412b0 Add artifacts support for folders/wildcard, include retrieval and extraction 2019-09-25 00:33:00 +03:00
allegroai
e6ed09664f Fix force flush logs at exit 2019-09-25 00:32:08 +03:00
allegroai
44ffb2985d Change tensorboard default scalar grouping (now False) 2019-09-25 00:31:23 +03:00
allegroai
0cbc99b16d Removed deprecated call 2019-09-25 00:30:46 +03:00
allegroai
dada40dd73 version bump 2019-09-23 18:42:05 +03:00
allegroai
b1d3fc9694 Add Full Artifacts support, including local files/folders, pandas, numpy, images. requires train-server 0.11 and above 2019-09-23 18:41:53 +03:00
allegroai
4f1eeb49c6 Add StorageHelper.get_local_copy to quickly download and provide local path to remote files (http/s3/gs/azure support) 2019-09-23 18:40:56 +03:00
allegroai
0b4f00af4d Restructured Logger with nice clean interface. 
Breaking changes: Logger no longer supports info/error/warning console() replaced with report_text()
 2019-09-23 18:40:13 +03:00
allegroai
1dbe962879 version bump 2019-09-15 21:53:04 +03:00
allegroai
24c2f86741 Add upload artifact supports pd.DataFrame 2019-09-15 21:52:57 +03:00
allegroai
406536d105 version bump 2019-09-15 01:36:42 +03:00
allegroai
8c3f6d254a Fix multiple tasks closing 2019-09-15 01:36:33 +03:00
allegroai
61fb17266f version bump 2019-09-15 00:02:51 +03:00
allegroai
df53ed5577 Fix safe YAML loading 2019-09-15 00:02:42 +03:00
allegroai
b98c821cf9 Fix task cloning 2019-09-15 00:02:23 +03:00
allegroai
c7a687b4a5 version bump 2019-09-14 13:55:54 +03:00
allegroai
933a9ad12e Add trains-init verifies credentials 2019-09-14 13:55:45 +03:00
allegroai
2ba372560e Fix set artifacts storage destination with output_uri 2019-09-14 13:55:17 +03:00
allegroai
648a972199 version bump 2019-09-13 19:08:56 +03:00
allegroai
13dd130c7d Fix always order by created time 2019-09-13 19:08:49 +03:00
allegroai
289063e345 version bump 2019-09-13 17:10:58 +03:00
allegroai
76ea73a780 Removed apache-libcloud 2019-09-13 17:09:58 +03:00
allegroai
d7bdc746b8 Add full artifacts support 2019-09-13 17:09:24 +03:00
allegroai
27ca36687a Add support for upcoming trains-server 2019-09-13 17:08:27 +03:00
allegroai
5b48322b55 Add support for upcoming trains-server 2019-09-13 17:07:48 +03:00
allegroai
64aabbe7d5 version bump 2019-09-09 21:50:26 +03:00
allegroai
9ffee412d7 Add overwriting artifacts 2019-09-09 21:50:18 +03:00
allegroai
1a5ed1132a Fix broken Keras binding support 2019-09-09 21:49:55 +03:00
allegroai
9dfe36db9e version bump 2019-09-07 23:28:41 +03:00
allegroai
3f63394b51 Documentation 2019-09-07 23:28:32 +03:00
allegroai
dc632e160f Improve artifacts support 2019-09-07 23:27:16 +03:00
allegroai
7cb7d891b3 version bump 2019-09-05 01:54:21 +03:00
allegroai
d0b1c6acb5 Sphinx compatibility 2019-09-05 01:54:15 +03:00
allegroai
2fb69ae951 Improve httpdriver authentication feature 2019-09-05 01:53:43 +03:00
allegroai
05364f0796 version bump 2019-09-03 12:59:42 +03:00
allegroai
64ba30df13 Stability and cleanups 2019-09-03 12:58:01 +03:00
allegroai
d4358af1e8 version bump 2019-08-19 21:23:54 +03:00
allegroai
25e3816484 Add permission check for Task.init(output_uri=) 2019-08-19 21:21:21 +03:00
allegroai
1f81a109b7 Simplify Logger interface 2019-08-19 21:20:25 +03:00
allegroai
ad5a44e906 Fix support for plotly 4.0 and matplotlib compatibility 2019-08-19 21:19:44 +03:00
allegroai
a896f5b465 Improve frameworks binding 2019-08-19 21:18:44 +03:00
allegroai
3bc1ec2362 Improve stability and resilience on intermittent network connection 2019-08-19 21:17:53 +03:00
allegroai
0a8cf706bd Add initial Azure storage support 2019-08-19 21:15:31 +03:00
allegroai
dcfd694d4a version bump 2019-08-09 02:20:52 +03:00
allegroai
761082b474 Replace opencv-python with more standard Pillow 2019-08-09 02:18:01 +03:00
allegroai
7beddf97da Optimize version update check 2019-08-09 02:11:00 +03:00
allegroai
c7c0bac5b9 version bump 2019-08-07 00:39:05 +03:00
allegroai
f22278b233 Fix matplotlib support 2019-08-07 00:38:58 +03:00
allegroai
66515eab14 version bump 2019-08-07 00:14:41 +03:00
allegroai
1d6727d2c0 Improve auto package detection 2019-08-07 00:05:51 +03:00
allegroai
3ab1c261e7 Fix matplotlib support 2019-08-07 00:05:24 +03:00
allegroai
fb7dfc49a9 Fix auto-detect git repository 2019-08-01 12:54:11 +03:00
allegroai
e9ad8c7c7f version bump 2019-07-31 23:10:03 +03:00
allegroai
2bbf46a273 Fix Windows support 2019-07-31 23:09:53 +03:00
allegroai
4c15613250 Add support for scikit-learn internal joblib implementation 2019-07-31 01:37:06 +03:00
allegroai
19c5f05912 Add scikit-learn support (joblib) and xgboost support 2019-07-31 00:30:12 +03:00
allegroai
1bb06c0190 version bump 2019-07-28 23:03:42 +03:00
allegroai
67df9774e1 Fix Matplotlib figure.show support 
Improve Matplotlib support, plt.show will show under plots tabs, and plt.imshow under debug images
 2019-07-28 21:06:47 +03:00
allegroai
787da4798b version bump 2019-07-28 21:04:57 +03:00
allegroai
62bc54d7be Add initial artifacts support 
Fix sub-process support
Fix delete_after_upload option when uploading images
Add logugu support
Fix subsample plots if they are too big
Fix requests for over 15mb
 2019-07-28 21:04:45 +03:00
allegroai
120de5c24f Fix PR 2019-07-24 01:44:09 +03:00
Erez Schanider
94642af4a1 Merge remote-tracking branch 'upstream/master' 2019-07-21 08:48:35 +03:00
allegroai
f19401da39 version bump 2019-07-20 23:55:46 +03:00
allegroai
c93d030109 Fix support for sub-process (process pool) 2019-07-20 23:55:14 +03:00
allegroai
c80aae0e1e Fix support for sub-process (process pool) 2019-07-20 23:11:54 +03:00
allegroai
50ce49a3dd Add separate api/web/file server configuration (backward support included). 
OS environment override with:  TRAINS_API_HOST / TRAINS_WEB_HOST / TRAINS_FILES_HOST
 2019-07-20 23:09:44 +03:00
allegroai
00f873081a Add support for multiple event writers in the same session 2019-07-20 22:02:19 +03:00
allegroai
51cc50e239 Add separate api/web/file server configuration (backward support included). 
OS environment override with:  TRAINS_API_HOST / TRAINS_WEB_HOST / TRAINS_FILES_HOST
 2019-07-20 22:01:27 +03:00
Erez Schanider
a0e42c66a1 fix deprecation warning 2019-07-17 09:10:32 +03:00
allegroai
66e5d89268 version bump 2019-07-14 19:55:43 +03:00
allegroai
44aaa39ccf Fix Tensorboard RGB channel order 2019-07-14 19:04:01 +03:00
allegroai
7199dc5d55 version bump 2019-07-14 00:08:54 +03:00
allegroai
f11da65d4a Fix pre-release version should not be recommended 2019-07-14 00:06:31 +03:00
allegroai
ddf1dc2c5a version bump 2019-07-13 23:56:37 +03:00
allegroai
e655dd6cdf Fix pycharm plugin support large git diff over OS environment 2019-07-13 23:56:27 +03:00
allegroai
9c7e0747fb Add support for Azure notebook and google colab 2019-07-13 23:55:34 +03:00
allegroai
7d0bf4838e Add Task.set_credentials for cloud hosted jupyter support 2019-07-13 23:54:47 +03:00
allegroai
cac4ac12b8 Add seaborn support and SVG support for matplotlib 2019-07-13 23:53:19 +03:00
allegroai
c9221e3fbb Add TRAINS_LOG_ENVIRONMENT for OS environment logging 2019-07-13 23:51:27 +03:00
allegroai
c997f6a95a Change warnings to debug messages 2019-07-13 23:50:43 +03:00
allegroai
a4c181e777 version bump 2019-07-10 17:25:38 +03:00
allegroai
339f57f44c Fix Jenkins CI/CD support 2019-07-10 17:25:30 +03:00
allegroai
2e7c2a9292 version bump 2019-07-09 10:14:09 +03:00
allegroai
d5a2383b75 Removed colorama / coloredlogs, they are now optional packages dynamically loaded 2019-07-09 03:05:33 +03:00
allegroai
c4c37c5cef Moved definition 2019-07-09 01:52:06 +03:00
allegroai
d9d5c6cb3c version bump 2019-07-08 23:29:20 +03:00
allegroai
22b18e7338 Optimize repository query and requirements analysis 2019-07-08 23:28:55 +03:00
allegroai
96abe3ef04 Documentation 2019-07-08 23:28:08 +03:00
allegroai
8a1e31c4f0 Add exception guard 2019-07-08 23:27:53 +03:00
allegroai
02ba0e28d5 Fix support non-linear iteration reporting 2019-07-08 23:27:25 +03:00
allegroai
31a0867ac9 Optimize requirements 2019-07-08 23:26:57 +03:00
allegroai
7eb27096ee version bump 2019-07-06 23:03:27 +03:00
allegroai
a1cf210896 Fix python 2.7 support 2019-07-06 23:03:14 +03:00
allegroai
e40d4f2f41 Add new task status and support for reuse override 2019-07-06 23:02:58 +03:00
allegroai
bcb10d7adb Changed, async repository detection and auto-requirements generation. 2019-07-06 23:02:24 +03:00
allegroai
577010c421 Add auto requirement.txt generation 2019-07-06 23:01:15 +03:00
allegroai
3050bf1476 Fix OS environment repository detection override 2019-07-06 23:00:28 +03:00
allegroai
c3eb5fd8b0 Add new API backward compatibility support 2019-07-06 22:59:56 +03:00
allegroai
e7f1e3de86 Add OS environment "TRAINS_TASK_NO_REUSE" forcing new experiment to be created every time 2019-07-06 22:59:20 +03:00
allegroai
7b1c0d8c21 Fix, gpu resource monitoring fail safety mechanism 2019-07-06 22:58:36 +03:00
allegroai
22a65abdc1 Add new task state support 2019-07-06 22:58:01 +03:00