ClearML/clearml
1
0
Fork 0
mirror of https://github.com/clearml/clearml synced 2025-06-26 18:16:07 +00:00
Code Issues Actions Packages Projects Releases Wiki Activity
869 Commits 4 Branches 181 Tags 56 MiB
8f65f28d58
Commit Graph

683 Commits

Author SHA1 Message Date
allegroai
9726f782f2 Add requirement parsing optimization using entry point by default 2020-04-26 22:58:13 +03:00
allegroai
7e4fba9d10 Fix scikit-learn module detection 2020-04-26 22:54:49 +03:00
allegroai
13ce783fa3 Check for updates based on session version 2020-04-26 22:53:18 +03:00
allegroai
466b2859d9 Upload debug assets with series / title including dot or slash did not add iteration index to the filename 2020-04-16 16:49:21 +03:00
allegroai
f7b80a0da2 matplotlib with no logger should not use the last iteration reported by the resource monitor 2020-04-16 16:48:19 +03:00
allegroai
cb139f2d17 Fix Tensorflow V1/V2 audio support 2020-04-16 16:46:02 +03:00
allegroai
215aa32239 Detect exception in debugger session, set Task to Failed 2020-04-16 16:43:10 +03:00
allegroai
4eaa77dbdb Fix single log request exceeds max packet size, set limit to 1MB per request 2020-04-16 16:41:18 +03:00
allegroai
7f4b100042 Fix text encoding utf-8 and pr_curve broken in Tensorboard support 2020-04-16 16:40:14 +03:00
allegroai
4bb17ca420 Fix renaming/deleting model file right after saving will break async upload (trains/issues#123) 2020-04-13 19:03:15 +03:00
allegroai
12659307a8 Fix update_weights() to use model upload target file when passed 2020-04-13 19:00:35 +03:00
allegroai
4b9c5c235c Update docstrings 2020-04-13 18:58:39 +03:00
allegroai
648779380c Add media (audio) support for both Logger and Tensorboard bind 2020-04-09 13:14:14 +03:00
allegroai
7ac7e088a1 Add trace feature 2020-04-09 13:12:50 +03:00
allegroai
0df3d38862 Fix self references in configuration when environment variables exist 2020-04-09 13:11:21 +03:00
allegroai
3ac7dbdb49 Refactor shutdown sequence 2020-04-09 13:10:29 +03:00
allegroai
7dae058359 Optimize locking for TaskHandler, avoid lock when shutting down 2020-04-09 13:08:46 +03:00
allegroai
d9aa83380f Stop resource monitoring before signaling task stop 2020-04-09 13:07:26 +03:00
allegroai
ab263bb59f Raise ValueError if Task.get_logger() is called after task was closed 2020-04-09 13:06:06 +03:00
allegroai
3c4925d605 Fix resource monitor and check if task is valid 2020-04-09 13:00:24 +03:00
allegroai
7f00e45d6c Do not recreate logger after Task was closed/exited 2020-04-09 12:59:00 +03:00
allegroai
3f6fb5379a Revert fork patching as signal is not enough and is not called from forked processes 2020-04-09 12:57:50 +03:00
allegroai
5eb4ae6600 Use a daemon thread for the log 2020-04-09 12:56:55 +03:00
allegroai
1b901b7d13 Fix logger in case a packet was dropped before it was overwritten 2020-04-09 12:56:02 +03:00
allegroai
aa737e6b5b Make sure task is marked as started in remote execution (just in case) 2020-04-09 12:53:43 +03:00
allegroai
f61cbdeb39 Check if join was successful when waiting for std flush pool 2020-04-09 12:51:34 +03:00
allegroai
2f395cc76b Use sub-process fork signal hooks instead of os._exit patch 2020-04-09 12:50:04 +03:00
allegroai
004f925454 ThreadPool should be terminated, not closed, otherwise it might hang 2020-04-09 12:47:38 +03:00
allegroai
9916c93ce0 Add 10sec timeout for stdout/stderr flush at end of process 2020-04-09 12:46:30 +03:00
allegroai
1718aa20d4 Add thread_waited_join waited join for Thread/Process Pools 2020-04-09 12:45:06 +03:00
allegroai
23bd6097a8 Add nicer stdout log flush 2020-04-09 12:42:45 +03:00
allegroai
9a0a84a83e Do not wait for logs if we are aborting the task manually (i.e. ctrl-C) 2020-04-09 12:41:10 +03:00
allegroai
98ce0bbe43 Change TaskHandler.close() wait default to False as it should not wait for logs to flush 2020-04-09 12:39:09 +03:00
allegroai
b3c9872a3f Intercept SystemExit and do nothing so we could kill the thread 2020-04-09 12:33:16 +03:00
allegroai
5ec4d80493 Disconnect stdout/stderr logger on exit 2020-04-09 12:31:43 +03:00
allegroai
de9c88bc2d Do not try to wait for Lock 2020-04-09 12:30:42 +03:00
allegroai
337e60a376 Kill repo/package detection thread on exit 2020-04-09 12:28:57 +03:00
allegroai
b2c2002c40 Create dev task manually when constructing the Task 2020-04-09 12:27:13 +03:00
allegroai
11420adce7 Log reports at the end of the task 2020-04-09 12:24:37 +03:00
allegroai
ffedb219d5 Local modules (except trains) imported from a folder inside the git project should not be logged as "local packages", they should be ignored 2020-04-09 12:21:37 +03:00
allegroai
07daf8f5e6 Fix logger sometimes getting stuck at end of experiment 2020-04-09 12:05:56 +03:00
allegroai
e6f29428eb Add StorageManager 2020-04-09 12:03:41 +03:00
allegroai
e1fc9b3dc8 ThreadPool should be terminated, not closed, otherwise it might hang 2020-04-09 11:39:03 +03:00
allegroai
070fd8149a Store the version that matching the Session API so we do not reload every time 2020-04-09 11:35:51 +03:00
allegroai
a425a70fc6 Add api.ssl_error_count_verbosity and make sure SSL retries are taken care by the session 2020-04-09 11:33:55 +03:00
allegroai
101e5393d1 Fix TRAINS_VCS_ROOT path conversion 2020-04-01 19:06:30 +03:00
allegroai
41ca1a2e49 Fix requirements detection to make sure trains is detected even if we execute without actually being installed 2020-04-01 19:04:57 +03:00
allegroai
01772430d6 Ignore virtual-environment folder that might be inside the project's directory 2020-04-01 19:02:54 +03:00
allegroai
6de3d4b6fd Ignore local modules imported from a folder inside the git project 2020-04-01 19:01:21 +03:00
allegroai
172ed62d41 Add Task.get_tasks() filtering support 2020-04-01 18:54:16 +03:00
allegroai
581edf1098 Version bump to v0.14.1 2020-03-24 20:36:57 +02:00
allegroai
c4719f2e2f Add type annotations and fix docstrings 2020-03-23 23:26:46 +02:00
allegroai
766c8ab24f Add Task.models property 2020-03-23 23:25:55 +02:00
allegroai
0211d233d4 Deprecate Task.set_model_config(), Task.get_model_config_text() and Task.get_model_config_dict() 2020-03-23 23:25:16 +02:00
allegroai
023f1721c1 Add Task.get_models() retrieving stored models on previously executed tasks 2020-03-22 18:19:07 +02:00
allegroai
332e9e2f63 Fix Tensorflow direct V2.1 multiple FileWriters 2020-03-22 18:17:16 +02:00
allegroai
493cce443a Reuse Model objects if we are storing local files (reduce clutter) 2020-03-22 18:15:32 +02:00
allegroai
4e2564cd3a Support reusing Models. Use trains.Model as general purpose registered Model. 2020-03-22 18:13:56 +02:00
allegroai
63507c82f7 Fix Model.download_model_weights() to reuse previously downloaded file 2020-03-22 18:11:30 +02:00
allegroai
477665ee33 Fix storage_uri handling in Model.update() 2020-03-22 18:05:05 +02:00
allegroai
abc9b512f7 Fix logging typos 2020-03-22 18:03:25 +02:00
allegroai
7817ef5cda Fix joblib binding 2020-03-20 10:30:13 +02:00
allegroai
5db53ba643 Support multiple EventWriter in TensorFlow eager mode (TF 2.0+) 2020-03-20 10:29:18 +02:00
allegroai
b4050ecf25 Fix TensorFlow NaN/Inf values support 2020-03-20 10:27:52 +02:00
allegroai
babaf9f1ce Add OpenMPI/Slurm support 2020-03-20 10:23:00 +02:00
allegroai
0adbd79975 Fix StorageHelper upload on shutdown 2020-03-20 10:20:44 +02:00
allegroai
dc915d0241 Fix support for Task init/close multiple times 2020-03-20 10:20:06 +02:00
allegroai
667ddcab88 Fix import for services that do not exist in old versions 2020-03-20 10:16:48 +02:00
allegroai
3b1d2d3258 Version bump to v0.14.0 2020-03-12 19:42:48 +02:00
allegroai
afad6a42ea Add initial slurm support (multiple nodes sharing the same task id) 2020-03-12 18:12:16 +02:00
allegroai
5b29aa194c Make sure artifact temporary files names are valid file names 2020-03-12 18:10:03 +02:00
allegroai
84a34428b6 Add trains-init support for config file env override (as well as argument) 2020-03-12 18:09:03 +02:00
allegroai
b3dff9a4eb Support setting task initial iteration for continuing previous runs 2020-03-12 17:40:29 +02:00
allegroai
f3531c1af2 Allow Task.set_credentials() to override configuration file in dev mode 2020-03-12 17:22:09 +02:00
allegroai
5bc39271e3 Fix store uncommitted code configuration option 2020-03-12 17:17:39 +02:00
allegroai
461fbd9df0 Better warning messages for storage errors 2020-03-12 17:13:36 +02:00
allegroai
30cf6b4834 Fix HTTP link quoting in stored links 2020-03-12 17:04:31 +02:00
allegroai
98c9a95338 Add support for reporting tables 2020-03-10 13:30:42 +02:00
allegroai
9e0ea880ce Add missing import 2020-03-08 18:56:28 +02:00
allegroai
b7358d7fef Add portalocker for inter-process lock 2020-03-05 12:31:22 +02:00
allegroai
2e3820603a Allow argparser override values with command line even in remote execution (essential for sub-process support) 2020-03-05 12:28:36 +02:00
allegroai
1d9e70bd8b Fix signal hooking registeration (cont.) 2020-03-05 12:26:56 +02:00
allegroai
181a0be0af Remove temporary file lock at the end of the execution or in Task.close() 2020-03-05 12:25:17 +02:00
allegroai
b0c602c832 Fix signal hooking registeration 2020-03-05 12:24:14 +02:00
allegroai
bcf97afeb9 Forking processes should not pass along the original File based Lock 2020-03-05 12:22:14 +02:00
allegroai
888c53f67d Allow disabling repository detection when calling Task.init() 2020-03-05 12:19:40 +02:00
allegroai
4bca5ccf27 Always reload task section before editing parts of it 2020-03-05 12:11:55 +02:00
allegroai
a2ecb2c75d Only use file based locks for main task. Secondary tasks use traditional multiprocessing lock 2020-03-05 12:10:23 +02:00
allegroai
da804ca75f Add support for Popen subprocesses with task edit protection from multiple processes 2020-03-05 12:05:12 +02:00
allegroai
e3ae4f4e26 Optimize task refresh while pulling task status in local worker and last iteration for Resource Monitoring 2020-03-05 11:40:27 +02:00
Karthikeyan Singaravelan
a97850e5b6 Import ABC from collections.abc instead of collections for Python 3.9 compatibility. 2020-03-03 21:38:03 +05:30
allegroai
146da439e7 Integrate pigar into Trains 2020-03-01 17:12:28 +02:00
allegroai
8ee2bd1844 Retry sending console logs if session.send() fails (applicable only in local mode where we use the logging handler) 2020-02-26 17:07:07 +02:00
allegroai
cf850020fb Don't print empty line at end of process if there's no artifacts summary 2020-02-26 17:06:17 +02:00
allegroai
baf5fc9e54 version bump to v0.13.3 2020-02-23 11:20:21 +02:00
allegroai
8972c1f005 Add Task.[get/set]_parameters_as_dict() to allow interaction with non-main task parameters (no need to connect()) 2020-02-20 18:32:12 +02:00
allegroai
98e6c2004c Use standard os environment variables to obtain default credentials for AWS, Google and Azure 2020-02-20 18:29:53 +02:00
allegroai
b5168010e9 Make sure Task.connect() returns the same value it is passed 2020-02-18 11:26:52 +02:00
allegroai
14588e6dec Refactor utility function 2020-02-18 11:25:29 +02:00
allegroai
3ea570cadf Store python binary along with major.minor version in task script section 2020-02-18 11:24:04 +02:00
allegroai
9fd3b98b24 Fix session error to print the instance host and not the class host 2020-02-18 11:23:06 +02:00
allegroai
edc237dad4 Improve support for tensorboard.summarywriter.addscalars binding 2020-02-18 11:21:47 +02:00
allegroai
f5f13658c3 Add binding for tensorboard.summarywriter.addscalars as well as scalars grouping configuration option 2020-02-12 14:04:53 +02:00
allegroai
63ffc09ae0 Fix incorrect upgrade message 2020-02-12 14:03:24 +02:00
allegroai
0bc71fbcf4 Remove title/series naming restrictions (allow '$' and '.') 2020-02-10 10:30:57 +02:00
allegroai
3ee70beea2 Fix URL for uploaded files with '%' in their name to allow proper unquote during HTTP serving 2020-02-10 10:30:57 +02:00
allegroai
c6849985ea Add Task.set_base_docer() and Task.get_base_docker() 2020-02-10 10:30:57 +02:00
allegroai
8c2b36968b Prefer tensorflow_gpu over tensorflow when inspecting installed packages 2020-02-04 18:00:39 +02:00
allegroai
0c71889ca5 Fix printout during init 2020-02-04 17:59:50 +02:00
allegroai
34d9402abb version bump to v0.13.2 2020-01-27 19:45:56 +02:00
allegroai
7b9e7406ad Fix mutually_exclusive() use of at_least_one() 2020-01-27 15:41:19 +02:00
allegroai
9f8e814ca6 Support git repositories without ".git" suffix 2020-01-27 15:41:19 +02:00
allegroai
923e45bb17 Allow reporting a pre-uploaded image url in Logger.report_image using the url parameter 2020-01-26 15:29:35 +02:00
allegroai
8772bc2755 Version bump 2020-01-22 11:08:41 +02:00
allegroai
d03311764e Fix None type as default value in dictionary 2020-01-22 11:08:06 +02:00
allegroai
b50bfd5b63 Fix default argparser value handling when value is None 2020-01-22 11:06:52 +02:00
allegroai
af0b8f4c70 Fix type check in hyper-parameters argparser integration 2020-01-22 11:03:56 +02:00
allegroai
1e011e10a2 Version bump 2020-01-21 16:41:14 +02:00
allegroai
1cc0ea6cf3 Fix logs, events and jupyter flushing on exit 2020-01-21 16:41:01 +02:00
allegroai
f0a27127bf Fix matplotlib savefig patching 2020-01-21 16:37:26 +02:00
allegroai
c5dd762d9b Improve conda support 2020-01-21 16:32:57 +02:00
allegroai
9a3e130700 version bump to v0.13.1 2020-01-13 17:29:17 +02:00
allegroai
fcaff82980 Add support for pylab.savefig in matplotlib binding 2020-01-13 17:16:56 +02:00
allegroai
0ecd734fd1 Support multi-line paste of credentials in configuration wizard 2020-01-13 17:16:25 +02:00
allegroai
1c6be01e38 Add support for savefig in matplotlib binding 2020-01-13 12:06:47 +02:00
allegroai
66b251a62b Try to make sure tensorboard is available when using torch 2020-01-13 11:55:55 +02:00
Allegro AI
affd6050f6
Merge pull request #79 from danmalowany-allegro/master 
Fix type hint in Logger.report_scatter3d()
 2020-01-12 12:50:10 +02:00
allegroai
5fdb2398df Version bump 2020-01-10 13:42:24 +02:00
allegroai
8da8053726 Do not store keras model network design if it cannot be serialized 2020-01-10 13:41:06 +02:00
allegroai
073f4c308d Convert ndarray to histogram for axis to get rid of warning in tensorflow binding 2020-01-10 13:39:31 +02:00
allegroai
163ace8856 Display matplotlib low version warning only once 2020-01-10 13:36:27 +02:00
allegroai
70624f469b Fix matplotlib binding support 2020-01-10 13:35:07 +02:00
allegroai
f65ef3e757 Support broken Jupyter version on some conda installations (SageMaker) 2020-01-10 13:33:19 +02:00
danmalowany-allegro
b9ee824877
Changed List to list 2020-01-06 18:27:56 +02:00
danmalowany-allegro
457f0b71c8
Fixed scatter type in report_scatter3d to Union 2020-01-06 18:12:00 +02:00
allegroai
80f3dc6790 version bump to v0.13.0 2020-01-06 17:44:28 +02:00
Allegro AI
be8d100e33
Merge pull request #78 from szymonmaszke/patch-1 
Add .pt file extension as PyTorch
 2020-01-06 17:30:31 +02:00
allegroai
30eaed79ea Add warning when automatic argument parser binding cannot be turned off 2020-01-06 17:20:15 +02:00
allegroai
bc33ad0da3 Calculate data-audit artifact uniqueness by user-criteria 2020-01-06 17:19:44 +02:00
allegroai
a169b43885 Add Task.upload_artifact support for external URLs 2020-01-06 17:16:51 +02:00
allegroai
7820e0d14a Use an environment variable for setting a default docker image 2020-01-06 17:09:45 +02:00
allegroai
7b7b6e487e Fix argparser/subparser support and support unsynced connected hyper parameters in remote execution 2020-01-06 17:08:03 +02:00
allegroai
8585d7e134 Avoid retries when verifying invalid credentials 2020-01-06 17:05:37 +02:00
Szymon Maszke
6815dd5410
Add .pt file extension as PyTorch 
Usually `.pt` is used as pytorch's extension, see [this StackOverflow question](https://stackoverflow.com/questions/59095824/what-is-difference-between-pt-pth-and-pwf-extentions-in-pytorch).

Furthermore `.pth` is used by Python to list additional package search paths (see [this PyTorch issue](https://github.com/pytorch/pytorch/issues/14864)) so IMO it might be worth reconsidering existence of it extension. AFAIK `.pt` is advised and used throughout most projects.
 2020-01-06 13:08:54 +01:00
allegroai
54ae340ccb Use source task id to determine cloned task parent 2020-01-02 12:01:03 +02:00
allegroai
62d5535351 Fix requests issue in python 2.7 that can cause a deadlock when importing netrc 2020-01-02 11:58:02 +02:00
allegroai
f4be527a21 Fix typo 2020-01-02 11:55:59 +02:00
allegroai
7110b938ae Fix matplotlib import binding when imported before trains 2019-12-30 18:37:17 +02:00
allegroai
ddeece1f57 Add support for API v2.5 2019-12-30 18:34:28 +02:00
allegroai
ba79471848 Update documentation 2019-12-24 18:20:16 +02:00
allegroai
e4024e01d5 Make sure ProxyDictPreWrite and ProxyDictPostWrite are pickled correctly 2019-12-21 18:33:15 +02:00
allegroai
4e0f711e39 Keep only the input artifacts when cloning a task 2019-12-21 18:30:24 +02:00
allegroai
0be981fbc1 Fix check_min_api_version to use a default session if none was created 2019-12-21 18:28:10 +02:00
allegroai
085eebc6b9 version bump 2019-12-15 15:13:44 +02:00
allegroai
14ce1e925e version bump 2019-12-15 00:11:26 +02:00
allegroai
3bd997c4dc Improve trains-init configuration wizard 2019-12-15 00:11:01 +02:00
allegroai
c1cc80ba1b Optimize artifacts threading 2019-12-15 00:10:34 +02:00
allegroai
a992591f3c Fix artifacts update in auxiliary task 2019-12-15 00:10:12 +02:00
allegroai
67d9a9e5d4 Do not reuse experiment if it has artifacts 2019-12-15 00:09:36 +02:00
allegroai
9add031fe8 Improve trains-init wizard 2019-12-04 23:47:39 +02:00
allegroai
f92278750a Fix default_output_uri in remote execution mode 
Fix arguments order in Task.create
 2019-12-04 23:47:26 +02:00
allegroai
03fbfb8237 version bump 2019-11-28 00:49:27 +02:00
allegroai
7e7329f7a0 Improve argparser automagic support 2019-11-28 00:49:19 +02:00
allegroai
09257b7247 Fix files http/s host ending with / 2019-11-28 00:48:48 +02:00
allegroai
8aa86225e2 Add default_output_uri in trains.conf configuration 
Fix Task.set_credentials support for different web/api/files hosts
 2019-11-23 01:27:45 +02:00
allegroai
8ab982cbc9 Fix support for uploading large files over slow http connection 2019-11-23 01:26:18 +02:00
allegroai
e1a640d37a Fix support for older git versions (<2) 2019-11-23 01:25:37 +02:00
allegroai
7af2d0c9d7 Improve trains-init configuration wizard 2019-11-23 01:25:17 +02:00
allegroai
9f59346c33 version bump 2019-11-15 22:00:31 +02:00
allegroai
603d42792d Fix jsonschema deprecation warning 2019-11-15 22:00:21 +02:00
allegroai
0a45d2094f Add Task connect_configuration, connect_label_enumeration, and support for nested dictionary with connect 
Add Task.get_tasks
 2019-11-15 22:00:10 +02:00
allegroai
15683b5b43 Fix support for auto package detection for standalone scripts 2019-11-15 21:59:50 +02:00
allegroai
d19fde7041 Add artifact get() returning the artifact object (after downloading and loading) 2019-11-15 21:59:36 +02:00
allegroai
b37aea1839 Add Task name and comment setter 2019-11-15 21:59:24 +02:00
李波
f88b9e69f8 fix vdict keys 2019-11-13 15:54:58 +08:00
allegroai
0ccdd5db48 version bump 2019-11-08 22:30:19 +02:00
allegroai
4372dda696 Add Task.init auto_connect_frameworks fine granularity control 2019-11-08 22:30:09 +02:00
allegroai
9362831269 Add sdk.metric.matplotlib_untitled_history_size to limit number of untitled matplotlib plots (default: 100) 2019-11-08 22:29:36 +02:00
allegroai
1bfee56977 Improve Windows support 2019-11-08 22:28:13 +02:00
allegroai
cef3cbaa08 version bump 2019-10-29 22:08:25 +02:00
allegroai
8b11fa18ea typo 2019-10-29 22:08:10 +02:00
allegroai
ac0dfabdfd Improve orchestration pipelines 2019-10-29 22:08:02 +02:00
allegroai
ff0a52c6d1 version bump 2019-10-28 22:01:11 +02:00
allegroai
3527f743a6 Improved check trains package updates 2019-10-28 22:01:01 +02:00
allegroai
bfa22ae82a Fix report surface support for TF 2019-10-28 22:00:11 +02:00
allegroai
492c8dbecb version bump 2019-10-27 00:32:34 +03:00
allegroai
00e66b5d63 Add missing x/y/z axis titles to various logger report 
Changed report_surface arguments
 2019-10-27 00:32:05 +03:00
allegroai
55dcdfce5a version bump 2019-10-25 15:16:28 +03:00
allegroai
81cf2d2261 Embed pyhocon into package, and extend parsing capabilities. 2019-10-25 15:16:18 +03:00
allegroai
2104c3ec6b Add trains-server new capabilities support 2019-10-25 15:15:22 +03:00
allegroai
ac2ea09403 Add trains-server api version 2.4 support 2019-10-25 15:13:41 +03:00
allegroai
6fffb33931 Fix artifacts support on Windows 2019-10-25 15:12:53 +03:00
allegroai
adbe02b62b Optimize scatter 2d plot storage 2019-10-25 15:12:01 +03:00
allegroai
cb3167bdd8 Add x/y/z title for scatter 2d/3d plots 2019-10-25 15:11:26 +03:00
allegroai
07f4b86d51 version bump 2019-10-16 23:36:12 +03:00
allegroai
607a3a8331 version bump 2019-10-15 22:36:13 +03:00
allegroai
cdbf792582 Change second model warning to info 2019-10-15 22:36:04 +03:00
allegroai
1a658e9d89 Fix output_uri support for local folders 2019-10-15 22:35:37 +03:00
allegroai
67fc8e3eb0 Add support for NVIDIA_VISIBLE_DEVICES / CUDA_VISIBLE_DEVICES 2019-10-15 22:34:56 +03:00
allegroai
913a3b5d1b version bump 2019-10-10 21:11:00 +03:00
allegroai
e0e6d9159b Fix python 2.7 and Windows support 2019-10-10 21:10:51 +03:00
allegroai
c1bcce9692 Retry suppression 2019-10-10 21:10:18 +03:00
allegroai
0b875a2dea Changed report_image matrix argument to image (with backwards support) 2019-10-10 21:09:44 +03:00
allegroai
aedd3fc87e version bump 2019-10-06 22:05:55 +03:00
allegroai
0a5696235b Add exception handling when no output uri credentials are found 2019-10-06 21:57:17 +03:00
allegroai
8f0bec5861 Fix windows support for time stamp based sorting 2019-10-06 21:56:46 +03:00
allegroai
79cf18b2b8 version bump 2019-10-06 01:43:48 +03:00
allegroai
02c2a12449 Fix deprecated warning on imports from sklearn 2019-10-06 01:43:37 +03:00
allegroai
c44f3ff11c version bump 2019-10-05 15:26:34 +03:00
allegroai
cfd0344784 Add gpu statistics embedded into package, no need for external packages 2019-10-05 15:26:28 +03:00
allegroai
99a702d149 Add artifacts upload retries (default 3) 2019-10-05 15:25:48 +03:00
allegroai
005f445600 version bump 2019-10-04 01:34:38 +03:00
allegroai
9f73dbabdb Better multi-processing, switching to to multiprocess Lock 2019-10-04 01:34:22 +03:00
allegroai
9e930a6894 Fix urllib retry warning suppression 2019-10-04 01:33:37 +03:00
allegroai
e5c0a738c3 Fix multi-processing issue with Task of type inference 2019-10-04 01:32:59 +03:00
allegroai
6aa22e449e Add alias for task type, train/inference 2019-10-04 01:31:57 +03:00
allegroai
4a42345561 Add support for tuples in hyper-parameters dict 2019-10-04 01:31:26 +03:00
allegroai
a7eb8476ce Add initial Tensorflow v2 support (2.0.0rc1) 2019-09-27 13:24:04 +03:00
allegroai
c44638c8d9 Fix python package analysis timed out before sending git repo detials. 2019-09-27 13:23:32 +03:00
allegroai
3eba23f1a3 Fix multiple matplotlib windows with Agg backend interactive mode, caused duplicate graphs to be sent. 2019-09-27 13:22:17 +03:00
allegroai
b720895307 Fix S3 warning 2019-09-27 13:21:04 +03:00
allegroai
c0ab9a2f52 Fix resource monitor fall back to seconds since experiment started, will keep waiting for any reporting for 30min, while sending monitor report after 3min 2019-09-27 13:20:41 +03:00
allegroai
85c11052c1 version bump 2019-09-25 00:33:12 +03:00
allegroai
86655412b0 Add artifacts support for folders/wildcard, include retrieval and extraction 2019-09-25 00:33:00 +03:00
allegroai
e6ed09664f Fix force flush logs at exit 2019-09-25 00:32:08 +03:00
allegroai
44ffb2985d Change tensorboard default scalar grouping (now False) 2019-09-25 00:31:23 +03:00
allegroai
0cbc99b16d Removed deprecated call 2019-09-25 00:30:46 +03:00
allegroai
dada40dd73 version bump 2019-09-23 18:42:05 +03:00
allegroai
b1d3fc9694 Add Full Artifacts support, including local files/folders, pandas, numpy, images. requires train-server 0.11 and above 2019-09-23 18:41:53 +03:00
allegroai
4f1eeb49c6 Add StorageHelper.get_local_copy to quickly download and provide local path to remote files (http/s3/gs/azure support) 2019-09-23 18:40:56 +03:00
allegroai
0b4f00af4d Restructured Logger with nice clean interface. 
Breaking changes: Logger no longer supports info/error/warning console() replaced with report_text()
 2019-09-23 18:40:13 +03:00
allegroai
1dbe962879 version bump 2019-09-15 21:53:04 +03:00
allegroai
24c2f86741 Add upload artifact supports pd.DataFrame 2019-09-15 21:52:57 +03:00
allegroai
406536d105 version bump 2019-09-15 01:36:42 +03:00
allegroai
8c3f6d254a Fix multiple tasks closing 2019-09-15 01:36:33 +03:00
allegroai
61fb17266f version bump 2019-09-15 00:02:51 +03:00
allegroai
df53ed5577 Fix safe YAML loading 2019-09-15 00:02:42 +03:00
allegroai
b98c821cf9 Fix task cloning 2019-09-15 00:02:23 +03:00
allegroai
c7a687b4a5 version bump 2019-09-14 13:55:54 +03:00
allegroai
933a9ad12e Add trains-init verifies credentials 2019-09-14 13:55:45 +03:00
allegroai
2ba372560e Fix set artifacts storage destination with output_uri 2019-09-14 13:55:17 +03:00
allegroai
648a972199 version bump 2019-09-13 19:08:56 +03:00
allegroai
13dd130c7d Fix always order by created time 2019-09-13 19:08:49 +03:00
allegroai
289063e345 version bump 2019-09-13 17:10:58 +03:00
allegroai
76ea73a780 Removed apache-libcloud 2019-09-13 17:09:58 +03:00
allegroai
d7bdc746b8 Add full artifacts support 2019-09-13 17:09:24 +03:00
allegroai
27ca36687a Add support for upcoming trains-server 2019-09-13 17:08:27 +03:00
allegroai
5b48322b55 Add support for upcoming trains-server 2019-09-13 17:07:48 +03:00
allegroai
64aabbe7d5 version bump 2019-09-09 21:50:26 +03:00
allegroai
9ffee412d7 Add overwriting artifacts 2019-09-09 21:50:18 +03:00
allegroai
1a5ed1132a Fix broken Keras binding support 2019-09-09 21:49:55 +03:00
allegroai
9dfe36db9e version bump 2019-09-07 23:28:41 +03:00
allegroai
3f63394b51 Documentation 2019-09-07 23:28:32 +03:00
allegroai
dc632e160f Improve artifacts support 2019-09-07 23:27:16 +03:00
allegroai
7cb7d891b3 version bump 2019-09-05 01:54:21 +03:00
allegroai
d0b1c6acb5 Sphinx compatibility 2019-09-05 01:54:15 +03:00
allegroai
2fb69ae951 Improve httpdriver authentication feature 2019-09-05 01:53:43 +03:00
allegroai
05364f0796 version bump 2019-09-03 12:59:42 +03:00
allegroai
64ba30df13 Stability and cleanups 2019-09-03 12:58:01 +03:00
allegroai
d4358af1e8 version bump 2019-08-19 21:23:54 +03:00
allegroai
25e3816484 Add permission check for Task.init(output_uri=) 2019-08-19 21:21:21 +03:00
allegroai
1f81a109b7 Simplify Logger interface 2019-08-19 21:20:25 +03:00
allegroai
ad5a44e906 Fix support for plotly 4.0 and matplotlib compatibility 2019-08-19 21:19:44 +03:00
allegroai
a896f5b465 Improve frameworks binding 2019-08-19 21:18:44 +03:00
allegroai
3bc1ec2362 Improve stability and resilience on intermittent network connection 2019-08-19 21:17:53 +03:00
allegroai
0a8cf706bd Add initial Azure storage support 2019-08-19 21:15:31 +03:00
allegroai
dcfd694d4a version bump 2019-08-09 02:20:52 +03:00
allegroai
761082b474 Replace opencv-python with more standard Pillow 2019-08-09 02:18:01 +03:00
allegroai
7beddf97da Optimize version update check 2019-08-09 02:11:00 +03:00
allegroai
c7c0bac5b9 version bump 2019-08-07 00:39:05 +03:00
allegroai
f22278b233 Fix matplotlib support 2019-08-07 00:38:58 +03:00
allegroai
66515eab14 version bump 2019-08-07 00:14:41 +03:00
allegroai
1d6727d2c0 Improve auto package detection 2019-08-07 00:05:51 +03:00
allegroai
3ab1c261e7 Fix matplotlib support 2019-08-07 00:05:24 +03:00
allegroai
fb7dfc49a9 Fix auto-detect git repository 2019-08-01 12:54:11 +03:00
allegroai
e9ad8c7c7f version bump 2019-07-31 23:10:03 +03:00
allegroai
2bbf46a273 Fix Windows support 2019-07-31 23:09:53 +03:00
allegroai
4c15613250 Add support for scikit-learn internal joblib implementation 2019-07-31 01:37:06 +03:00
allegroai
19c5f05912 Add scikit-learn support (joblib) and xgboost support 2019-07-31 00:30:12 +03:00
allegroai
1bb06c0190 version bump 2019-07-28 23:03:42 +03:00
allegroai
67df9774e1 Fix Matplotlib figure.show support 
Improve Matplotlib support, plt.show will show under plots tabs, and plt.imshow under debug images
 2019-07-28 21:06:47 +03:00
allegroai
787da4798b version bump 2019-07-28 21:04:57 +03:00
allegroai
62bc54d7be Add initial artifacts support 
Fix sub-process support
Fix delete_after_upload option when uploading images
Add logugu support
Fix subsample plots if they are too big
Fix requests for over 15mb
 2019-07-28 21:04:45 +03:00
allegroai
120de5c24f Fix PR 2019-07-24 01:44:09 +03:00
Erez Schanider
94642af4a1 Merge remote-tracking branch 'upstream/master' 2019-07-21 08:48:35 +03:00
allegroai
f19401da39 version bump 2019-07-20 23:55:46 +03:00
allegroai
c93d030109 Fix support for sub-process (process pool) 2019-07-20 23:55:14 +03:00
allegroai
c80aae0e1e Fix support for sub-process (process pool) 2019-07-20 23:11:54 +03:00
allegroai
50ce49a3dd Add separate api/web/file server configuration (backward support included). 
OS environment override with:  TRAINS_API_HOST / TRAINS_WEB_HOST / TRAINS_FILES_HOST
 2019-07-20 23:09:44 +03:00
allegroai
00f873081a Add support for multiple event writers in the same session 2019-07-20 22:02:19 +03:00
allegroai
51cc50e239 Add separate api/web/file server configuration (backward support included). 
OS environment override with:  TRAINS_API_HOST / TRAINS_WEB_HOST / TRAINS_FILES_HOST
 2019-07-20 22:01:27 +03:00
Erez Schanider
a0e42c66a1 fix deprecation warning 2019-07-17 09:10:32 +03:00
allegroai
66e5d89268 version bump 2019-07-14 19:55:43 +03:00
allegroai
44aaa39ccf Fix Tensorboard RGB channel order 2019-07-14 19:04:01 +03:00
allegroai
7199dc5d55 version bump 2019-07-14 00:08:54 +03:00
allegroai
f11da65d4a Fix pre-release version should not be recommended 2019-07-14 00:06:31 +03:00
allegroai
ddf1dc2c5a version bump 2019-07-13 23:56:37 +03:00
allegroai
e655dd6cdf Fix pycharm plugin support large git diff over OS environment 2019-07-13 23:56:27 +03:00
allegroai
9c7e0747fb Add support for Azure notebook and google colab 2019-07-13 23:55:34 +03:00
allegroai
7d0bf4838e Add Task.set_credentials for cloud hosted jupyter support 2019-07-13 23:54:47 +03:00
allegroai
cac4ac12b8 Add seaborn support and SVG support for matplotlib 2019-07-13 23:53:19 +03:00
allegroai
c9221e3fbb Add TRAINS_LOG_ENVIRONMENT for OS environment logging 2019-07-13 23:51:27 +03:00
allegroai
c997f6a95a Change warnings to debug messages 2019-07-13 23:50:43 +03:00
allegroai
a4c181e777 version bump 2019-07-10 17:25:38 +03:00
allegroai
339f57f44c Fix Jenkins CI/CD support 2019-07-10 17:25:30 +03:00
allegroai
2e7c2a9292 version bump 2019-07-09 10:14:09 +03:00
allegroai
d5a2383b75 Removed colorama / coloredlogs, they are now optional packages dynamically loaded 2019-07-09 03:05:33 +03:00
allegroai
c4c37c5cef Moved definition 2019-07-09 01:52:06 +03:00
allegroai
d9d5c6cb3c version bump 2019-07-08 23:29:20 +03:00
allegroai
22b18e7338 Optimize repository query and requirements analysis 2019-07-08 23:28:55 +03:00
allegroai
96abe3ef04 Documentation 2019-07-08 23:28:08 +03:00
allegroai
8a1e31c4f0 Add exception guard 2019-07-08 23:27:53 +03:00
allegroai
02ba0e28d5 Fix support non-linear iteration reporting 2019-07-08 23:27:25 +03:00
allegroai
31a0867ac9 Optimize requirements 2019-07-08 23:26:57 +03:00
allegroai
7eb27096ee version bump 2019-07-06 23:03:27 +03:00
allegroai
a1cf210896 Fix python 2.7 support 2019-07-06 23:03:14 +03:00
allegroai
e40d4f2f41 Add new task status and support for reuse override 2019-07-06 23:02:58 +03:00
allegroai
bcb10d7adb Changed, async repository detection and auto-requirements generation. 2019-07-06 23:02:24 +03:00
allegroai
577010c421 Add auto requirement.txt generation 2019-07-06 23:01:15 +03:00
allegroai
3050bf1476 Fix OS environment repository detection override 2019-07-06 23:00:28 +03:00
allegroai
c3eb5fd8b0 Add new API backward compatibility support 2019-07-06 22:59:56 +03:00
allegroai
e7f1e3de86 Add OS environment "TRAINS_TASK_NO_REUSE" forcing new experiment to be created every time 2019-07-06 22:59:20 +03:00
allegroai
7b1c0d8c21 Fix, gpu resource monitoring fail safety mechanism 2019-07-06 22:58:36 +03:00
allegroai
22a65abdc1 Add new task state support 2019-07-06 22:58:01 +03:00
allegroai
b5219d98de Add new API backward compatibility support 2019-07-06 22:57:21 +03:00
allegroai
d38f0ec14d Add new API backward compatibility support 2019-07-06 22:56:55 +03:00
allegroai
2f3ff16e67 Add new API version support 2019-07-06 22:56:17 +03:00
allegroai
f2829e1162 Fix, multiple experiments in the same session 2019-07-04 01:21:34 +03:00
allegroai
700a927f42 version bump 2019-07-02 00:00:14 +03:00
allegroai
738f00340a Fix resource monitor fall back to seconds-from-start 2019-07-02 00:00:05 +03:00
allegroai
4099efc26b version bump 2019-07-01 22:23:50 +03:00
allegroai
8475ecaed8 Python 2 support 2019-07-01 22:23:40 +03:00
Allegro AI
8894981a19
Hot fix, version bump 2019-06-30 10:55:44 +03:00
Allegro AI
a6e70f783a
Hot fix, release 2019-06-30 10:53:38 +03:00
eyalto
161d086d67
changes enum in requirements txt 2019-06-30 10:39:32 +03:00
allegroai
6a69b935d4 version bump 2019-06-27 23:23:03 +03:00
allegroai
d27dc352cb Changed, resource monitor prefer sync to iterations, over seconds from beginning of experiment 2019-06-27 23:22:28 +03:00
allegroai
85e783cc6b Add resource monitoring ability machine/gpu 2019-06-24 01:02:41 +03:00
allegroai
85f702d594 version bump 2019-06-20 19:04:54 +03:00
allegroai
e18964b5df version bump 2019-06-20 03:34:08 +03:00
allegroai
2c1e314fbf Fix python 2.7 debugger threading issues 2019-06-20 03:33:57 +03:00
allegroai
39ba074b70 Add report_histogram is the same as report_vector 2019-06-20 03:32:15 +03:00
allegroai
74fe96f17c Refactored binding, better support for matplotlib jupyter binding 2019-06-20 03:31:22 +03:00
allegroai
2d3d532b11 version bump 2019-06-20 01:50:52 +03:00
allegroai
a77b470500 Refactored binding, better support for matplotlib jupyter binding 2019-06-20 01:50:40 +03:00
allegroai
ff8652f39f Fix support for local git branch, without matching remote branch 2019-06-20 01:49:37 +03:00
allegroai
77e2c32523 Fix timeout for uploading images 2019-06-19 19:47:12 +03:00
allegroai
cc536a8f3f Add latest package check, as long as we are in pre-release. 2019-06-19 19:46:47 +03:00
allegroai
45c2c612b0 version bump 2019-06-19 15:14:41 +03:00
allegroai
675dc32528 Add api.verify_certificate to allow non-verified ssl connection (enterprise firewall mitm scenarios), by defaults only secured connections are allowed. 
Add latest package check, as long as we are in pre-release.
 2019-06-19 15:14:28 +03:00