ClearML/clearml
1
0
Fork 0
mirror of https://github.com/clearml/clearml synced 2025-02-12 23:54:54 +00:00
Code Issues Actions Packages Projects Releases Wiki Activity
900 Commits 4 Branches 178 Tags 51 MiB
f7cb4e3e9c
Commit Graph

710 Commits

Author SHA1 Message Date
allegroai
1a39973cb9 Fix ArgParse auto-connect to support default function type (stored as empty string, ignored when running remotely) and type string with default value None (ignored when running remotely and None value is kept) 2020-10-04 16:58:50 +03:00
allegroai
765afcbb64 Fix Task.execute_remotely() not clearing development tag resulting in experiment not being editable in the UI 2020-10-04 16:54:24 +03:00
allegroai
ce09a78578 Use specific default_demo_host (default_host may be overridden by Task.set_credentials) 2020-10-04 16:52:28 +03:00
Shaked Klein Orbach
7590d601f7 add support for TRAINS_NO_DEFAULT_SERVER issue #209 2020-10-01 19:54:05 +03:00
Shaked Klein Orbach
e1c5aeed06 add support for TRAINS_NO_DEFAULT_SERVER issue #209 2020-10-01 19:54:05 +03:00
allegroai
8adfa3ebd2 Fix Task.clone() did not copy the configuration section 2020-10-01 16:17:02 +03:00
allegroai
75a88f0d6e Safer code 2020-10-01 16:15:37 +03:00
allegroai
b84a781860 version bump 2020-09-29 19:28:54 +03:00
allegroai
295b33857c Fix optimizer monitor 2020-09-29 19:28:42 +03:00
allegroai
be099f42f9 Support Keras restructuring for Network, Model and Sequential 2020-09-29 19:27:43 +03:00
allegroai
5094ede309 Don't add pandas artifact unnamed:0 column, return original pandas object. 2020-09-29 19:21:37 +03:00
allegroai
30a08ee937 Add set ResourceMonitor iteration wait duration timeout (issue #208) 2020-09-29 19:19:35 +03:00
allegroai
86da29b560 Fix TrainsJob hyperparams overriding order was not guaranteed 2020-09-29 19:18:49 +03:00
allegroai
55ac24aa9a Exclude argsparser arguments and copy hyperparms in Task.clone() if API < 2.9 2020-09-29 19:18:04 +03:00
allegroai
cd77f0b8c8 Add ArgParser default help (if not provided) 2020-09-29 19:15:11 +03:00
allegroai
2065288a90 Add improved trace filtering capabilities 2020-09-29 19:14:10 +03:00
allegroai
8e859503f6 Don't raise error for batch requests with no items 2020-09-29 19:10:00 +03:00
allegroai
ab9487c4e0 Update Session API version according to max server reported version 2020-09-29 19:09:07 +03:00
allegroai
8ec6bba4d9 Fix Optimizer limits and values, update trains version in examples 2020-09-15 19:14:45 +03:00
allegroai
ab5059e8e1 Fix Task.init() casts init task_type None to str 2020-09-15 18:15:02 +03:00
allegroai
6bc9d705a0 Fix available versions loading 2020-09-15 18:14:05 +03:00
allegroai
2a249c41f0 If possible, do not use api tasks object directly (use Task instead) 2020-09-15 18:13:07 +03:00
allegroai
d36f6c26da Fix auto model logging using relative path (use full absolute path) 2020-09-15 18:11:31 +03:00
allegroai
2a2d4b6114 Add git diff on repository submodule (requires git 2.14 or above) 2020-09-15 18:10:02 +03:00
allegroai
3466cc0789 Fix scatter2d sub-sampling and rounding 2020-09-15 18:08:57 +03:00
allegroai
10ec4d56fb version bump 2020-09-09 22:11:45 +03:00
allegroai
0797f23f36 pep8 2020-09-09 22:11:29 +03:00
allegroai
e206232126 Improve pipeline controller 2020-09-09 22:11:18 +03:00
allegroai
2c47e9f248 Fix joblib auto logging models failing on compressed streams, issue #203 2020-09-09 22:10:59 +03:00
allegroai
299ce14515 Fix sending empty reports, issue #205 2020-09-09 22:10:59 +03:00
allegroai
f4917572bb Remove warning on skipped auto-magic model logging 2020-09-09 22:09:02 +03:00
allegroai
fede603a7b Fix upload message 2020-09-09 22:08:22 +03:00
allegroai
33f42def54 pep8 2020-09-09 22:07:50 +03:00
allegroai
24ab1ecc2d Fix Windows support for install package analysis 2020-09-09 22:07:35 +03:00
allegroai
7eedd30097 pep8 2020-09-09 22:06:04 +03:00
allegroai
03e7ebd48c Add pipeline controller tag-per-step option. Pipeline controller parameters can now be any type. 2020-09-05 16:31:01 +03:00
allegroai
86aa3aaa98 Fix docstrings 2020-09-05 16:30:00 +03:00
allegroai
fae11edf1b Fix NaN in plotly plots (matplotlib conversion) 
Add sdk.metrics.plot_max_num_digits to limit the number of digits in a plot (reduce plot sizes)
 2020-09-05 16:28:24 +03:00
allegroai
c30b6d27e8 Fix failed controller pipeline tasks were considered completed 2020-09-05 16:26:40 +03:00
allegroai
646163a2cb Fix matplotlib _reporter refactoring 2020-09-05 16:25:28 +03:00
allegroai
5beecbb078 Add Pipeline Controller automation and example 2020-09-01 18:00:19 +03:00
allegroai
4f06ab1c59 Fix thread wait Ctrl-C interrupt did not exit process 2020-09-01 17:58:42 +03:00
allegroai
134fabb7a2 Add Task.logger property 2020-09-01 17:56:38 +03:00
allegroai
4c77cd1479 Rename Task.reporter to Task._reporter (deprecated) 2020-09-01 17:47:40 +03:00
allegroai
99a8724bec Fix Task.wait_for_status() to reload after it ends 2020-09-01 17:46:24 +03:00
allegroai
d148fe8042 Add TrainsJob.is_completed()/is_aborted() 2020-09-01 17:45:08 +03:00
allegroai
fd165f7126 Fix docstrings 2020-09-01 17:44:26 +03:00
allegroai
19822419b6 Version bump to v0.16.1 2020-08-27 15:07:05 +03:00
allegroai
f11c6f5f27 Improve HyperParameterOptimizer 2020-08-27 15:05:21 +03:00
allegroai
b25ca9b384 Fix double-escaped design when connecting OutputModel 2020-08-27 15:04:03 +03:00
allegroai
838c9cb0d2 Fix HyperParameter optimizer to create Task of type optimizer 2020-08-23 01:06:59 +03:00
allegroai
e1bbc03001 Fix artifact upload to only use file stream when not uploading locally stored file. Multi-part upload is not supported on stream upload. 2020-08-23 01:06:20 +03:00
allegroai
b054ba4088 No offline mode when running remotely 2020-08-23 01:05:18 +03:00
allegroai
de068cc390 Fix cache handling for different partitions/drives/devices 2020-08-18 11:53:40 +03:00
allegroai
ce483521ef Fix Task.get_reported_console_output() for new API v2.9 2020-08-18 11:52:31 +03:00
allegroai
df0e5deb02 Fix git+https requirements handling, resolve top_level.txt package name (kerastuner from git was not detected) 2020-08-18 11:51:04 +03:00
allegroai
ffdf2e5c4c Version bump to v0.16.0 2020-08-10 17:25:47 +03:00
allegroai
4fbf0b9d4a Fix TF binding to preserve previous behavior 2020-08-10 17:25:33 +03:00
allegroai
9a561964e5 PEP8 2020-08-10 08:18:38 +03:00
Allegro AI
abb875cedb
Merge pull request #182 from guyfre/fix/tf_img_summary 
Fix saving image summary in tensorflow binding
 2020-08-10 08:13:36 +03:00
allegroai
73bd8c2714 Add FastAI example, disable binding if tensorboard is loaded (assume TensorBoradLogger will be used) 2020-08-10 08:01:03 +03:00
allegroai
4628b5eb82 Fix and improve signal handling (disable edit lock on signal callbacks, call before releasing the STD patch) 2020-08-10 07:57:26 +03:00
guyfre
dc036fd51d Fix in saving image summary in tensorflow bindings 2020-08-09 12:56:46 +03:00
allegroai
0704cf0c8e Fix task.connect() dictionary to update the section (not override it) just like in API < 2.9 2020-08-08 12:53:54 +03:00
allegroai
d56eb03381 Fix plotly support for matplotlib 3.3 2020-08-08 12:52:54 +03:00
allegroai
5fc641afc6 Chang default legacy section name to 'Args' 
Fix generated config file comment
 2020-08-08 12:51:29 +03:00
allegroai
b710c2f19d Fix OS env var TRAINS_OFFLINE_MODE set to API version (e.g. 2.9) 2020-08-08 12:49:33 +03:00
allegroai
65003a168a Fix hyper-parameter legacy mode (type=='legacy') 
Add type/description to TF_DEFINES
Cast hyper-parameters to string (if not None)
 2020-08-08 12:48:23 +03:00
allegroai
de61dbf54e Fix offline mode to support python3.5 2020-08-08 12:47:08 +03:00
allegroai
2c68a188d9 Fix multiprocessing Pool throw exception in pool would hang the program. Call original signal handler and re-flush stdout. 
Add py2.7 support for get_current_thread_id.
 2020-08-08 12:45:15 +03:00
allegroai
48ef50d41d Add session API version to exported tasks 2020-08-08 12:43:12 +03:00
allegroai
fa4803cb82 Fix log level for trains submodules 2020-08-08 12:42:32 +03:00
allegroai
ff736a76c9 Fix GPU stats on Windows machines (issue #177) 2020-08-08 12:40:32 +03:00
allegroai
35fa4f010a Add Optimizer min_iteration_per_job for all SearchStrategies 2020-08-08 12:39:56 +03:00
allegroai
ef83a648eb Support Task get_model_config/set_model_config legacy model configuration interface 2020-08-08 12:38:46 +03:00
allegroai
f4f53902ed Add sdk.development.log_os_environments to match TRAINS_LOG_ENVIRONMENT 
Support logging OS environments into Environment section
 2020-08-08 12:37:42 +03:00
allegroai
f89ec8cbac Avoid using "tasks." outside of a function as it triggers a Session 2020-08-08 12:35:57 +03:00
allegroai
e378de1e41 Add multi configuration section support (hyperparams and configurations) 
Support setting offline mode API version using TRAINS_OFFLINE_MODE env var
 2020-08-08 12:35:03 +03:00
allegroai
6d4e85de0a Add Trains Server API v2.9 support 2020-08-08 12:31:20 +03:00
allegroai
e4801542f5 Moved dict parsing in/out (hocon) into utilities.config 2020-08-08 12:28:59 +03:00
allegroai
6dca60aef2 Fix duplicate argument 2020-07-30 15:15:21 +03:00
allegroai
619be3dc75 Fix requirements detection: 
- multiple -e packages were not detected (only the first one)
- trains installed from git + running with trains in python path resulted in double entry of trains
- Do not add -e to packages installed from git repositories, Trains-Agent doesn't like it
 2020-07-30 15:12:46 +03:00
allegroai
1d277d01d3 Fix large git diff preview (artifact auxiliary_git_diff) is a single line per file, add option to control the artifact preview 2020-07-30 15:10:41 +03:00
allegroai
0a5c10b4b0 Fix user input wizard, support python 3.5 / 2.7 2020-07-30 15:08:27 +03:00
allegroai
23394a265d flake8 + change ModuleNotFoundError to ImportError (support py 2.7/3.5) 2020-07-30 15:07:25 +03:00
allegroai
a8d6380696 Add offline support using Task.set_offline() and Task.import_offline_session() 2020-07-30 15:03:22 +03:00
allegroai
2ec5726812 Fix filename too long bug (trains-server #54) 2020-07-30 14:58:48 +03:00
allegroai
d8671beb89 Fix StorageHelper to stream StringIO into file (tensorboard add_text support) 2020-07-30 14:57:35 +03:00
allegroai
7de064aaa0 Fix Optuna and HPBandster optimizers to ignore extra kwargs in constructor. Use OptimizerOptuna as default optimizer for hyper-parameter optimization example. 2020-07-30 14:56:15 +03:00
allegroai
093477cb35 Refactor fastai bind 2020-07-30 14:54:37 +03:00
allegroai
00ccadf591 Fix Task.get_reported_scalars(): do not raise exception, set max_request to 1, retrieve all scalars by default 2020-07-30 14:53:33 +03:00
allegroai
4bfd614367 Fix optimizer to support string 2020-07-30 14:51:41 +03:00
allegroai
e9f950f939 Fix set_base_docker() on main task to do nothing when running remotely 2020-07-30 14:34:39 +03:00
Guillaume Theaud
15afc479c6 Robustify GPU monitoring 2020-07-15 11:16:05 -04:00
allegroai
e7864e6ba8 Move autoscaler input functions to utilities 2020-07-14 23:40:05 +03:00
allegroai
5e0aecf1b2 Fix print message 2020-07-14 23:38:39 +03:00
allegroai
84bdac5cc8 Fix HBandster to not shutdown namespace manually as Pyro will shut it down for us 2020-07-14 23:37:41 +03:00
allegroai
4e1d2b0f4a Add Optimizer set_optimizer_task and OptimizerOptuna 2020-07-14 23:36:50 +03:00
allegroai
925450c7ef Add Task.init() argument continue_last_task to continue a previously used Task (issue #160) 2020-07-14 23:36:03 +03:00
allegroai
79799d3efd Add logger.report_confusion_matrix arg yaxis_reversed (when True flip the confusion matrix, default False). Issue #165 2020-07-11 01:37:02 +03:00
allegroai
a3c191742b Add Task.get_projects 2020-07-11 01:34:50 +03:00
allegroai
b4e3871b30 Fix Task.import_task/export_task to use project name 2020-07-11 01:34:26 +03:00
allegroai
8d7740ea68 Add AWS EC2 Auto-Scaler service example 2020-07-11 01:32:51 +03:00
allegroai
25fd425bf7 Support requirements detection using pip freeze (development.detect_with_pip_freeze configuration setting) 2020-07-11 01:31:47 +03:00
allegroai
d642639890 Add fastai binding support 2020-07-11 01:29:29 +03:00
allegroai
0328327b5a version bump 2020-07-06 21:03:12 +03:00
allegroai
8af97dbab1 Add Task export_task / import_task / update_task (Issue #128) 2020-07-06 21:03:12 +03:00
allegroai
04ab5ca99c Add initial keras-tuner support (https://github.com/keras-team/keras-tuner/issues/334) 2020-07-06 21:03:12 +03:00
allegroai
df143f1b4e Fix add UTC to time stamp in comment #152 2020-07-06 21:00:47 +03:00
allegroai
2b75c933ee Fix detect installed packages when Trains is not imported directly. 2020-07-06 21:00:01 +03:00
allegroai
2f5b519cd8 Tensorboard text logging report as debug samples (.txt files), instead of as console output. 2020-07-04 22:55:29 +03:00
allegroai
934771184d Fix git diff larger than 500kb , git section will contain warning, and entire git diff will be uploaded as artifact named auxiliary_git_diff 2020-07-04 22:53:26 +03:00
allegroai
d1744785b1 flake8 2020-07-04 22:52:09 +03:00
allegroai
87f7b5d50f Fix limit git diff to 500kb 2020-07-02 01:28:15 +03:00
allegroai
6129e09b50 Fix Hyper-Parameter optimization get_top_experiments() order 2020-07-02 01:28:15 +03:00
allegroai
59b78b288e Add TRAINS_SUPPRESS_UPDATE_MESSAGE #157 2020-07-02 01:28:15 +03:00
allegroai
5cc09d83fd Fix Task.get_task should not auto log console outputs 2020-07-02 01:28:15 +03:00
allegroai
b07a17890d Add task.upload_artifact auto_pickle=True #153 
Fix multiple argparse calls before task.init
Add mark_started force argument #159
 2020-07-02 01:28:15 +03:00
allegroai
efd843d863 Fix auto logging multiple argparse calls before Task.init 2020-07-02 01:28:15 +03:00
allegroai
b2fb5a3425 Improve Tensorboard histogram scale 2020-07-02 01:28:15 +03:00
allegroai
5d13ec0dfe Fix Tensorboard 2d convolution histogram, improve histogram accuracy on very small histograms. 
Add Logger._set_tensorboard_series_prefix add series prefix for all TB reports
 2020-06-23 23:08:08 +03:00
allegroai
f6a8736ef6 Fix PyHocon parsing of dictionary keys starting with a numeric value would break the parser 2020-06-23 23:07:05 +03:00
allegroai
a99709d5d0 Version bump to v0.15.1 2020-06-21 23:31:25 +03:00
allegroai
f3621feabb Allow Task.get_tasks() to filter by list of project ids 2020-06-21 23:31:14 +03:00
allegroai
2c5e2bb849 Add Slack Monitor service 2020-06-21 23:30:07 +03:00
allegroai
575f391ba7 Fix ssh://user@domain@server.com/ in git repo link (Issue #149) 2020-06-20 22:15:08 +03:00
allegroai
d2d3e595af Fix incorrect entry point detection when called from Trains wrapper (such as TrainsLogger Ignite/Lightning) 2020-06-19 20:51:46 +03:00
allegroai
5fbfa1d6e2 Add safety guards for Model creation / cache lookup 2020-06-19 19:09:36 +03:00
allegroai
9f9452ecf4 Automation Parameter serialization type name 2020-06-19 19:09:27 +03:00
allegroai
0626d807a7 Add WeightsFileHandler callback type enum 2020-06-19 19:09:17 +03:00
allegroai
9a7850b23d Fix anonymous named Models and input model registration based on remote url instead of local file (when StorageManager is used to download) 2020-06-19 00:52:31 +03:00
allegroai
7ab93e7dba Removed automagic reuse Model objects 2020-06-19 00:46:43 +03:00
allegroai
71003e02b2 hyper-parameter Parameter serialization type is now named "type" 2020-06-19 00:46:01 +03:00
allegroai
01d497451e Fix models and projects api client access 2020-06-19 00:44:38 +03:00
allegroai
2004b64a5b Change Task.wait_for_status() defaults & Add TrainsJob.is_failed() 2020-06-18 01:08:54 +03:00
allegroai
29b4b7338b Fix Logger.tensorboard_single_series_per_graph 2020-06-18 01:08:30 +03:00
allegroai
0454804721 WeightsFileHandler callback documentation 2020-06-18 01:08:10 +03:00
Allegro AI
1475f0e98d
Merge pull request #145 from H4dr1en/patch-3 
Add task.wait_for_status()
 2020-06-17 21:47:28 +03:00
allegroai
9ee596f48b version bump 2020-06-16 22:02:05 +03:00
allegroai
e03d421b46 Allow auto-model logging callbacks to drop logging 2020-06-16 22:01:52 +03:00
allegroai
bec31c7ac4 Fix matplotlib plot margins 2020-06-15 22:25:32 +03:00
allegroai
9c1d08b826 Fix TensorFlow >=2 histogram binding 2020-06-15 22:23:09 +03:00
H4dr1en
547f69da4b
Add task.wait_for_status() 2020-06-15 15:19:58 +02:00
allegroai
20a9f0997d Add direct plotly figure reporting (see issue #136) 2020-06-14 00:01:30 +03:00
allegroai
8a5f6b7d02 Fix Google CoLab code/package detection 2020-06-13 22:12:28 +03:00
allegroai
aa61fa3f06 Improve pytorch ignite integration 2020-06-13 22:10:59 +03:00
allegroai
a5b1ed0330 Improve matplotlib integration, issue #140 2020-06-13 22:09:45 +03:00
allegroai
2784a48c47 Embed jsonmodels v2.4 package 2020-06-13 22:08:57 +03:00
allegroai
7173a16a16 Update docstrings 2020-06-11 21:15:40 +03:00
allegroai
570b8f19b3 Reuse model id, upload to the correct destination, and remove multiple comments 2020-06-11 17:21:48 +03:00