ClearML/clearml
1
0
Fork 0
mirror of https://github.com/clearml/clearml synced 2025-02-08 22:03:46 +00:00
Code Issues Actions Packages Projects Releases Wiki Activity
888 Commits 4 Branches 178 Tags 51 MiB
c75de848f5
Commit Graph

698 Commits

Author SHA1 Message Date
allegroai
86da29b560 Fix TrainsJob hyperparams overriding order was not guaranteed 2020-09-29 19:18:49 +03:00
allegroai
55ac24aa9a Exclude argsparser arguments and copy hyperparms in Task.clone() if API < 2.9 2020-09-29 19:18:04 +03:00
allegroai
cd77f0b8c8 Add ArgParser default help (if not provided) 2020-09-29 19:15:11 +03:00
allegroai
2065288a90 Add improved trace filtering capabilities 2020-09-29 19:14:10 +03:00
allegroai
8e859503f6 Don't raise error for batch requests with no items 2020-09-29 19:10:00 +03:00
allegroai
ab9487c4e0 Update Session API version according to max server reported version 2020-09-29 19:09:07 +03:00
allegroai
8ec6bba4d9 Fix Optimizer limits and values, update trains version in examples 2020-09-15 19:14:45 +03:00
allegroai
ab5059e8e1 Fix Task.init() casts init task_type None to str 2020-09-15 18:15:02 +03:00
allegroai
6bc9d705a0 Fix available versions loading 2020-09-15 18:14:05 +03:00
allegroai
2a249c41f0 If possible, do not use api tasks object directly (use Task instead) 2020-09-15 18:13:07 +03:00
allegroai
d36f6c26da Fix auto model logging using relative path (use full absolute path) 2020-09-15 18:11:31 +03:00
allegroai
2a2d4b6114 Add git diff on repository submodule (requires git 2.14 or above) 2020-09-15 18:10:02 +03:00
allegroai
3466cc0789 Fix scatter2d sub-sampling and rounding 2020-09-15 18:08:57 +03:00
allegroai
10ec4d56fb version bump 2020-09-09 22:11:45 +03:00
allegroai
0797f23f36 pep8 2020-09-09 22:11:29 +03:00
allegroai
e206232126 Improve pipeline controller 2020-09-09 22:11:18 +03:00
allegroai
2c47e9f248 Fix joblib auto logging models failing on compressed streams, issue #203 2020-09-09 22:10:59 +03:00
allegroai
299ce14515 Fix sending empty reports, issue #205 2020-09-09 22:10:59 +03:00
allegroai
f4917572bb Remove warning on skipped auto-magic model logging 2020-09-09 22:09:02 +03:00
allegroai
fede603a7b Fix upload message 2020-09-09 22:08:22 +03:00
allegroai
33f42def54 pep8 2020-09-09 22:07:50 +03:00
allegroai
24ab1ecc2d Fix Windows support for install package analysis 2020-09-09 22:07:35 +03:00
allegroai
7eedd30097 pep8 2020-09-09 22:06:04 +03:00
allegroai
03e7ebd48c Add pipeline controller tag-per-step option. Pipeline controller parameters can now be any type. 2020-09-05 16:31:01 +03:00
allegroai
86aa3aaa98 Fix docstrings 2020-09-05 16:30:00 +03:00
allegroai
fae11edf1b Fix NaN in plotly plots (matplotlib conversion) 
Add sdk.metrics.plot_max_num_digits to limit the number of digits in a plot (reduce plot sizes)
 2020-09-05 16:28:24 +03:00
allegroai
c30b6d27e8 Fix failed controller pipeline tasks were considered completed 2020-09-05 16:26:40 +03:00
allegroai
646163a2cb Fix matplotlib _reporter refactoring 2020-09-05 16:25:28 +03:00
allegroai
5beecbb078 Add Pipeline Controller automation and example 2020-09-01 18:00:19 +03:00
allegroai
4f06ab1c59 Fix thread wait Ctrl-C interrupt did not exit process 2020-09-01 17:58:42 +03:00
allegroai
134fabb7a2 Add Task.logger property 2020-09-01 17:56:38 +03:00
allegroai
4c77cd1479 Rename Task.reporter to Task._reporter (deprecated) 2020-09-01 17:47:40 +03:00
allegroai
99a8724bec Fix Task.wait_for_status() to reload after it ends 2020-09-01 17:46:24 +03:00
allegroai
d148fe8042 Add TrainsJob.is_completed()/is_aborted() 2020-09-01 17:45:08 +03:00
allegroai
fd165f7126 Fix docstrings 2020-09-01 17:44:26 +03:00
allegroai
19822419b6 Version bump to v0.16.1 2020-08-27 15:07:05 +03:00
allegroai
f11c6f5f27 Improve HyperParameterOptimizer 2020-08-27 15:05:21 +03:00
allegroai
b25ca9b384 Fix double-escaped design when connecting OutputModel 2020-08-27 15:04:03 +03:00
allegroai
838c9cb0d2 Fix HyperParameter optimizer to create Task of type optimizer 2020-08-23 01:06:59 +03:00
allegroai
e1bbc03001 Fix artifact upload to only use file stream when not uploading locally stored file. Multi-part upload is not supported on stream upload. 2020-08-23 01:06:20 +03:00
allegroai
b054ba4088 No offline mode when running remotely 2020-08-23 01:05:18 +03:00
allegroai
de068cc390 Fix cache handling for different partitions/drives/devices 2020-08-18 11:53:40 +03:00
allegroai
ce483521ef Fix Task.get_reported_console_output() for new API v2.9 2020-08-18 11:52:31 +03:00
allegroai
df0e5deb02 Fix git+https requirements handling, resolve top_level.txt package name (kerastuner from git was not detected) 2020-08-18 11:51:04 +03:00
allegroai
ffdf2e5c4c Version bump to v0.16.0 2020-08-10 17:25:47 +03:00
allegroai
4fbf0b9d4a Fix TF binding to preserve previous behavior 2020-08-10 17:25:33 +03:00
allegroai
9a561964e5 PEP8 2020-08-10 08:18:38 +03:00
Allegro AI
abb875cedb
Merge pull request #182 from guyfre/fix/tf_img_summary 
Fix saving image summary in tensorflow binding
 2020-08-10 08:13:36 +03:00
allegroai
73bd8c2714 Add FastAI example, disable binding if tensorboard is loaded (assume TensorBoradLogger will be used) 2020-08-10 08:01:03 +03:00
allegroai
4628b5eb82 Fix and improve signal handling (disable edit lock on signal callbacks, call before releasing the STD patch) 2020-08-10 07:57:26 +03:00
guyfre
dc036fd51d Fix in saving image summary in tensorflow bindings 2020-08-09 12:56:46 +03:00
allegroai
0704cf0c8e Fix task.connect() dictionary to update the section (not override it) just like in API < 2.9 2020-08-08 12:53:54 +03:00
allegroai
d56eb03381 Fix plotly support for matplotlib 3.3 2020-08-08 12:52:54 +03:00
allegroai
5fc641afc6 Chang default legacy section name to 'Args' 
Fix generated config file comment
 2020-08-08 12:51:29 +03:00
allegroai
b710c2f19d Fix OS env var TRAINS_OFFLINE_MODE set to API version (e.g. 2.9) 2020-08-08 12:49:33 +03:00
allegroai
65003a168a Fix hyper-parameter legacy mode (type=='legacy') 
Add type/description to TF_DEFINES
Cast hyper-parameters to string (if not None)
 2020-08-08 12:48:23 +03:00
allegroai
de61dbf54e Fix offline mode to support python3.5 2020-08-08 12:47:08 +03:00
allegroai
2c68a188d9 Fix multiprocessing Pool throw exception in pool would hang the program. Call original signal handler and re-flush stdout. 
Add py2.7 support for get_current_thread_id.
 2020-08-08 12:45:15 +03:00
allegroai
48ef50d41d Add session API version to exported tasks 2020-08-08 12:43:12 +03:00
allegroai
fa4803cb82 Fix log level for trains submodules 2020-08-08 12:42:32 +03:00
allegroai
ff736a76c9 Fix GPU stats on Windows machines (issue #177) 2020-08-08 12:40:32 +03:00
allegroai
35fa4f010a Add Optimizer min_iteration_per_job for all SearchStrategies 2020-08-08 12:39:56 +03:00
allegroai
ef83a648eb Support Task get_model_config/set_model_config legacy model configuration interface 2020-08-08 12:38:46 +03:00
allegroai
f4f53902ed Add sdk.development.log_os_environments to match TRAINS_LOG_ENVIRONMENT 
Support logging OS environments into Environment section
 2020-08-08 12:37:42 +03:00
allegroai
f89ec8cbac Avoid using "tasks." outside of a function as it triggers a Session 2020-08-08 12:35:57 +03:00
allegroai
e378de1e41 Add multi configuration section support (hyperparams and configurations) 
Support setting offline mode API version using TRAINS_OFFLINE_MODE env var
 2020-08-08 12:35:03 +03:00
allegroai
6d4e85de0a Add Trains Server API v2.9 support 2020-08-08 12:31:20 +03:00
allegroai
e4801542f5 Moved dict parsing in/out (hocon) into utilities.config 2020-08-08 12:28:59 +03:00
allegroai
6dca60aef2 Fix duplicate argument 2020-07-30 15:15:21 +03:00
allegroai
619be3dc75 Fix requirements detection: 
- multiple -e packages were not detected (only the first one)
- trains installed from git + running with trains in python path resulted in double entry of trains
- Do not add -e to packages installed from git repositories, Trains-Agent doesn't like it
 2020-07-30 15:12:46 +03:00
allegroai
1d277d01d3 Fix large git diff preview (artifact auxiliary_git_diff) is a single line per file, add option to control the artifact preview 2020-07-30 15:10:41 +03:00
allegroai
0a5c10b4b0 Fix user input wizard, support python 3.5 / 2.7 2020-07-30 15:08:27 +03:00
allegroai
23394a265d flake8 + change ModuleNotFoundError to ImportError (support py 2.7/3.5) 2020-07-30 15:07:25 +03:00
allegroai
a8d6380696 Add offline support using Task.set_offline() and Task.import_offline_session() 2020-07-30 15:03:22 +03:00
allegroai
2ec5726812 Fix filename too long bug (trains-server #54) 2020-07-30 14:58:48 +03:00
allegroai
d8671beb89 Fix StorageHelper to stream StringIO into file (tensorboard add_text support) 2020-07-30 14:57:35 +03:00
allegroai
7de064aaa0 Fix Optuna and HPBandster optimizers to ignore extra kwargs in constructor. Use OptimizerOptuna as default optimizer for hyper-parameter optimization example. 2020-07-30 14:56:15 +03:00
allegroai
093477cb35 Refactor fastai bind 2020-07-30 14:54:37 +03:00
allegroai
00ccadf591 Fix Task.get_reported_scalars(): do not raise exception, set max_request to 1, retrieve all scalars by default 2020-07-30 14:53:33 +03:00
allegroai
4bfd614367 Fix optimizer to support string 2020-07-30 14:51:41 +03:00
allegroai
e9f950f939 Fix set_base_docker() on main task to do nothing when running remotely 2020-07-30 14:34:39 +03:00
Guillaume Theaud
15afc479c6 Robustify GPU monitoring 2020-07-15 11:16:05 -04:00
allegroai
e7864e6ba8 Move autoscaler input functions to utilities 2020-07-14 23:40:05 +03:00
allegroai
5e0aecf1b2 Fix print message 2020-07-14 23:38:39 +03:00
allegroai
84bdac5cc8 Fix HBandster to not shutdown namespace manually as Pyro will shut it down for us 2020-07-14 23:37:41 +03:00
allegroai
4e1d2b0f4a Add Optimizer set_optimizer_task and OptimizerOptuna 2020-07-14 23:36:50 +03:00
allegroai
925450c7ef Add Task.init() argument continue_last_task to continue a previously used Task (issue #160) 2020-07-14 23:36:03 +03:00
allegroai
79799d3efd Add logger.report_confusion_matrix arg yaxis_reversed (when True flip the confusion matrix, default False). Issue #165 2020-07-11 01:37:02 +03:00
allegroai
a3c191742b Add Task.get_projects 2020-07-11 01:34:50 +03:00
allegroai
b4e3871b30 Fix Task.import_task/export_task to use project name 2020-07-11 01:34:26 +03:00
allegroai
8d7740ea68 Add AWS EC2 Auto-Scaler service example 2020-07-11 01:32:51 +03:00
allegroai
25fd425bf7 Support requirements detection using pip freeze (development.detect_with_pip_freeze configuration setting) 2020-07-11 01:31:47 +03:00
allegroai
d642639890 Add fastai binding support 2020-07-11 01:29:29 +03:00
allegroai
0328327b5a version bump 2020-07-06 21:03:12 +03:00
allegroai
8af97dbab1 Add Task export_task / import_task / update_task (Issue #128) 2020-07-06 21:03:12 +03:00
allegroai
04ab5ca99c Add initial keras-tuner support (https://github.com/keras-team/keras-tuner/issues/334) 2020-07-06 21:03:12 +03:00
allegroai
df143f1b4e Fix add UTC to time stamp in comment #152 2020-07-06 21:00:47 +03:00
allegroai
2b75c933ee Fix detect installed packages when Trains is not imported directly. 2020-07-06 21:00:01 +03:00
allegroai
2f5b519cd8 Tensorboard text logging report as debug samples (.txt files), instead of as console output. 2020-07-04 22:55:29 +03:00
allegroai
934771184d Fix git diff larger than 500kb , git section will contain warning, and entire git diff will be uploaded as artifact named auxiliary_git_diff 2020-07-04 22:53:26 +03:00
allegroai
d1744785b1 flake8 2020-07-04 22:52:09 +03:00
allegroai
87f7b5d50f Fix limit git diff to 500kb 2020-07-02 01:28:15 +03:00
allegroai
6129e09b50 Fix Hyper-Parameter optimization get_top_experiments() order 2020-07-02 01:28:15 +03:00
allegroai
59b78b288e Add TRAINS_SUPPRESS_UPDATE_MESSAGE #157 2020-07-02 01:28:15 +03:00
allegroai
5cc09d83fd Fix Task.get_task should not auto log console outputs 2020-07-02 01:28:15 +03:00
allegroai
b07a17890d Add task.upload_artifact auto_pickle=True #153 
Fix multiple argparse calls before task.init
Add mark_started force argument #159
 2020-07-02 01:28:15 +03:00
allegroai
efd843d863 Fix auto logging multiple argparse calls before Task.init 2020-07-02 01:28:15 +03:00
allegroai
b2fb5a3425 Improve Tensorboard histogram scale 2020-07-02 01:28:15 +03:00
allegroai
5d13ec0dfe Fix Tensorboard 2d convolution histogram, improve histogram accuracy on very small histograms. 
Add Logger._set_tensorboard_series_prefix add series prefix for all TB reports
 2020-06-23 23:08:08 +03:00
allegroai
f6a8736ef6 Fix PyHocon parsing of dictionary keys starting with a numeric value would break the parser 2020-06-23 23:07:05 +03:00
allegroai
a99709d5d0 Version bump to v0.15.1 2020-06-21 23:31:25 +03:00
allegroai
f3621feabb Allow Task.get_tasks() to filter by list of project ids 2020-06-21 23:31:14 +03:00
allegroai
2c5e2bb849 Add Slack Monitor service 2020-06-21 23:30:07 +03:00
allegroai
575f391ba7 Fix ssh://user@domain@server.com/ in git repo link (Issue #149) 2020-06-20 22:15:08 +03:00
allegroai
d2d3e595af Fix incorrect entry point detection when called from Trains wrapper (such as TrainsLogger Ignite/Lightning) 2020-06-19 20:51:46 +03:00
allegroai
5fbfa1d6e2 Add safety guards for Model creation / cache lookup 2020-06-19 19:09:36 +03:00
allegroai
9f9452ecf4 Automation Parameter serialization type name 2020-06-19 19:09:27 +03:00
allegroai
0626d807a7 Add WeightsFileHandler callback type enum 2020-06-19 19:09:17 +03:00
allegroai
9a7850b23d Fix anonymous named Models and input model registration based on remote url instead of local file (when StorageManager is used to download) 2020-06-19 00:52:31 +03:00
allegroai
7ab93e7dba Removed automagic reuse Model objects 2020-06-19 00:46:43 +03:00
allegroai
71003e02b2 hyper-parameter Parameter serialization type is now named "type" 2020-06-19 00:46:01 +03:00
allegroai
01d497451e Fix models and projects api client access 2020-06-19 00:44:38 +03:00
allegroai
2004b64a5b Change Task.wait_for_status() defaults & Add TrainsJob.is_failed() 2020-06-18 01:08:54 +03:00
allegroai
29b4b7338b Fix Logger.tensorboard_single_series_per_graph 2020-06-18 01:08:30 +03:00
allegroai
0454804721 WeightsFileHandler callback documentation 2020-06-18 01:08:10 +03:00
Allegro AI
1475f0e98d
Merge pull request #145 from H4dr1en/patch-3 
Add task.wait_for_status()
 2020-06-17 21:47:28 +03:00
allegroai
9ee596f48b version bump 2020-06-16 22:02:05 +03:00
allegroai
e03d421b46 Allow auto-model logging callbacks to drop logging 2020-06-16 22:01:52 +03:00
allegroai
bec31c7ac4 Fix matplotlib plot margins 2020-06-15 22:25:32 +03:00
allegroai
9c1d08b826 Fix TensorFlow >=2 histogram binding 2020-06-15 22:23:09 +03:00
H4dr1en
547f69da4b
Add task.wait_for_status() 2020-06-15 15:19:58 +02:00
allegroai
20a9f0997d Add direct plotly figure reporting (see issue #136) 2020-06-14 00:01:30 +03:00
allegroai
8a5f6b7d02 Fix Google CoLab code/package detection 2020-06-13 22:12:28 +03:00
allegroai
aa61fa3f06 Improve pytorch ignite integration 2020-06-13 22:10:59 +03:00
allegroai
a5b1ed0330 Improve matplotlib integration, issue #140 2020-06-13 22:09:45 +03:00
allegroai
2784a48c47 Embed jsonmodels v2.4 package 2020-06-13 22:08:57 +03:00
allegroai
7173a16a16 Update docstrings 2020-06-11 21:15:40 +03:00
allegroai
570b8f19b3 Reuse model id, upload to the correct destination, and remove multiple comments 2020-06-11 17:21:48 +03:00
allegroai
ac986d05f1 Add APIClient support 2020-06-11 15:08:45 +03:00
allegroai
feb82c30a7 Allow providing alternate model ID when getting an output model 2020-06-11 15:07:25 +03:00
allegroai
6a28a6e21d Change callback structure, access thorough designated class WeightsFileHandler.ModelInfo 
See https://github.com/pytorch/ignite/issues/1056
 2020-06-11 15:05:11 +03:00
allegroai
5475d00d52 Add missing Task types in scheme 2020-06-11 14:47:14 +03:00
allegroai
bd2a0dcc2c Fix trains-init wizard, allow at most two credentials verification tries 2020-06-11 14:41:10 +03:00
allegroai
d5c7ef7eff Do not call make deterministic on import 2020-06-11 14:39:57 +03:00
H4dr1en
91fbc1cf87
Add set_parent method to Tasks 2020-06-09 11:17:42 +02:00
allegroai
00e56faa96 Version bump to v0.15.0 2020-06-01 19:56:21 +03:00
allegroai
7dad7e57e4 Fix automation BOHB budget display calculation, Job.started() and daemon sleep 2020-06-01 11:02:45 +03:00
allegroai
2066d9ff9d Fix type-hints and docstrings 2020-06-01 11:00:42 +03:00
allegroai
43dac458df Change OptimizerBOHB argument max_job_execution_minutes to time_limit_per_job. Add budget remaining reporting 2020-05-31 13:28:03 +03:00
allegroai
2089dde55a Add Task.running_locally() and Task.execute_remotely() 2020-05-31 12:13:54 +03:00