475 Commits

Author	SHA1	Message	Date
allegroai	63507c82f7	Fix Model.download_model_weights() to reuse previously downloaded file	2020-03-22 18:11:30 +02:00
allegroai	477665ee33	Fix storage_uri handling in Model.update()	2020-03-22 18:05:05 +02:00
allegroai	abc9b512f7	Fix logging typos	2020-03-22 18:03:25 +02:00
allegroai	7817ef5cda	Fix joblib binding	2020-03-20 10:30:13 +02:00
allegroai	5db53ba643	Support multiple EventWriter in TensorFlow eager mode (TF 2.0+)	2020-03-20 10:29:18 +02:00
allegroai	b4050ecf25	Fix TensorFlow NaN/Inf values support	2020-03-20 10:27:52 +02:00
allegroai	babaf9f1ce	Add OpenMPI/Slurm support	2020-03-20 10:23:00 +02:00
allegroai	0adbd79975	Fix StorageHelper upload on shutdown	2020-03-20 10:20:44 +02:00
allegroai	dc915d0241	Fix support for Task init/close multiple times	2020-03-20 10:20:06 +02:00
allegroai	667ddcab88	Fix import for services that do not exist in old versions	2020-03-20 10:16:48 +02:00
allegroai	3b1d2d3258	Version bump to v0.14.0	2020-03-12 19:42:48 +02:00
allegroai	afad6a42ea	Add initial slurm support (multiple nodes sharing the same task id)	2020-03-12 18:12:16 +02:00
allegroai	5b29aa194c	Make sure artifact temporary files names are valid file names	2020-03-12 18:10:03 +02:00
allegroai	84a34428b6	Add trains-init support for config file env override (as well as argument)	2020-03-12 18:09:03 +02:00
allegroai	b3dff9a4eb	Support setting task initial iteration for continuing previous runs	2020-03-12 17:40:29 +02:00
allegroai	f3531c1af2	Allow Task.set_credentials() to override configuration file in dev mode	2020-03-12 17:22:09 +02:00
allegroai	5bc39271e3	Fix store uncommitted code configuration option	2020-03-12 17:17:39 +02:00
allegroai	461fbd9df0	Better warning messages for storage errors	2020-03-12 17:13:36 +02:00
allegroai	30cf6b4834	Fix HTTP link quoting in stored links	2020-03-12 17:04:31 +02:00
allegroai	98c9a95338	Add support for reporting tables	2020-03-10 13:30:42 +02:00
allegroai	9e0ea880ce	Add missing import	2020-03-08 18:56:28 +02:00
allegroai	b7358d7fef	Add portalocker for inter-process lock	2020-03-05 12:31:22 +02:00
allegroai	2e3820603a	Allow argparser override values with command line even in remote execution (essential for sub-process support)	2020-03-05 12:28:36 +02:00
allegroai	1d9e70bd8b	Fix signal hooking registeration (cont.)	2020-03-05 12:26:56 +02:00
allegroai	181a0be0af	Remove temporary file lock at the end of the execution or in Task.close()	2020-03-05 12:25:17 +02:00
allegroai	b0c602c832	Fix signal hooking registeration	2020-03-05 12:24:14 +02:00
allegroai	bcf97afeb9	Forking processes should not pass along the original File based Lock	2020-03-05 12:22:14 +02:00
allegroai	888c53f67d	Allow disabling repository detection when calling Task.init()	2020-03-05 12:19:40 +02:00
allegroai	4bca5ccf27	Always reload task section before editing parts of it	2020-03-05 12:11:55 +02:00
allegroai	a2ecb2c75d	Only use file based locks for main task. Secondary tasks use traditional multiprocessing lock	2020-03-05 12:10:23 +02:00
allegroai	da804ca75f	Add support for Popen subprocesses with task edit protection from multiple processes	2020-03-05 12:05:12 +02:00
allegroai	e3ae4f4e26	Optimize task refresh while pulling task status in local worker and last iteration for Resource Monitoring	2020-03-05 11:40:27 +02:00
Karthikeyan Singaravelan	a97850e5b6	Import ABC from collections.abc instead of collections for Python 3.9 compatibility.	2020-03-03 21:38:03 +05:30
allegroai	146da439e7	Integrate pigar into Trains	2020-03-01 17:12:28 +02:00
allegroai	8ee2bd1844	Retry sending console logs if session.send() fails (applicable only in local mode where we use the logging handler)	2020-02-26 17:07:07 +02:00
allegroai	cf850020fb	Don't print empty line at end of process if there's no artifacts summary	2020-02-26 17:06:17 +02:00
allegroai	baf5fc9e54	version bump to v0.13.3	2020-02-23 11:20:21 +02:00
allegroai	8972c1f005	Add Task.[get/set]_parameters_as_dict() to allow interaction with non-main task parameters (no need to connect())	2020-02-20 18:32:12 +02:00
allegroai	98e6c2004c	Use standard os environment variables to obtain default credentials for AWS, Google and Azure	2020-02-20 18:29:53 +02:00
allegroai	b5168010e9	Make sure Task.connect() returns the same value it is passed	2020-02-18 11:26:52 +02:00
allegroai	14588e6dec	Refactor utility function	2020-02-18 11:25:29 +02:00
allegroai	3ea570cadf	Store python binary along with major.minor version in task script section	2020-02-18 11:24:04 +02:00
allegroai	9fd3b98b24	Fix session error to print the instance host and not the class host	2020-02-18 11:23:06 +02:00
allegroai	edc237dad4	Improve support for tensorboard.summarywriter.addscalars binding	2020-02-18 11:21:47 +02:00
allegroai	f5f13658c3	Add binding for tensorboard.summarywriter.addscalars as well as scalars grouping configuration option	2020-02-12 14:04:53 +02:00
allegroai	63ffc09ae0	Fix incorrect upgrade message	2020-02-12 14:03:24 +02:00
allegroai	0bc71fbcf4	Remove title/series naming restrictions (allow '$' and '.')	2020-02-10 10:30:57 +02:00
allegroai	3ee70beea2	Fix URL for uploaded files with '%' in their name to allow proper unquote during HTTP serving	2020-02-10 10:30:57 +02:00
allegroai	c6849985ea	Add Task.set_base_docer() and Task.get_base_docker()	2020-02-10 10:30:57 +02:00
allegroai	8c2b36968b	Prefer tensorflow_gpu over tensorflow when inspecting installed packages	2020-02-04 18:00:39 +02:00
allegroai	0c71889ca5	Fix printout during init	2020-02-04 17:59:50 +02:00
allegroai	34d9402abb	version bump to v0.13.2	2020-01-27 19:45:56 +02:00
allegroai	7b9e7406ad	Fix mutually_exclusive() use of at_least_one()	2020-01-27 15:41:19 +02:00
allegroai	9f8e814ca6	Support git repositories without ".git" suffix	2020-01-27 15:41:19 +02:00
allegroai	923e45bb17	Allow reporting a pre-uploaded image url in Logger.report_image using the url parameter	2020-01-26 15:29:35 +02:00
allegroai	8772bc2755	Version bump	2020-01-22 11:08:41 +02:00
allegroai	d03311764e	Fix None type as default value in dictionary	2020-01-22 11:08:06 +02:00
allegroai	b50bfd5b63	Fix default argparser value handling when value is None	2020-01-22 11:06:52 +02:00
allegroai	af0b8f4c70	Fix type check in hyper-parameters argparser integration	2020-01-22 11:03:56 +02:00
allegroai	1e011e10a2	Version bump	2020-01-21 16:41:14 +02:00
allegroai	1cc0ea6cf3	Fix logs, events and jupyter flushing on exit	2020-01-21 16:41:01 +02:00
allegroai	f0a27127bf	Fix matplotlib savefig patching	2020-01-21 16:37:26 +02:00
allegroai	c5dd762d9b	Improve conda support	2020-01-21 16:32:57 +02:00
allegroai	9a3e130700	version bump to v0.13.1	2020-01-13 17:29:17 +02:00
allegroai	fcaff82980	Add support for pylab.savefig in matplotlib binding	2020-01-13 17:16:56 +02:00
allegroai	0ecd734fd1	Support multi-line paste of credentials in configuration wizard	2020-01-13 17:16:25 +02:00
allegroai	1c6be01e38	Add support for savefig in matplotlib binding	2020-01-13 12:06:47 +02:00
allegroai	66b251a62b	Try to make sure tensorboard is available when using torch	2020-01-13 11:55:55 +02:00
Allegro AI	affd6050f6	Merge pull request #79 from danmalowany-allegro/master ... Fix type hint in Logger.report_scatter3d()	2020-01-12 12:50:10 +02:00
allegroai	5fdb2398df	Version bump	2020-01-10 13:42:24 +02:00
allegroai	8da8053726	Do not store keras model network design if it cannot be serialized	2020-01-10 13:41:06 +02:00
allegroai	073f4c308d	Convert ndarray to histogram for axis to get rid of warning in tensorflow binding	2020-01-10 13:39:31 +02:00
allegroai	163ace8856	Display matplotlib low version warning only once	2020-01-10 13:36:27 +02:00
allegroai	70624f469b	Fix matplotlib binding support	2020-01-10 13:35:07 +02:00
allegroai	f65ef3e757	Support broken Jupyter version on some conda installations (SageMaker)	2020-01-10 13:33:19 +02:00
danmalowany-allegro	b9ee824877	Changed List to list	2020-01-06 18:27:56 +02:00
danmalowany-allegro	457f0b71c8	Fixed scatter type in report_scatter3d to Union	2020-01-06 18:12:00 +02:00
allegroai	80f3dc6790	version bump to v0.13.0	2020-01-06 17:44:28 +02:00
Allegro AI	be8d100e33	Merge pull request #78 from szymonmaszke/patch-1 ... Add .pt file extension as PyTorch	2020-01-06 17:30:31 +02:00
allegroai	30eaed79ea	Add warning when automatic argument parser binding cannot be turned off	2020-01-06 17:20:15 +02:00
allegroai	bc33ad0da3	Calculate data-audit artifact uniqueness by user-criteria	2020-01-06 17:19:44 +02:00
allegroai	a169b43885	Add Task.upload_artifact support for external URLs	2020-01-06 17:16:51 +02:00
allegroai	7820e0d14a	Use an environment variable for setting a default docker image	2020-01-06 17:09:45 +02:00
allegroai	7b7b6e487e	Fix argparser/subparser support and support unsynced connected hyper parameters in remote execution	2020-01-06 17:08:03 +02:00
allegroai	8585d7e134	Avoid retries when verifying invalid credentials	2020-01-06 17:05:37 +02:00
Szymon Maszke	6815dd5410	Add .pt file extension as PyTorch ... Usually `.pt` is used as pytorch's extension, see [this StackOverflow question](https://stackoverflow.com/questions/59095824/what-is-difference-between-pt-pth-and-pwf-extentions-in-pytorch). Furthermore `.pth` is used by Python to list additional package search paths (see [this PyTorch issue](https://github.com/pytorch/pytorch/issues/14864)) so IMO it might be worth reconsidering existence of it extension. AFAIK `.pt` is advised and used throughout most projects.	2020-01-06 13:08:54 +01:00
allegroai	54ae340ccb	Use source task id to determine cloned task parent	2020-01-02 12:01:03 +02:00
allegroai	62d5535351	Fix requests issue in python 2.7 that can cause a deadlock when importing netrc	2020-01-02 11:58:02 +02:00
allegroai	f4be527a21	Fix typo	2020-01-02 11:55:59 +02:00
allegroai	7110b938ae	Fix matplotlib import binding when imported before trains	2019-12-30 18:37:17 +02:00
allegroai	ddeece1f57	Add support for API v2.5	2019-12-30 18:34:28 +02:00
allegroai	ba79471848	Update documentation	2019-12-24 18:20:16 +02:00
allegroai	e4024e01d5	Make sure ProxyDictPreWrite and ProxyDictPostWrite are pickled correctly	2019-12-21 18:33:15 +02:00
allegroai	4e0f711e39	Keep only the input artifacts when cloning a task	2019-12-21 18:30:24 +02:00
allegroai	0be981fbc1	Fix check_min_api_version to use a default session if none was created	2019-12-21 18:28:10 +02:00
allegroai	085eebc6b9	version bump	2019-12-15 15:13:44 +02:00
allegroai	14ce1e925e	version bump	2019-12-15 00:11:26 +02:00
allegroai	3bd997c4dc	Improve trains-init configuration wizard	2019-12-15 00:11:01 +02:00
allegroai	c1cc80ba1b	Optimize artifacts threading	2019-12-15 00:10:34 +02:00
allegroai	a992591f3c	Fix artifacts update in auxiliary task	2019-12-15 00:10:12 +02:00
allegroai	67d9a9e5d4	Do not reuse experiment if it has artifacts	2019-12-15 00:09:36 +02:00
allegroai	9add031fe8	Improve trains-init wizard	2019-12-04 23:47:39 +02:00
allegroai	f92278750a	Fix default_output_uri in remote execution mode ... Fix arguments order in Task.create	2019-12-04 23:47:26 +02:00
allegroai	03fbfb8237	version bump	2019-11-28 00:49:27 +02:00
allegroai	7e7329f7a0	Improve argparser automagic support	2019-11-28 00:49:19 +02:00
allegroai	09257b7247	Fix files http/s host ending with /	2019-11-28 00:48:48 +02:00
allegroai	8aa86225e2	Add default_output_uri in trains.conf configuration ... Fix Task.set_credentials support for different web/api/files hosts	2019-11-23 01:27:45 +02:00
allegroai	8ab982cbc9	Fix support for uploading large files over slow http connection	2019-11-23 01:26:18 +02:00
allegroai	e1a640d37a	Fix support for older git versions (<2)	2019-11-23 01:25:37 +02:00
allegroai	7af2d0c9d7	Improve trains-init configuration wizard	2019-11-23 01:25:17 +02:00
allegroai	9f59346c33	version bump	2019-11-15 22:00:31 +02:00
allegroai	603d42792d	Fix jsonschema deprecation warning	2019-11-15 22:00:21 +02:00
allegroai	0a45d2094f	Add Task connect_configuration, connect_label_enumeration, and support for nested dictionary with connect ... Add Task.get_tasks	2019-11-15 22:00:10 +02:00
allegroai	15683b5b43	Fix support for auto package detection for standalone scripts	2019-11-15 21:59:50 +02:00
allegroai	d19fde7041	Add artifact get() returning the artifact object (after downloading and loading)	2019-11-15 21:59:36 +02:00
allegroai	b37aea1839	Add Task name and comment setter	2019-11-15 21:59:24 +02:00
李波	f88b9e69f8	fix vdict keys	2019-11-13 15:54:58 +08:00
allegroai	0ccdd5db48	version bump	2019-11-08 22:30:19 +02:00
allegroai	4372dda696	Add Task.init auto_connect_frameworks fine granularity control	2019-11-08 22:30:09 +02:00
allegroai	9362831269	Add sdk.metric.matplotlib_untitled_history_size to limit number of untitled matplotlib plots (default: 100)	2019-11-08 22:29:36 +02:00
allegroai	1bfee56977	Improve Windows support	2019-11-08 22:28:13 +02:00
allegroai	cef3cbaa08	version bump	2019-10-29 22:08:25 +02:00
allegroai	8b11fa18ea	typo	2019-10-29 22:08:10 +02:00
allegroai	ac0dfabdfd	Improve orchestration pipelines	2019-10-29 22:08:02 +02:00
allegroai	ff0a52c6d1	version bump	2019-10-28 22:01:11 +02:00
allegroai	3527f743a6	Improved check trains package updates	2019-10-28 22:01:01 +02:00
allegroai	bfa22ae82a	Fix report surface support for TF	2019-10-28 22:00:11 +02:00
allegroai	492c8dbecb	version bump	2019-10-27 00:32:34 +03:00
allegroai	00e66b5d63	Add missing x/y/z axis titles to various logger report ... Changed report_surface arguments	2019-10-27 00:32:05 +03:00
allegroai	55dcdfce5a	version bump	2019-10-25 15:16:28 +03:00
allegroai	81cf2d2261	Embed pyhocon into package, and extend parsing capabilities.	2019-10-25 15:16:18 +03:00
allegroai	2104c3ec6b	Add trains-server new capabilities support	2019-10-25 15:15:22 +03:00
allegroai	ac2ea09403	Add trains-server api version 2.4 support	2019-10-25 15:13:41 +03:00
allegroai	6fffb33931	Fix artifacts support on Windows	2019-10-25 15:12:53 +03:00
allegroai	adbe02b62b	Optimize scatter 2d plot storage	2019-10-25 15:12:01 +03:00
allegroai	cb3167bdd8	Add x/y/z title for scatter 2d/3d plots	2019-10-25 15:11:26 +03:00
allegroai	07f4b86d51	version bump	2019-10-16 23:36:12 +03:00
allegroai	607a3a8331	version bump	2019-10-15 22:36:13 +03:00
allegroai	cdbf792582	Change second model warning to info	2019-10-15 22:36:04 +03:00
allegroai	1a658e9d89	Fix output_uri support for local folders	2019-10-15 22:35:37 +03:00
allegroai	67fc8e3eb0	Add support for NVIDIA_VISIBLE_DEVICES / CUDA_VISIBLE_DEVICES	2019-10-15 22:34:56 +03:00
allegroai	913a3b5d1b	version bump	2019-10-10 21:11:00 +03:00
allegroai	e0e6d9159b	Fix python 2.7 and Windows support	2019-10-10 21:10:51 +03:00
allegroai	c1bcce9692	Retry suppression	2019-10-10 21:10:18 +03:00
allegroai	0b875a2dea	Changed report_image matrix argument to image (with backwards support)	2019-10-10 21:09:44 +03:00
allegroai	aedd3fc87e	version bump	2019-10-06 22:05:55 +03:00
allegroai	0a5696235b	Add exception handling when no output uri credentials are found	2019-10-06 21:57:17 +03:00
allegroai	8f0bec5861	Fix windows support for time stamp based sorting	2019-10-06 21:56:46 +03:00
allegroai	79cf18b2b8	version bump	2019-10-06 01:43:48 +03:00
allegroai	02c2a12449	Fix deprecated warning on imports from sklearn	2019-10-06 01:43:37 +03:00
allegroai	c44f3ff11c	version bump	2019-10-05 15:26:34 +03:00
allegroai	cfd0344784	Add gpu statistics embedded into package, no need for external packages	2019-10-05 15:26:28 +03:00
allegroai	99a702d149	Add artifacts upload retries (default 3)	2019-10-05 15:25:48 +03:00
allegroai	005f445600	version bump	2019-10-04 01:34:38 +03:00
allegroai	9f73dbabdb	Better multi-processing, switching to to multiprocess Lock	2019-10-04 01:34:22 +03:00
allegroai	9e930a6894	Fix urllib retry warning suppression	2019-10-04 01:33:37 +03:00
allegroai	e5c0a738c3	Fix multi-processing issue with Task of type inference	2019-10-04 01:32:59 +03:00
allegroai	6aa22e449e	Add alias for task type, train/inference	2019-10-04 01:31:57 +03:00
allegroai	4a42345561	Add support for tuples in hyper-parameters dict	2019-10-04 01:31:26 +03:00
allegroai	a7eb8476ce	Add initial Tensorflow v2 support (2.0.0rc1)	2019-09-27 13:24:04 +03:00
allegroai	c44638c8d9	Fix python package analysis timed out before sending git repo detials.	2019-09-27 13:23:32 +03:00
allegroai	3eba23f1a3	Fix multiple matplotlib windows with Agg backend interactive mode, caused duplicate graphs to be sent.	2019-09-27 13:22:17 +03:00
allegroai	b720895307	Fix S3 warning	2019-09-27 13:21:04 +03:00
allegroai	c0ab9a2f52	Fix resource monitor fall back to seconds since experiment started, will keep waiting for any reporting for 30min, while sending monitor report after 3min	2019-09-27 13:20:41 +03:00
allegroai	85c11052c1	version bump	2019-09-25 00:33:12 +03:00
allegroai	86655412b0	Add artifacts support for folders/wildcard, include retrieval and extraction	2019-09-25 00:33:00 +03:00
allegroai	e6ed09664f	Fix force flush logs at exit	2019-09-25 00:32:08 +03:00
allegroai	44ffb2985d	Change tensorboard default scalar grouping (now False)	2019-09-25 00:31:23 +03:00
allegroai	0cbc99b16d	Removed deprecated call	2019-09-25 00:30:46 +03:00
allegroai	dada40dd73	version bump	2019-09-23 18:42:05 +03:00
allegroai	b1d3fc9694	Add Full Artifacts support, including local files/folders, pandas, numpy, images. requires train-server 0.11 and above	2019-09-23 18:41:53 +03:00
allegroai	4f1eeb49c6	Add StorageHelper.get_local_copy to quickly download and provide local path to remote files (http/s3/gs/azure support)	2019-09-23 18:40:56 +03:00
allegroai	0b4f00af4d	Restructured Logger with nice clean interface. ... Breaking changes: Logger no longer supports info/error/warning console() replaced with report_text()	2019-09-23 18:40:13 +03:00
allegroai	1dbe962879	version bump	2019-09-15 21:53:04 +03:00
allegroai	24c2f86741	Add upload artifact supports pd.DataFrame	2019-09-15 21:52:57 +03:00
allegroai	406536d105	version bump	2019-09-15 01:36:42 +03:00
allegroai	8c3f6d254a	Fix multiple tasks closing	2019-09-15 01:36:33 +03:00
allegroai	61fb17266f	version bump	2019-09-15 00:02:51 +03:00
allegroai	df53ed5577	Fix safe YAML loading	2019-09-15 00:02:42 +03:00
allegroai	b98c821cf9	Fix task cloning	2019-09-15 00:02:23 +03:00
allegroai	c7a687b4a5	version bump	2019-09-14 13:55:54 +03:00
allegroai	933a9ad12e	Add trains-init verifies credentials	2019-09-14 13:55:45 +03:00
allegroai	2ba372560e	Fix set artifacts storage destination with output_uri	2019-09-14 13:55:17 +03:00
allegroai	648a972199	version bump	2019-09-13 19:08:56 +03:00
allegroai	13dd130c7d	Fix always order by created time	2019-09-13 19:08:49 +03:00
allegroai	289063e345	version bump	2019-09-13 17:10:58 +03:00
allegroai	76ea73a780	Removed apache-libcloud	2019-09-13 17:09:58 +03:00
allegroai	d7bdc746b8	Add full artifacts support	2019-09-13 17:09:24 +03:00
allegroai	27ca36687a	Add support for upcoming trains-server	2019-09-13 17:08:27 +03:00
allegroai	5b48322b55	Add support for upcoming trains-server	2019-09-13 17:07:48 +03:00
allegroai	64aabbe7d5	version bump	2019-09-09 21:50:26 +03:00
allegroai	9ffee412d7	Add overwriting artifacts	2019-09-09 21:50:18 +03:00
allegroai	1a5ed1132a	Fix broken Keras binding support	2019-09-09 21:49:55 +03:00
allegroai	9dfe36db9e	version bump	2019-09-07 23:28:41 +03:00
allegroai	3f63394b51	Documentation	2019-09-07 23:28:32 +03:00
allegroai	dc632e160f	Improve artifacts support	2019-09-07 23:27:16 +03:00
allegroai	7cb7d891b3	version bump	2019-09-05 01:54:21 +03:00
allegroai	d0b1c6acb5	Sphinx compatibility	2019-09-05 01:54:15 +03:00
allegroai	2fb69ae951	Improve httpdriver authentication feature	2019-09-05 01:53:43 +03:00
allegroai	05364f0796	version bump	2019-09-03 12:59:42 +03:00