11 Commits

Author	SHA1	Message	Date
allegroai	3c4925d605	Fix resource monitor and check if task is valid	2020-04-09 13:00:24 +03:00
allegroai	67fc8e3eb0	Add support for NVIDIA_VISIBLE_DEVICES / CUDA_VISIBLE_DEVICES	2019-10-15 22:34:56 +03:00
allegroai	cfd0344784	Add gpu statistics embedded into package, no need for external packages	2019-10-05 15:26:28 +03:00
allegroai	c0ab9a2f52	Fix resource monitor fall back to seconds since experiment started, will keep waiting for any reporting for 30min, while sending monitor report after 3min	2019-09-27 13:20:41 +03:00
allegroai	0b4f00af4d	Restructured Logger with nice clean interface. ... Breaking changes: Logger no longer supports info/error/warning console() replaced with report_text()	2019-09-23 18:40:13 +03:00
allegroai	02ba0e28d5	Fix support non-linear iteration reporting	2019-07-08 23:27:25 +03:00
allegroai	7b1c0d8c21	Fix, gpu resource monitoring fail safety mechanism	2019-07-06 22:58:36 +03:00
allegroai	738f00340a	Fix resource monitor fall back to seconds-from-start	2019-07-02 00:00:05 +03:00
allegroai	8475ecaed8	Python 2 support	2019-07-01 22:23:40 +03:00
allegroai	d27dc352cb	Changed, resource monitor prefer sync to iterations, over seconds from beginning of experiment	2019-06-27 23:22:28 +03:00
allegroai	85e783cc6b	Add resource monitoring ability machine/gpu	2019-06-24 01:02:41 +03:00