Commit Graph

189 Commits

Author SHA1 Message Date
allegroai
4bca5ccf27 Always reload task section before editing parts of it 2020-03-05 12:11:55 +02:00
allegroai
a2ecb2c75d Only use file based locks for main task. Secondary tasks use traditional multiprocessing lock 2020-03-05 12:10:23 +02:00
allegroai
da804ca75f Add support for Popen subprocesses with task edit protection from multiple processes 2020-03-05 12:05:12 +02:00
allegroai
e3ae4f4e26 Optimize task refresh while pulling task status in local worker and last iteration for Resource Monitoring 2020-03-05 11:40:27 +02:00
Karthikeyan Singaravelan
a97850e5b6 Import ABC from collections.abc instead of collections for Python 3.9 compatibility. 2020-03-03 21:38:03 +05:30
allegroai
146da439e7 Integrate pigar into Trains 2020-03-01 17:12:28 +02:00
allegroai
8ee2bd1844 Retry sending console logs if session.send() fails (applicable only in local mode where we use the logging handler) 2020-02-26 17:07:07 +02:00
allegroai
3ea570cadf Store python binary along with major.minor version in task script section 2020-02-18 11:24:04 +02:00
allegroai
63ffc09ae0 Fix incorrect upgrade message 2020-02-12 14:03:24 +02:00
allegroai
0bc71fbcf4 Remove title/series naming restrictions (allow '$' and '.') 2020-02-10 10:30:57 +02:00
allegroai
3ee70beea2 Fix URL for uploaded files with '%' in their name to allow proper unquote during HTTP serving 2020-02-10 10:30:57 +02:00
allegroai
c6849985ea Add Task.set_base_docer() and Task.get_base_docker() 2020-02-10 10:30:57 +02:00
allegroai
8c2b36968b Prefer tensorflow_gpu over tensorflow when inspecting installed packages 2020-02-04 18:00:39 +02:00
allegroai
7b9e7406ad Fix mutually_exclusive() use of at_least_one() 2020-01-27 15:41:19 +02:00
allegroai
9f8e814ca6 Support git repositories without ".git" suffix 2020-01-27 15:41:19 +02:00
allegroai
923e45bb17 Allow reporting a pre-uploaded image url in Logger.report_image using the url parameter 2020-01-26 15:29:35 +02:00
allegroai
d03311764e Fix None type as default value in dictionary 2020-01-22 11:08:06 +02:00
allegroai
b50bfd5b63 Fix default argparser value handling when value is None 2020-01-22 11:06:52 +02:00
allegroai
af0b8f4c70 Fix type check in hyper-parameters argparser integration 2020-01-22 11:03:56 +02:00
allegroai
1cc0ea6cf3 Fix logs, events and jupyter flushing on exit 2020-01-21 16:41:01 +02:00
allegroai
c5dd762d9b Improve conda support 2020-01-21 16:32:57 +02:00
allegroai
66b251a62b Try to make sure tensorboard is available when using torch 2020-01-13 11:55:55 +02:00
allegroai
f65ef3e757 Support broken Jupyter version on some conda installations (SageMaker) 2020-01-10 13:33:19 +02:00
allegroai
7820e0d14a Use an environment variable for setting a default docker image 2020-01-06 17:09:45 +02:00
allegroai
7b7b6e487e Fix argparser/subparser support and support unsynced connected hyper parameters in remote execution 2020-01-06 17:08:03 +02:00
allegroai
54ae340ccb Use source task id to determine cloned task parent 2020-01-02 12:01:03 +02:00
allegroai
4e0f711e39 Keep only the input artifacts when cloning a task 2019-12-21 18:30:24 +02:00
allegroai
a992591f3c Fix artifacts update in auxiliary task 2019-12-15 00:10:12 +02:00
allegroai
7e7329f7a0 Improve argparser automagic support 2019-11-28 00:49:19 +02:00
allegroai
e1a640d37a Fix support for older git versions (<2) 2019-11-23 01:25:37 +02:00
allegroai
15683b5b43 Fix support for auto package detection for standalone scripts 2019-11-15 21:59:50 +02:00
allegroai
b37aea1839 Add Task name and comment setter 2019-11-15 21:59:24 +02:00
allegroai
9362831269 Add sdk.metric.matplotlib_untitled_history_size to limit number of untitled matplotlib plots (default: 100) 2019-11-08 22:29:36 +02:00
allegroai
1bfee56977 Improve Windows support 2019-11-08 22:28:13 +02:00
allegroai
00e66b5d63 Add missing x/y/z axis titles to various logger report
Changed report_surface arguments
2019-10-27 00:32:05 +03:00
allegroai
2104c3ec6b Add trains-server new capabilities support 2019-10-25 15:15:22 +03:00
allegroai
cb3167bdd8 Add x/y/z title for scatter 2d/3d plots 2019-10-25 15:11:26 +03:00
allegroai
1a658e9d89 Fix output_uri support for local folders 2019-10-15 22:35:37 +03:00
allegroai
e0e6d9159b Fix python 2.7 and Windows support 2019-10-10 21:10:51 +03:00
allegroai
c1bcce9692 Retry suppression 2019-10-10 21:10:18 +03:00
allegroai
0b875a2dea Changed report_image matrix argument to image (with backwards support) 2019-10-10 21:09:44 +03:00
allegroai
8f0bec5861 Fix windows support for time stamp based sorting 2019-10-06 21:56:46 +03:00
allegroai
99a702d149 Add artifacts upload retries (default 3) 2019-10-05 15:25:48 +03:00
allegroai
9f73dbabdb Better multi-processing, switching to to multiprocess Lock 2019-10-04 01:34:22 +03:00
allegroai
4a42345561 Add support for tuples in hyper-parameters dict 2019-10-04 01:31:26 +03:00
allegroai
c44638c8d9 Fix python package analysis timed out before sending git repo detials. 2019-09-27 13:23:32 +03:00
allegroai
e6ed09664f Fix force flush logs at exit 2019-09-25 00:32:08 +03:00
allegroai
0b4f00af4d Restructured Logger with nice clean interface.
Breaking changes: Logger no longer supports info/error/warning console() replaced with report_text()
2019-09-23 18:40:13 +03:00
allegroai
24c2f86741 Add upload artifact supports pd.DataFrame 2019-09-15 21:52:57 +03:00
allegroai
df53ed5577 Fix safe YAML loading 2019-09-15 00:02:42 +03:00
allegroai
b98c821cf9 Fix task cloning 2019-09-15 00:02:23 +03:00
allegroai
2ba372560e Fix set artifacts storage destination with output_uri 2019-09-14 13:55:17 +03:00
allegroai
13dd130c7d Fix always order by created time 2019-09-13 19:08:49 +03:00
allegroai
76ea73a780 Removed apache-libcloud 2019-09-13 17:09:58 +03:00
allegroai
d7bdc746b8 Add full artifacts support 2019-09-13 17:09:24 +03:00
allegroai
3f63394b51 Documentation 2019-09-07 23:28:32 +03:00
allegroai
d0b1c6acb5 Sphinx compatibility 2019-09-05 01:54:15 +03:00
allegroai
64ba30df13 Stability and cleanups 2019-09-03 12:58:01 +03:00
allegroai
3bc1ec2362 Improve stability and resilience on intermittent network connection 2019-08-19 21:17:53 +03:00
allegroai
761082b474 Replace opencv-python with more standard Pillow 2019-08-09 02:18:01 +03:00
allegroai
1d6727d2c0 Improve auto package detection 2019-08-07 00:05:51 +03:00
allegroai
3ab1c261e7 Fix matplotlib support 2019-08-07 00:05:24 +03:00
allegroai
fb7dfc49a9 Fix auto-detect git repository 2019-08-01 12:54:11 +03:00
allegroai
62bc54d7be Add initial artifacts support
Fix sub-process support
Fix delete_after_upload option when uploading images
Add logugu support
Fix subsample plots if they are too big
Fix requests for over 15mb
2019-07-28 21:04:45 +03:00
allegroai
c80aae0e1e Fix support for sub-process (process pool) 2019-07-20 23:11:54 +03:00
allegroai
50ce49a3dd Add separate api/web/file server configuration (backward support included).
OS environment override with:  TRAINS_API_HOST / TRAINS_WEB_HOST / TRAINS_FILES_HOST
2019-07-20 23:09:44 +03:00
allegroai
e655dd6cdf Fix pycharm plugin support large git diff over OS environment 2019-07-13 23:56:27 +03:00
allegroai
9c7e0747fb Add support for Azure notebook and google colab 2019-07-13 23:55:34 +03:00
allegroai
7d0bf4838e Add Task.set_credentials for cloud hosted jupyter support 2019-07-13 23:54:47 +03:00
allegroai
cac4ac12b8 Add seaborn support and SVG support for matplotlib 2019-07-13 23:53:19 +03:00
allegroai
c4c37c5cef Moved definition 2019-07-09 01:52:06 +03:00
allegroai
22b18e7338 Optimize repository query and requirements analysis 2019-07-08 23:28:55 +03:00
allegroai
8a1e31c4f0 Add exception guard 2019-07-08 23:27:53 +03:00
allegroai
577010c421 Add auto requirement.txt generation 2019-07-06 23:01:15 +03:00
allegroai
3050bf1476 Fix OS environment repository detection override 2019-07-06 23:00:28 +03:00
allegroai
22a65abdc1 Add new task state support 2019-07-06 22:58:01 +03:00
allegroai
b5219d98de Add new API backward compatibility support 2019-07-06 22:57:21 +03:00
allegroai
8475ecaed8 Python 2 support 2019-07-01 22:23:40 +03:00
allegroai
85e783cc6b Add resource monitoring ability machine/gpu 2019-06-24 01:02:41 +03:00
allegroai
ff8652f39f Fix support for local git branch, without matching remote branch 2019-06-20 01:49:37 +03:00
allegroai
77e2c32523 Fix timeout for uploading images 2019-06-19 19:47:12 +03:00
allegroai
675dc32528 Add api.verify_certificate to allow non-verified ssl connection (enterprise firewall mitm scenarios), by defaults only secured connections are allowed.
Add latest package check, as long as we are in pre-release.
2019-06-19 15:14:28 +03:00
allegroai
089a4c66ff Fix Jupyter support on Windows host 2019-06-16 02:29:05 +03:00
allegroai
3112769ad9 Better support for connecting dictionary parameters 2019-06-16 02:27:47 +03:00
allegroai
f8fa394f43 Changed log warning to debug 2019-06-15 00:30:51 +03:00
allegroai
ac9aba9242 Support parameter auto casting int/float 2019-06-15 00:30:32 +03:00
allegroai
ea3b5856fd Python 2.7 support 2019-06-13 01:55:36 +03:00
allegroai
fbfa701b96 add support for demoapp.trainsai.io default host 2019-06-11 14:38:50 +03:00
allegroai
f595afe6c8 Initial beta version 2019-06-10 20:02:11 +03:00