22 Commits

Author	SHA1	Message	Date
allegroai	395a547c04	Optimize async processing for increased speed	2022-10-08 02:12:04 +03:00
Aleksandar Ivanovski	d89d1370d8	[DEV] feature/bytes-payload | Add typing	2022-10-06 16:01:31 +02:00
Aleksandar Ivanovski	2aa91a3d43	[DEV] feature/bytes-payload | Handle keys when req is bytes	2022-10-06 15:13:36 +02:00
Aleksandar Ivanovski	09ed480bc2	[DEV] feature/bytes-payload | Add bytes as payload	2022-10-06 13:31:54 +02:00
allegroai	f4eed33f10	Add Triton support for variable length requests, adds support for HuggingFace Transformers ... Add triton_grpc_compression=False (default) for grpc connection compression control	2022-09-02 23:41:54 +03:00
allegroai	c6c40c9a36	Add support for Preprocess class inside a module (i.e. __init__.py with subfolders)	2022-09-02 21:50:41 +03:00
allegroai	5beb077f51	Add support for update pre/post processing code to a live endpoint	2022-06-07 00:52:08 +03:00
allegroai	48f720ac91	Optimize request serving statistics reporting	2022-06-07 00:20:33 +03:00
allegroai	4a55c10366	Change default log level to warning UVICORN_LOG_LEVEL	2022-06-07 00:19:51 +03:00
allegroai	f7b21b38b1	Add CLEARML_EXTRA_PYTHON_PACKAGES for additional runtime package installaiton ... Upgrade kafka to 3.1.1	2022-06-05 16:15:34 +03:00
allegroai	0e240101db	Add pandas to the default serving container, update triton client package	2022-06-05 16:12:22 +03:00
allegroai	782cd5dfc8	pep8	2022-06-05 16:11:55 +03:00
allegroai	f2e207e2f2	Add per endpoint-variable add/remove statistics logging	2022-06-05 16:11:17 +03:00
allegroai	8778f723e6	Add pre/post processing callnack state dict, for safe per request state storage	2022-06-05 16:10:20 +03:00
Victor Sonck	e3a8ed95b5	Add task reload call that made statistics service not update correctly	2022-06-01 09:54:02 +02:00
allegroai	c3f3008868	pep8	2022-04-29 03:10:35 +03:00
allegroai	409fc156fd	Add Preprocess.model_endpoint	2022-04-18 23:24:30 +03:00
allegroai	4355c1b1f4	Add model metric logging	2022-03-21 01:00:19 +02:00
allegroai	d684169367	Add model ensemble and model pipelines support	2022-03-09 04:02:03 +02:00
allegroai	34e5a0b2c8	Fix routing	2022-03-06 03:14:06 +02:00
allegroai	451e335ceb	Add missing requirements	2022-03-06 02:05:52 +02:00
allegroai	b4cb27b27d	ClearML-Serving v2 initial working commit	2022-03-06 01:25:56 +02:00