50 Commits

Author	SHA1	Message	Date
Victor Sonck	a04d1bda03	Remove never-used but now deprecated np.int (#42)	2023-02-07 08:05:01 +02:00
allegroai	e09e636214	version bump	2022-10-08 14:41:53 +03:00
allegroai	0c5d9820df	Optimize containers	2022-10-08 02:22:32 +03:00
allegroai	395a547c04	Optimize async processing for increased speed	2022-10-08 02:12:04 +03:00
allegroai	f4aaf095a3	Add triton logging control	2022-10-08 02:10:46 +03:00
allegroai	4d4091281a	add more model frameworks support	2022-10-08 02:10:34 +03:00
Aleksandar Ivanovski	d89d1370d8	[DEV] feature/bytes-payload | Add typing	2022-10-06 16:01:31 +02:00
Aleksandar Ivanovski	2aa91a3d43	[DEV] feature/bytes-payload | Handle keys when req is bytes	2022-10-06 15:13:36 +02:00
Aleksandar Ivanovski	09ed480bc2	[DEV] feature/bytes-payload | Add bytes as payload	2022-10-06 13:31:54 +02:00
allegroai	748ab67be0	version bump	2022-09-03 00:02:33 +03:00
allegroai	f4eed33f10	Add Triton support for variable length requests, adds support for HuggingFace Transformers ... Add triton_grpc_compression=False (default) for grpc connection compression control	2022-09-02 23:41:54 +03:00
allegroai	c6c40c9a36	Add support for Preprocess class inside a module (i.e. __init__.py with subfolders)	2022-09-02 21:50:41 +03:00
allegroai	6005e238ca	Add custom model serving example	2022-07-15 22:28:15 +03:00
allegroai	7fa3f2e94a	Fix --aux-config not working, issue #30	2022-07-15 22:28:15 +03:00
allegroai	8a79f88040	version bump	2022-06-07 00:52:20 +03:00
allegroai	5beb077f51	Add support for update pre/post processing code to a live endpoint	2022-06-07 00:52:08 +03:00
allegroai	48f720ac91	Optimize request serving statistics reporting	2022-06-07 00:20:33 +03:00
allegroai	4a55c10366	Change default log level to warning UVICORN_LOG_LEVEL	2022-06-07 00:19:51 +03:00
allegroai	f7b21b38b1	Add CLEARML_EXTRA_PYTHON_PACKAGES for additional runtime package installaiton ... Upgrade kafka to 3.1.1	2022-06-05 16:15:34 +03:00
allegroai	517ddc1822	Update base triton container to v22.04 (Nvidia driver version 510+)	2022-06-05 16:15:03 +03:00
allegroai	0e240101db	Add pandas to the default serving container, update triton client package	2022-06-05 16:12:22 +03:00
allegroai	782cd5dfc8	pep8	2022-06-05 16:11:55 +03:00
allegroai	5361bd3285	Fix statistics container auto reload configuration	2022-06-05 16:11:44 +03:00
allegroai	f2e207e2f2	Add per endpoint-variable add/remove statistics logging	2022-06-05 16:11:17 +03:00
allegroai	8778f723e6	Add pre/post processing callnack state dict, for safe per request state storage	2022-06-05 16:10:20 +03:00
Allegro AI	45d0877c71	Merge pull request #27 from thepycoder/bugfix/statistics_reload ... Add task reload call that made statistics service not update correctly	2022-06-03 13:26:15 +03:00
Victor Sonck	dfe620eafc	Fix bug where custom buckets are not passed through correctly	2022-06-01 17:14:31 +02:00
Victor Sonck	e3a8ed95b5	Add task reload call that made statistics service not update correctly	2022-06-01 09:54:02 +02:00
Victor Sonck	5a6c8abeb0	Changed variable type to value	2022-05-31 16:30:13 +02:00
allegroai	c3f3008868	pep8	2022-04-29 03:10:35 +03:00
allegroai	409fc156fd	Add Preprocess.model_endpoint	2022-04-18 23:24:30 +03:00
allegroai	619ef8da36	Fix print config help fails	2022-04-03 21:28:41 +03:00
allegroai	e0f18dc1f7	Fix metric scalar vector support	2022-03-21 17:10:04 +02:00
allegroai	4355c1b1f4	Add model metric logging	2022-03-21 01:00:19 +02:00
allegroai	d684169367	Add model ensemble and model pipelines support	2022-03-09 04:02:03 +02:00
allegroai	34e5a0b2c8	Fix routing	2022-03-06 03:14:06 +02:00
allegroai	451e335ceb	Add missing requirements	2022-03-06 02:05:52 +02:00
allegroai	b4cb27b27d	ClearML-Serving v2 initial working commit	2022-03-06 01:25:56 +02:00
allegroai	b5f5d72046	Add --engine-container and --engine-container-args to control serving engine container (issue #2, #3 and #5)	2021-06-13 23:57:34 +03:00
allegroai	b4d01d21bc	Add support for serving engine container control ... Fix storage packages install by default (issue #5)	2021-06-13 23:56:54 +03:00
allegroai	b6355a1db8	version bump	2021-06-05 03:11:03 +03:00
allegroai	925407923f	Fix in case --project is not provided	2021-06-03 08:49:41 +03:00
allegroai	9b81d5e02d	Fix passing --id and --project/--name	2021-06-02 14:18:39 +03:00
allegroai	3287e4e4ad	Fix FileType usage	2021-06-02 14:18:12 +03:00
allegroai	34d435714f	Improve error handling on missing tritonserver executable	2021-05-14 01:30:16 +03:00
allegroai	435c537bca	Add --debug	2021-05-13 15:06:29 +03:00
allegroai	7a78743b7c	version bump	2021-04-23 00:44:17 +03:00
allegroai	beff309f0f	Fix use specific commit ID	2021-04-23 00:44:10 +03:00
allegroai	ad049c51c1	typo	2021-04-12 03:27:21 +03:00
allegroai	44c66c3848	Initial commit	2021-04-12 03:17:25 +03:00