Commit Graph

41 Commits

Author SHA1 Message Date
allegroai
748ab67be0 version bump 2022-09-03 00:02:33 +03:00
allegroai
f4eed33f10 Add Triton support for variable length requests, adds support for HuggingFace Transformers
Add triton_grpc_compression=False (default) for grpc connection compression control
2022-09-02 23:41:54 +03:00
allegroai
c6c40c9a36 Add support for Preprocess class inside a module (i.e. __init__.py with subfolders) 2022-09-02 21:50:41 +03:00
allegroai
6005e238ca Add custom model serving example 2022-07-15 22:28:15 +03:00
allegroai
7fa3f2e94a Fix --aux-config not working, issue #30 2022-07-15 22:28:15 +03:00
allegroai
8a79f88040 version bump 2022-06-07 00:52:20 +03:00
allegroai
5beb077f51 Add support for update pre/post processing code to a live endpoint 2022-06-07 00:52:08 +03:00
allegroai
48f720ac91 Optimize request serving statistics reporting 2022-06-07 00:20:33 +03:00
allegroai
4a55c10366 Change default log level to warning UVICORN_LOG_LEVEL 2022-06-07 00:19:51 +03:00
allegroai
f7b21b38b1 Add CLEARML_EXTRA_PYTHON_PACKAGES for additional runtime package installaiton
Upgrade kafka to 3.1.1
2022-06-05 16:15:34 +03:00
allegroai
517ddc1822 Update base triton container to v22.04 (Nvidia driver version 510+) 2022-06-05 16:15:03 +03:00
allegroai
0e240101db Add pandas to the default serving container, update triton client package 2022-06-05 16:12:22 +03:00
allegroai
782cd5dfc8 pep8 2022-06-05 16:11:55 +03:00
allegroai
5361bd3285 Fix statistics container auto reload configuration 2022-06-05 16:11:44 +03:00
allegroai
f2e207e2f2 Add per endpoint-variable add/remove statistics logging 2022-06-05 16:11:17 +03:00
allegroai
8778f723e6 Add pre/post processing callnack state dict, for safe per request state storage 2022-06-05 16:10:20 +03:00
Allegro AI
45d0877c71
Merge pull request #27 from thepycoder/bugfix/statistics_reload
Add task reload call that made statistics service not update correctly
2022-06-03 13:26:15 +03:00
Victor Sonck
dfe620eafc Fix bug where custom buckets are not passed through correctly 2022-06-01 17:14:31 +02:00
Victor Sonck
e3a8ed95b5 Add task reload call that made statistics service not update correctly 2022-06-01 09:54:02 +02:00
Victor Sonck
5a6c8abeb0 Changed variable type to value 2022-05-31 16:30:13 +02:00
allegroai
c3f3008868 pep8 2022-04-29 03:10:35 +03:00
allegroai
409fc156fd Add Preprocess.model_endpoint 2022-04-18 23:24:30 +03:00
allegroai
619ef8da36 Fix print config help fails 2022-04-03 21:28:41 +03:00
allegroai
e0f18dc1f7 Fix metric scalar vector support 2022-03-21 17:10:04 +02:00
allegroai
4355c1b1f4 Add model metric logging 2022-03-21 01:00:19 +02:00
allegroai
d684169367 Add model ensemble and model pipelines support 2022-03-09 04:02:03 +02:00
allegroai
34e5a0b2c8 Fix routing 2022-03-06 03:14:06 +02:00
allegroai
451e335ceb Add missing requirements 2022-03-06 02:05:52 +02:00
allegroai
b4cb27b27d ClearML-Serving v2 initial working commit 2022-03-06 01:25:56 +02:00
allegroai
b5f5d72046 Add --engine-container and --engine-container-args to control serving engine container (issue #2, #3 and #5) 2021-06-13 23:57:34 +03:00
allegroai
b4d01d21bc Add support for serving engine container control
Fix storage packages install by default (issue #5)
2021-06-13 23:56:54 +03:00
allegroai
b6355a1db8 version bump 2021-06-05 03:11:03 +03:00
allegroai
925407923f Fix in case --project is not provided 2021-06-03 08:49:41 +03:00
allegroai
9b81d5e02d Fix passing --id and --project/--name 2021-06-02 14:18:39 +03:00
allegroai
3287e4e4ad Fix FileType usage 2021-06-02 14:18:12 +03:00
allegroai
34d435714f Improve error handling on missing tritonserver executable 2021-05-14 01:30:16 +03:00
allegroai
435c537bca Add --debug 2021-05-13 15:06:29 +03:00
allegroai
7a78743b7c version bump 2021-04-23 00:44:17 +03:00
allegroai
beff309f0f Fix use specific commit ID 2021-04-23 00:44:10 +03:00
allegroai
ad049c51c1 typo 2021-04-12 03:27:21 +03:00
allegroai
44c66c3848 Initial commit 2021-04-12 03:17:25 +03:00