Commit Graph

35 Commits

Author SHA1 Message Date
allegroai
bca162810b Add async pipeline example (--engine custom_async) 2024-02-27 09:44:53 +02:00
allegroai
9488ead080 Add async pipeline version 2024-02-27 09:44:20 +02:00
allegroai
8f6feef938 Fix broken link 2024-02-27 09:43:47 +02:00
allegroai
dc6fd46a46 Update requirements 2024-02-26 11:34:21 +02:00
allegroai
f2ba37c8d4 Fix version enabled endpoints on Triton engine were not called 2024-02-26 11:27:12 +02:00
allegroai
b42a0b0cfc Fix requirements 2024-01-06 17:57:50 +02:00
allegroai
05cbfade2a Update requirements 2023-09-23 18:03:24 +03:00
allegroai
2d3ac1fe63 fix model name 2023-04-13 01:03:50 +03:00
allegroai
3bddccbaef Add new preprocess template 2023-04-12 23:31:32 +03:00
Amir Mousavi
41df4eb287
Removes unnessary flatten (#50) 2023-04-11 09:15:54 +03:00
allegroai
0c5d9820df Optimize containers 2022-10-08 02:22:32 +03:00
allegroai
219fa308df Add huggingface transformers example 2022-10-08 02:12:31 +03:00
allegroai
363276ba79 Add raw bytes serving example 2022-10-08 02:12:18 +03:00
Aleksandar Ivanovski
29c9732e8e [DEV] feature/bytes-payload | Add examples 2022-10-07 09:19:17 +02:00
allegroai
f4eed33f10 Add Triton support for variable length requests, adds support for HuggingFace Transformers
Add triton_grpc_compression=False (default) for grpc connection compression control
2022-09-02 23:41:54 +03:00
allegroai
0588f58405 Fix examples requirements.txt 2022-09-02 21:48:06 +03:00
allegroai
6005e238ca Add custom model serving example 2022-07-15 22:28:15 +03:00
allegroai
8778f723e6 Add pre/post processing callnack state dict, for safe per request state storage 2022-06-05 16:10:20 +03:00
H4dr1en
a3062c08f3
Update readme.md (#21) 2022-04-25 12:05:35 +03:00
allegroai
49e5acba53 Improve pipeline concurrency 2022-04-18 23:24:04 +03:00
Allegro AI
4c55b12343
Update preprocess.py 2022-03-30 20:31:05 +03:00
Allegro AI
0ca2d8ce3a
Update preprocess.py 2022-03-30 20:30:50 +03:00
allegroai
7e9c44e73d Documentation 2022-03-21 17:54:57 +02:00
allegroai
4355c1b1f4 Add model metric logging 2022-03-21 01:00:19 +02:00
allegroai
d684169367 Add model ensemble and model pipelines support 2022-03-09 04:02:03 +02:00
allegroai
34e5a0b2c8 Fix routing 2022-03-06 03:14:06 +02:00
Allegro AI
d84829bb8a
Update readme.md 2022-03-06 02:14:33 +02:00
Allegro AI
f2f0c07c38
Update readme.md 2022-03-06 02:12:33 +02:00
Allegro AI
a49fa0321e
Update readme.md 2022-03-06 02:12:02 +02:00
Allegro AI
b35100568a
Update readme.md 2022-03-06 02:10:55 +02:00
Allegro AI
3560159de0
Update readme.md 2022-03-06 02:10:30 +02:00
allegroai
451e335ceb Add missing requirements 2022-03-06 02:05:52 +02:00
allegroai
b4cb27b27d ClearML-Serving v2 initial working commit 2022-03-06 01:25:56 +02:00
fawad_nizamani
8b77d2cd28 Added python example of sending request to model deployed on triton engine 2021-12-13 20:09:39 +05:00
allegroai
44c66c3848 Initial commit 2021-04-12 03:17:25 +03:00