Commit Graph

11 Commits

Author SHA1 Message Date
allegroai
f4eed33f10 Add Triton support for variable length requests, adds support for HuggingFace Transformers
Add triton_grpc_compression=False (default) for grpc connection compression control
2022-09-02 23:41:54 +03:00
allegroai
0588f58405 Fix examples requirements.txt 2022-09-02 21:48:06 +03:00
allegroai
8778f723e6 Add pre/post processing callnack state dict, for safe per request state storage 2022-06-05 16:10:20 +03:00
H4dr1en
a3062c08f3
Update readme.md (#21) 2022-04-25 12:05:35 +03:00
Allegro AI
4c55b12343
Update preprocess.py 2022-03-30 20:31:05 +03:00
allegroai
7e9c44e73d Documentation 2022-03-21 17:54:57 +02:00
allegroai
4355c1b1f4 Add model metric logging 2022-03-21 01:00:19 +02:00
allegroai
34e5a0b2c8 Fix routing 2022-03-06 03:14:06 +02:00
Allegro AI
a49fa0321e
Update readme.md 2022-03-06 02:12:02 +02:00
allegroai
451e335ceb Add missing requirements 2022-03-06 02:05:52 +02:00
allegroai
b4cb27b27d ClearML-Serving v2 initial working commit 2022-03-06 01:25:56 +02:00