Commit Graph

9 Commits

Author SHA1 Message Date
stephanbertl
666ce26ab2
Add exit-on-error option for tritonserver (#76)
This fixes #60 
Co-authored-by: = <s.bertl@iaea.org>
2024-07-07 15:51:23 +03:00
allegroai
82ade1e24a Fix check triton config.pbtxt for missing values or colliding specifications (#62) 2023-09-23 17:42:57 +03:00
allegroai
96b335e3c2 Fix ignore auto detected platform when passing config.pbtxt with platform entry 2023-09-23 17:40:54 +03:00
allegroai
083635c803 Add str type to Triton type conversion 2023-09-23 17:36:28 +03:00
allegroai
f4aaf095a3 Add triton logging control 2022-10-08 02:10:46 +03:00
allegroai
f4eed33f10 Add Triton support for variable length requests, adds support for HuggingFace Transformers
Add triton_grpc_compression=False (default) for grpc connection compression control
2022-09-02 23:41:54 +03:00
allegroai
4355c1b1f4 Add model metric logging 2022-03-21 01:00:19 +02:00
allegroai
d684169367 Add model ensemble and model pipelines support 2022-03-09 04:02:03 +02:00
allegroai
b4cb27b27d ClearML-Serving v2 initial working commit 2022-03-06 01:25:56 +02:00