ClearML/clearml-serving
1
0
Fork 0
mirror of https://github.com/clearml/clearml-serving synced 2025-02-07 13:22:16 +00:00
Code Issues Actions Packages Projects Releases Wiki Activity
748ab67be0
clearml-serving/clearml_serving/engines/triton
History
allegroai f4eed33f10 Add Triton support for variable length requests, adds support for HuggingFace Transformers 
Add triton_grpc_compression=False (default) for grpc connection compression control
2022-09-02 23:41:54 +03:00
..
__init__.py ClearML-Serving v2 initial working commit 2022-03-06 01:25:56 +02:00
Dockerfile Update base triton container to v22.04 (Nvidia driver version 510+) 2022-06-05 16:15:03 +03:00
entrypoint.sh Add CLEARML_EXTRA_PYTHON_PACKAGES for additional runtime package installaiton 2022-06-05 16:15:34 +03:00
requirements.txt Add pandas to the default serving container, update triton client package 2022-06-05 16:12:22 +03:00
triton_helper.py Add Triton support for variable length requests, adds support for HuggingFace Transformers 2022-09-02 23:41:54 +03:00