ClearML/clearml-serving
1
0
Fork 0
mirror of https://github.com/clearml/clearml-serving synced 2025-06-26 18:16:00 +00:00
Code Issues Actions Packages Projects Releases Wiki Activity

added exit-on-error option for tritonserver. Fixes allegroai/clearml-serving#60

Browse Source
This commit is contained in:
= 2024-05-03 15:32:45 +02:00
parent 7ba356efc9
commit 375431b75c
1 changed files with 6 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

6
clearml_serving/engines/triton/triton_helper.py
View File

@ -540,6 +540,12 @@ def main():
parser.add_argument(
'--t-log-verbose', type=str,
help='<integer> Triton server logging verbosity (default disabled)')
parser.add_argument(
'--t-exit-on-error', type=bool, default=True,
help='Exits the inference server if any error occurs during initialization.'
'Recommended to set to True to catch any unanticipated errors.'
'False prevents single models breaking the whole tritonserver.'
)
args = parser.parse_args()