ClearML/clearml-serving
1
0
Fork 0
mirror of https://github.com/clearml/clearml-serving synced 2025-02-24 13:12:21 +00:00
Code Issues Actions Packages Projects Releases Wiki Activity

Add exit-on-error option for tritonserver (#76)

Browse Source 
This fixes #60 
Co-authored-by: = <s.bertl@iaea.org>
This commit is contained in:
stephanbertl 2024-07-07 14:51:23 +02:00 committed by GitHub
parent 7ba356efc9
commit 666ce26ab2
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 6 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

6
clearml_serving/engines/triton/triton_helper.py
View File

@ -540,6 +540,12 @@ def main():
parser.add_argument( parser.add_argument(
'--t-log-verbose', type=str, '--t-log-verbose', type=str,
help='<integer> Triton server logging verbosity (default disabled)') help='<integer> Triton server logging verbosity (default disabled)')
parser.add_argument(
'--t-exit-on-error', type=bool, default=True,
help='Exits the inference server if any error occurs during initialization.'
'Recommended to set to True to catch any unanticipated errors.'
'False prevents single models breaking the whole tritonserver.'
)
args = parser.parse_args() args = parser.parse_args()