ClearML/clearml-serving
1
0
Fork 0
mirror of https://github.com/clearml/clearml-serving synced 2025-06-26 18:16:00 +00:00
Code Issues Actions Packages Projects Releases Wiki Activity
151 Commits 2 Branches 8 Tags 2.1 MiB
fd8b7604a9
Commit Graph

9 Commits

Author SHA1 Message Date
Eugen Ajechiloae
7d801a11da add degug print 2024-08-14 19:47:58 +03:00
Eugen Ajechiloae
6a8e616256 not tested - exit on cuda oom 2024-08-14 19:43:44 +03:00
Eugen Ajechiloae
6ef1f67ad0 initial commit for oom issues - allow for model unload and restart serving on crash 2024-08-14 17:01:29 +03:00
IlyaMescheryakov1402
724c99c605
Add clearml_serving_inference restart on CUDA OOM (#75) 
* initial commit

* add OOM handler for MIG profiles

---------

Co-authored-by: Meshcheryakov Ilya <i.meshcheryakov@mts.ai>
 2024-07-07 15:54:08 +03:00
allegroai
0c5d9820df Optimize containers 2022-10-08 02:22:32 +03:00
allegroai
4a55c10366 Change default log level to warning UVICORN_LOG_LEVEL 2022-06-07 00:19:51 +03:00
allegroai
f7b21b38b1 Add CLEARML_EXTRA_PYTHON_PACKAGES for additional runtime package installaiton 
Upgrade kafka to 3.1.1
 2022-06-05 16:15:34 +03:00
allegroai
4355c1b1f4 Add model metric logging 2022-03-21 01:00:19 +02:00
allegroai
b4cb27b27d ClearML-Serving v2 initial working commit 2022-03-06 01:25:56 +02:00