Files
clearml-serving/clearml_serving/serving/model_request_processor.py
IlyaMescheryakov1402 724c99c605 Add clearml_serving_inference restart on CUDA OOM (#75)
* initial commit

* add OOM handler for MIG profiles

---------

Co-authored-by: Meshcheryakov Ilya <i.meshcheryakov@mts.ai>
2024-07-07 15:54:08 +03:00

61 KiB