ClearML/clearml-serving
1
0
Fork 0
mirror of https://github.com/clearml/clearml-serving synced 2025-02-07 05:18:12 +00:00
Code Issues Actions Packages Projects Releases Wiki Activity
143 Commits 2 Branches 8 Tags 2.1 MiB
main
Commit Graph

3 Commits

Author SHA1 Message Date
IlyaMescheryakov1402
724c99c605
Add clearml_serving_inference restart on CUDA OOM (#75) 
* initial commit

* add OOM handler for MIG profiles

---------

Co-authored-by: Meshcheryakov Ilya <i.meshcheryakov@mts.ai>
 2024-07-07 15:54:08 +03:00
allegroai
71c104c9df Add exception prints to serving session Task and inference Task, for better debugging capabilities 
Add report instance ID when reporting back to the main serving session task
 2024-03-01 13:13:48 +02:00
allegroai
395a547c04 Optimize async processing for increased speed 2022-10-08 02:12:04 +03:00