ClearML/clearml-serving
1
0
Fork 0
mirror of https://github.com/clearml/clearml-serving synced 2025-06-26 18:16:00 +00:00
Code Issues Actions Packages Projects Releases Wiki Activity
155 Commits 2 Branches 8 Tags 2.1 MiB
b67eba1093
Commit Graph

155 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
eajechiloae
b67eba1093
Merge 61be8733c8 into 724c99c605 2024-08-15 16:46:35 +03:00
Eugen Ajechiloae
61be8733c8 remove dbg print 2024-08-15 16:45:36 +03:00
Eugen Ajechiloae
64909cdd65 remove dbg prints 2024-08-15 16:38:27 +03:00
Eugen Ajechiloae
df098f7749 dont call gc collect on remove 2024-08-15 16:25:59 +03:00
Eugen Ajechiloae
fd8b7604a9 call gc on remove as well 2024-08-15 16:18:41 +03:00
Eugen Ajechiloae
d0131d0b58 set status in exit 2024-08-15 16:00:40 +03:00
Eugen Ajechiloae
4fa5b5aa36 force exit using os._exit 2024-08-15 15:55:34 +03:00
Eugen Ajechiloae
1f4e1599e3 let gc handle unload 2024-08-15 15:23:29 +03:00
Eugen Ajechiloae
5d5188de40 add debugging comment 2024-08-14 21:20:13 +03:00
Eugen Ajechiloae
79b987ac0c more dbg prints 2024-08-14 21:03:25 +03:00
Eugen Ajechiloae
67325df4d5 change dbg print 2024-08-14 20:50:57 +03:00
Eugen Ajechiloae
f95939cffe more debug prints 2024-08-14 20:46:45 +03:00
Eugen Ajechiloae
7d801a11da add degug print 2024-08-14 19:47:58 +03:00
Eugen Ajechiloae
6a8e616256 not tested - exit on cuda oom 2024-08-14 19:43:44 +03:00
Eugen Ajechiloae
6ef1f67ad0 initial commit for oom issues - allow for model unload and restart serving on crash 2024-08-14 17:01:29 +03:00
IlyaMescheryakov1402
724c99c605
Add clearml_serving_inference restart on CUDA OOM (#75) 
* initial commit

* add OOM handler for MIG profiles

---------

Co-authored-by: Meshcheryakov Ilya <i.meshcheryakov@mts.ai>
 2024-07-07 15:54:08 +03:00
stephanbertl
666ce26ab2
Add exit-on-error option for tritonserver (#76) 
This fixes #60 
Co-authored-by: = <s.bertl@iaea.org>
 2024-07-07 15:51:23 +03:00
allegroai
7ba356efc9 Update README 2024-03-11 16:54:08 +02:00
allegroai
047a120100 Fix broken requirements 2024-03-01 13:13:48 +02:00
allegroai
71c104c9df Add exception prints to serving session Task and inference Task, for better debugging capabilities 
Add report instance ID when reporting back to the main serving session task
 2024-03-01 13:13:48 +02:00
allegroai
c658780d97 Update README 2024-03-01 00:02:56 +02:00
allegroai
8df521b949 Fix python < 3.10 support 
Fix custom_async engine
Suppress warning
 2024-02-27 09:45:32 +02:00
allegroai
bca162810b Add async pipeline example (--engine custom_async) 2024-02-27 09:44:53 +02:00
allegroai
9488ead080 Add async pipeline version 2024-02-27 09:44:20 +02:00
allegroai
8f6feef938 Fix broken link 2024-02-27 09:43:47 +02:00
allegroai
3611a040f7 Fix requirements 2024-02-27 09:43:18 +02:00
allegroai
dc6fd46a46 Update requirements 2024-02-26 11:34:21 +02:00
allegroai
0f4122247d Fix ping serving session task to make sure everyone knows we are alive 2024-02-26 11:31:58 +02:00
allegroai
f2ba37c8d4 Fix version enabled endpoints on Triton engine were not called 2024-02-26 11:27:12 +02:00
allegroai
4ac13d5287 Fix requirements issue 2024-01-11 15:21:13 +02:00
allegroai
4335ebd340 Improve preprocess template docstring 2024-01-06 17:58:20 +02:00
allegroai
b42a0b0cfc Fix requirements 2024-01-06 17:57:50 +02:00
allegroai
368a03dc70 Fix internal ValueError exception should return 422 (not 404 as before) 2024-01-06 17:55:49 +02:00
allegroai
02fef01657 Add python 3.11 to support matrix 2024-01-06 17:54:56 +02:00
Jake Henning
6c4bece663
Fix Pillow vulnerability "libwebp: OOB write in BuildHuffmanTable" 2023-10-04 13:23:42 +03:00
Jake Henning
c20bbd66b9
Fix Pillow vulnerability "libwebp: OOB write in BuildHuffmanTable" 2023-10-04 13:22:46 +03:00
allegroai
05cbfade2a Update requirements 2023-09-23 18:03:24 +03:00
allegroai
cc5823cfc6 Update README 2023-09-23 17:48:25 +03:00
allegroai
82ade1e24a Fix check triton config.pbtxt for missing values or colliding specifications (#62) 2023-09-23 17:42:57 +03:00
allegroai
96b335e3c2 Fix ignore auto detected platform when passing config.pbtxt with platform entry 2023-09-23 17:40:54 +03:00
allegroai
083635c803 Add str type to Triton type conversion 2023-09-23 17:36:28 +03:00
allegroai
58d826e427 Fail-safe Kafka pulling 2023-09-23 17:36:01 +03:00
allegroai
e4c07c756a Add traceback for failing to load preprocess class (#57) 2023-09-23 17:35:21 +03:00
Jake Henning
4a737b95c6
Update README.md 2023-05-17 19:42:28 +03:00
Amir Mousavi
115770547c
Adds missing await (#55) 
Co-authored-by: Amir Mousavi <amirh@collisure.com>
 2023-05-08 12:46:52 +03:00
allegroai
2d3ac1fe63 fix model name 2023-04-13 01:03:50 +03:00
Allegro AI
eaa2b8a9e8
Update README.md 2023-04-13 00:36:06 +03:00
allegroai
fe04382fdc version bump 2023-04-12 23:39:05 +03:00
allegroai
aca8b4aa03 Upgrade to python 3.11 2023-04-12 23:38:56 +03:00
allegroai
d9599ba942 docstring 2023-04-12 23:35:00 +03:00