Commit Graph

10 Commits

Author SHA1 Message Date
Eugen Ajechiloae
6a8e616256 not tested - exit on cuda oom 2024-08-14 19:43:44 +03:00
Eugen Ajechiloae
6ef1f67ad0 initial commit for oom issues - allow for model unload and restart serving on crash 2024-08-14 17:01:29 +03:00
allegroai
4335ebd340 Improve preprocess template docstring 2024-01-06 17:58:20 +02:00
allegroai
d9599ba942 docstring 2023-04-12 23:35:00 +03:00
Aleksandar Ivanovski
d89d1370d8 [DEV] feature/bytes-payload | Add typing 2022-10-06 16:01:31 +02:00
allegroai
6005e238ca Add custom model serving example 2022-07-15 22:28:15 +03:00
allegroai
8778f723e6 Add pre/post processing callnack state dict, for safe per request state storage 2022-06-05 16:10:20 +03:00
allegroai
409fc156fd Add Preprocess.model_endpoint 2022-04-18 23:24:30 +03:00
allegroai
4355c1b1f4 Add model metric logging 2022-03-21 01:00:19 +02:00
allegroai
d684169367 Add model ensemble and model pipelines support 2022-03-09 04:02:03 +02:00