Eugen Ajechiloae
|
6a8e616256
|
not tested - exit on cuda oom
|
2024-08-14 19:43:44 +03:00 |
|
Eugen Ajechiloae
|
6ef1f67ad0
|
initial commit for oom issues - allow for model unload and restart serving on crash
|
2024-08-14 17:01:29 +03:00 |
|
allegroai
|
4335ebd340
|
Improve preprocess template docstring
|
2024-01-06 17:58:20 +02:00 |
|
allegroai
|
d9599ba942
|
docstring
|
2023-04-12 23:35:00 +03:00 |
|
Aleksandar Ivanovski
|
d89d1370d8
|
[DEV] feature/bytes-payload | Add typing
|
2022-10-06 16:01:31 +02:00 |
|
allegroai
|
6005e238ca
|
Add custom model serving example
|
2022-07-15 22:28:15 +03:00 |
|
allegroai
|
8778f723e6
|
Add pre/post processing callnack state dict, for safe per request state storage
|
2022-06-05 16:10:20 +03:00 |
|
allegroai
|
409fc156fd
|
Add Preprocess.model_endpoint
|
2022-04-18 23:24:30 +03:00 |
|
allegroai
|
4355c1b1f4
|
Add model metric logging
|
2022-03-21 01:00:19 +02:00 |
|
allegroai
|
d684169367
|
Add model ensemble and model pipelines support
|
2022-03-09 04:02:03 +02:00 |
|