allegroai 0f4122247d Fix ping serving session task to make sure everyone knows we are alive

2024-02-26 11:31:58 +02:00

..

__init__.py

ClearML-Serving v2 initial working commit

2022-03-06 01:25:56 +02:00

Dockerfile

Upgrade to python 3.11

2023-04-12 23:38:56 +03:00

endpoints.py

Add Triton support for variable length requests, adds support for HuggingFace Transformers

2022-09-02 23:41:54 +03:00

entrypoint.sh

Optimize containers

2022-10-08 02:22:32 +03:00

init.py

Optimize async processing for increased speed

2022-10-08 02:12:04 +03:00

main.py

Fix internal ValueError exception should return 422 (not 404 as before)

2024-01-06 17:55:49 +02:00

model_request_processor.py

Fix ping serving session task to make sure everyone knows we are alive

2024-02-26 11:31:58 +02:00

preprocess_service.py

Fix version enabled endpoints on Triton engine were not called

2024-02-26 11:27:12 +02:00

requirements.txt

Fix requirements issue

2024-01-11 15:21:13 +02:00

uvicorn_mp_entrypoint.py

Optimize async processing for increased speed

2022-10-08 02:12:04 +03:00