allegroai 71c104c9df Add exception prints to serving session Task and inference Task, for better debugging capabilities ...

Add report instance ID when reporting back to the main serving session task

2024-03-01 13:13:48 +02:00

..

__init__.py

ClearML-Serving v2 initial working commit

2022-03-06 01:25:56 +02:00

Dockerfile

Upgrade to python 3.11

2023-04-12 23:38:56 +03:00

endpoints.py

Add Triton support for variable length requests, adds support for HuggingFace Transformers

2022-09-02 23:41:54 +03:00

entrypoint.sh

Optimize containers

2022-10-08 02:22:32 +03:00

init.py

Add exception prints to serving session Task and inference Task, for better debugging capabilities

2024-03-01 13:13:48 +02:00

main.py

Add exception prints to serving session Task and inference Task, for better debugging capabilities

2024-03-01 13:13:48 +02:00

model_request_processor.py

Add exception prints to serving session Task and inference Task, for better debugging capabilities

2024-03-01 13:13:48 +02:00

preprocess_service.py

Fix python < 3.10 support

2024-02-27 09:45:32 +02:00

requirements.txt

Fix requirements

2024-02-27 09:43:18 +02:00

uvicorn_mp_entrypoint.py

Optimize async processing for increased speed

2022-10-08 02:12:04 +03:00