ClearML/clearml-serving
1
0
Fork 0
mirror of https://github.com/clearml/clearml-serving synced 2025-06-26 18:16:00 +00:00
Code Issues Actions Packages Projects Releases Wiki Activity

Commit Graph

  • 1def0a6901 Update github repo link main clearml 2025-01-13 18:40:02 +02:00
  • 9f51a9334f Fix torch import clearml 2024-12-16 18:51:58 +02:00
  • aff27c62b8 Fix gRPC errors print stack traces and full verbose details. Add support for controlling error printouts using CLEARML_SERVING_AIO_RPC_IGNORE_ERRORS and CLEARML_SERVING_AIO_RPC_VERBOSE_ERRORS (pass a whitespace-separated list of error codes or error names) clearml 2024-12-12 23:57:21 +02:00
  • 724c99c605 Add clearml_serving_inference restart on CUDA OOM (#75) IlyaMescheryakov1402 2024-07-07 15:54:08 +03:00
  • 666ce26ab2 Add exit-on-error option for tritonserver (#76) stephanbertl 2024-07-07 14:51:23 +02:00
  • 7ba356efc9 Update README allegroai 2024-03-11 16:54:08 +02:00
  • 047a120100 Fix broken requirements allegroai 2024-03-01 13:13:26 +02:00
  • 71c104c9df Add exception prints to serving session Task and inference Task, for better debugging capabilities Add report instance ID when reporting back to the main serving session task allegroai 2024-03-01 13:12:56 +02:00
  • c658780d97 Update README allegroai 2024-03-01 00:02:56 +02:00
  • 8df521b949 Fix python < 3.10 support Fix custom_async engine Suppress warning 1.3.1 allegroai 2024-02-27 09:45:32 +02:00
  • bca162810b Add async pipeline example (--engine custom_async) allegroai 2024-02-27 09:44:53 +02:00
  • 9488ead080 Add async pipeline version allegroai 2024-02-27 09:44:20 +02:00
  • 8f6feef938 Fix broken link allegroai 2024-02-27 09:43:47 +02:00
  • 3611a040f7 Fix requirements allegroai 2024-02-27 09:43:18 +02:00
  • dc6fd46a46 Update requirements allegroai 2024-02-26 11:34:21 +02:00
  • 0f4122247d Fix ping serving session task to make sure everyone knows we are alive allegroai 2024-02-26 11:31:58 +02:00
  • f2ba37c8d4 Fix version enabled endpoints on Triton engine were not called allegroai 2024-02-26 11:27:12 +02:00
  • 4ac13d5287 Fix requirements issue allegroai 2024-01-11 15:21:13 +02:00
  • 4335ebd340 Improve preprocess template docstring allegroai 2024-01-06 17:58:20 +02:00
  • b42a0b0cfc Fix requirements allegroai 2024-01-06 17:57:50 +02:00
  • 368a03dc70 Fix internal ValueError exception should return 422 (not 404 as before) allegroai 2024-01-06 17:55:49 +02:00
  • 02fef01657 Add python 3.11 to support matrix allegroai 2024-01-06 17:54:56 +02:00
  • 6c4bece663 Fix Pillow vulnerability "libwebp: OOB write in BuildHuffmanTable" Jake Henning 2023-10-04 13:23:42 +03:00
  • c20bbd66b9 Fix Pillow vulnerability "libwebp: OOB write in BuildHuffmanTable" Jake Henning 2023-10-04 13:22:46 +03:00
  • 05cbfade2a Update requirements allegroai 2023-09-23 18:03:24 +03:00
  • cc5823cfc6 Update README allegroai 2023-09-23 17:48:25 +03:00
  • 82ade1e24a Fix check triton config.pbtxt for missing values or colliding specifications (#62) allegroai 2023-09-23 17:42:57 +03:00
  • 96b335e3c2 Fix ignore auto detected platform when passing config.pbtxt with platform entry allegroai 2023-09-23 17:40:54 +03:00
  • 083635c803 Add str type to Triton type conversion allegroai 2023-09-23 17:36:28 +03:00
  • 58d826e427 Fail-safe Kafka pulling allegroai 2023-09-23 17:36:01 +03:00
  • e4c07c756a Add traceback for failing to load preprocess class (#57) allegroai 2023-09-23 17:35:21 +03:00
  • 4a737b95c6 Update README.md Jake Henning 2023-05-17 19:42:28 +03:00
  • 115770547c Adds missing await (#55) Amir Mousavi 2023-05-08 17:46:52 +08:00
  • 2d3ac1fe63 fix model name allegroai 2023-04-13 01:02:27 +03:00
  • eaa2b8a9e8 Update README.md 1.3.0 Allegro AI 2023-04-13 00:36:06 +03:00
  • fe04382fdc version bump allegroai 2023-04-12 23:39:05 +03:00
  • aca8b4aa03 Upgrade to python 3.11 allegroai 2023-04-12 23:38:56 +03:00
  • d9599ba942 docstring allegroai 2023-04-12 23:35:00 +03:00
  • 78a03cc166 Register models on serving session allegroai 2023-04-12 23:34:49 +03:00
  • 3bddccbaef Add new preprocess template allegroai 2023-04-12 23:31:32 +03:00
  • 31a4ebb965 Add CLEARML_GRPC_* environement variable support to configure grpc channel options (notice CLEARML_GRPC_var is converted into grpc.var when setting grpc channel, casing does not change) #49 allegroai 2023-04-12 23:30:59 +03:00
  • b16c51e631 typo allegroai 2023-04-12 23:29:15 +03:00
  • 41df4eb287 Removes unnessary flatten (#50) Amir Mousavi 2023-04-11 14:15:54 +08:00
  • 6fb0006776 Add environment vars for advanced usage (#45) Sebastian Meyer 2023-03-27 12:57:05 +02:00
  • a04d1bda03 Remove never-used but now deprecated np.int (#42) Victor Sonck 2023-02-07 07:05:01 +01:00
  • e09e636214 version bump 1.2.0 allegroai 2022-10-08 14:41:53 +03:00
  • 0c5d9820df Optimize containers allegroai 2022-10-08 02:22:32 +03:00
  • 219fa308df Add huggingface transformers example allegroai 2022-10-08 02:12:31 +03:00
  • 363276ba79 Add raw bytes serving example allegroai 2022-10-08 02:12:18 +03:00
  • 395a547c04 Optimize async processing for increased speed allegroai 2022-10-08 02:11:57 +03:00
  • f4aaf095a3 Add triton logging control allegroai 2022-10-08 02:10:46 +03:00
  • 4d4091281a add more model frameworks support allegroai 2022-10-08 02:10:34 +03:00
  • 1569f08d1d Merge pull request #37 from codechem/feature/bytes-payload Allegro AI 2022-10-08 00:01:01 +03:00
  • 29c9732e8e [DEV] feature/bytes-payload | Add examples Aleksandar Ivanovski 2022-10-07 09:19:17 +02:00
  • d89d1370d8 [DEV] feature/bytes-payload | Add typing Aleksandar Ivanovski 2022-10-06 16:01:31 +02:00
  • 2aa91a3d43 [DEV] feature/bytes-payload | Handle keys when req is bytes Aleksandar Ivanovski 2022-10-06 15:13:36 +02:00
  • 09ed480bc2 [DEV] feature/bytes-payload | Add bytes as payload Aleksandar Ivanovski 2022-10-06 13:31:54 +02:00
  • 4b52103636 Update README.md Allegro AI 2022-09-03 00:46:52 +03:00
  • 748ab67be0 version bump 1.1.0 allegroai 2022-09-03 00:02:33 +03:00
  • f4eed33f10 Add Triton support for variable length requests, adds support for HuggingFace Transformers Add triton_grpc_compression=False (default) for grpc connection compression control allegroai 2022-09-02 23:41:49 +03:00
  • c6c40c9a36 Add support for Preprocess class inside a module (i.e. __init__.py with subfolders) allegroai 2022-09-02 21:50:41 +03:00
  • 0588f58405 Fix examples requirements.txt allegroai 2022-09-02 21:48:06 +03:00
  • 6005e238ca Add custom model serving example allegroai 2022-07-15 22:27:55 +03:00
  • 4f31c4c178 Add python 3.10 to support table allegroai 2022-07-15 22:27:35 +03:00
  • 7fa3f2e94a Fix --aux-config not working, issue #30 allegroai 2022-07-15 22:27:10 +03:00
  • 3e28569181 Endpoint model name revision (#31) dev William Zhang 2022-07-11 18:49:20 +07:00
  • 826f503cf4 Update README.md Allegro AI 2022-06-07 17:00:13 +03:00
  • a12311c7d6 Update README.md 1.0.0 Allegro AI 2022-06-07 01:11:38 +03:00
  • 8a79f88040 version bump allegroai 2022-06-07 00:52:20 +03:00
  • 5beb077f51 Add support for update pre/post processing code to a live endpoint allegroai 2022-06-07 00:52:08 +03:00
  • b5de243348 Update to do list allegroai 2022-06-07 00:20:42 +03:00
  • 48f720ac91 Optimize request serving statistics reporting allegroai 2022-06-07 00:20:33 +03:00
  • 4a55c10366 Change default log level to warning UVICORN_LOG_LEVEL allegroai 2022-06-07 00:19:51 +03:00
  • 723878f65d Add kubernetes helm chart allegroai 2022-06-05 17:17:19 +03:00
  • f7b21b38b1 Add CLEARML_EXTRA_PYTHON_PACKAGES for additional runtime package installaiton Upgrade kafka to 3.1.1 allegroai 2022-06-05 16:15:34 +03:00
  • 517ddc1822 Update base triton container to v22.04 (Nvidia driver version 510+) allegroai 2022-06-05 16:15:03 +03:00
  • 0e240101db Add pandas to the default serving container, update triton client package allegroai 2022-06-05 16:12:22 +03:00
  • 782cd5dfc8 pep8 allegroai 2022-06-05 16:11:55 +03:00
  • 5361bd3285 Fix statistics container auto reload configuration allegroai 2022-06-05 16:11:44 +03:00
  • f2e207e2f2 Add per endpoint-variable add/remove statistics logging allegroai 2022-06-05 16:11:17 +03:00
  • 8778f723e6 Add pre/post processing callnack state dict, for safe per request state storage allegroai 2022-06-05 16:10:16 +03:00
  • 45d0877c71 Merge pull request #27 from thepycoder/bugfix/statistics_reload Allegro AI 2022-06-03 13:26:15 +03:00
  • 4c7d630895 Merge pull request #28 from thepycoder/bugfix/scalar_histogram_typo Allegro AI 2022-06-03 13:25:58 +03:00
  • dfe620eafc Fix bug where custom buckets are not passed through correctly Victor Sonck 2022-06-01 17:14:31 +02:00
  • e3a8ed95b5 Add task reload call that made statistics service not update correctly Victor Sonck 2022-06-01 09:54:02 +02:00
  • c51e2d402e Merge pull request #26 from thepycoder/bugfix/variable_value_mixup Allegro AI 2022-05-31 17:32:37 +03:00
  • 5a6c8abeb0 Changed variable type to value Victor Sonck 2022-05-31 16:30:13 +02:00
  • d15bfcade5 Fix triton model auto refresh default value allegroai 2022-04-29 03:10:58 +03:00
  • c3f3008868 pep8 allegroai 2022-04-29 03:10:35 +03:00
  • a3062c08f3 Update readme.md (#21) H4dr1en 2022-04-25 11:05:35 +02:00
  • 827905cdc0 Fix link in README (#20) pollfly 2022-04-20 23:44:01 +03:00
  • 409fc156fd Add Preprocess.model_endpoint allegroai 2022-04-18 23:24:30 +03:00
  • 49e5acba53 Improve pipeline concurrency allegroai 2022-04-18 23:24:04 +03:00
  • 8314074edf Update diagram allegroai 2022-04-18 23:21:15 +03:00
  • 19fc4f8202 Update diagram allegroai 2022-04-03 21:37:34 +03:00
  • 619ef8da36 Fix print config help fails allegroai 2022-04-03 21:28:41 +03:00
  • a54a9fbb7c Update README.md Allegro AI 2022-04-01 19:22:18 +03:00
  • 9048d77cb6 Update README.md Allegro AI 2022-04-01 19:12:56 +03:00
  • 5ee6e244d4 Update diagram allegroai 2022-04-01 19:09:19 +03:00
  • 4c55b12343 Update preprocess.py Allegro AI 2022-03-30 20:31:05 +03:00