Commit Graph

136 Commits

Author SHA1 Message Date
allegroai
71c104c9df Add exception prints to serving session Task and inference Task, for better debugging capabilities
Add report instance ID when reporting back to the main serving session task
2024-03-01 13:13:48 +02:00
allegroai
c658780d97 Update README 2024-03-01 00:02:56 +02:00
allegroai
8df521b949 Fix python < 3.10 support
Fix custom_async engine
Suppress warning
2024-02-27 09:45:32 +02:00
allegroai
bca162810b Add async pipeline example (--engine custom_async) 2024-02-27 09:44:53 +02:00
allegroai
9488ead080 Add async pipeline version 2024-02-27 09:44:20 +02:00
allegroai
8f6feef938 Fix broken link 2024-02-27 09:43:47 +02:00
allegroai
3611a040f7 Fix requirements 2024-02-27 09:43:18 +02:00
allegroai
dc6fd46a46 Update requirements 2024-02-26 11:34:21 +02:00
allegroai
0f4122247d Fix ping serving session task to make sure everyone knows we are alive 2024-02-26 11:31:58 +02:00
allegroai
f2ba37c8d4 Fix version enabled endpoints on Triton engine were not called 2024-02-26 11:27:12 +02:00
allegroai
4ac13d5287 Fix requirements issue 2024-01-11 15:21:13 +02:00
allegroai
4335ebd340 Improve preprocess template docstring 2024-01-06 17:58:20 +02:00
allegroai
b42a0b0cfc Fix requirements 2024-01-06 17:57:50 +02:00
allegroai
368a03dc70 Fix internal ValueError exception should return 422 (not 404 as before) 2024-01-06 17:55:49 +02:00
allegroai
02fef01657 Add python 3.11 to support matrix 2024-01-06 17:54:56 +02:00
Jake Henning
6c4bece663
Fix Pillow vulnerability "libwebp: OOB write in BuildHuffmanTable" 2023-10-04 13:23:42 +03:00
Jake Henning
c20bbd66b9
Fix Pillow vulnerability "libwebp: OOB write in BuildHuffmanTable" 2023-10-04 13:22:46 +03:00
allegroai
05cbfade2a Update requirements 2023-09-23 18:03:24 +03:00
allegroai
cc5823cfc6 Update README 2023-09-23 17:48:25 +03:00
allegroai
82ade1e24a Fix check triton config.pbtxt for missing values or colliding specifications (#62) 2023-09-23 17:42:57 +03:00
allegroai
96b335e3c2 Fix ignore auto detected platform when passing config.pbtxt with platform entry 2023-09-23 17:40:54 +03:00
allegroai
083635c803 Add str type to Triton type conversion 2023-09-23 17:36:28 +03:00
allegroai
58d826e427 Fail-safe Kafka pulling 2023-09-23 17:36:01 +03:00
allegroai
e4c07c756a Add traceback for failing to load preprocess class (#57) 2023-09-23 17:35:21 +03:00
Jake Henning
4a737b95c6
Update README.md 2023-05-17 19:42:28 +03:00
Amir Mousavi
115770547c
Adds missing await (#55)
Co-authored-by: Amir Mousavi <amirh@collisure.com>
2023-05-08 12:46:52 +03:00
allegroai
2d3ac1fe63 fix model name 2023-04-13 01:03:50 +03:00
Allegro AI
eaa2b8a9e8
Update README.md 2023-04-13 00:36:06 +03:00
allegroai
fe04382fdc version bump 2023-04-12 23:39:05 +03:00
allegroai
aca8b4aa03 Upgrade to python 3.11 2023-04-12 23:38:56 +03:00
allegroai
d9599ba942 docstring 2023-04-12 23:35:00 +03:00
allegroai
78a03cc166 Register models on serving session 2023-04-12 23:34:49 +03:00
allegroai
3bddccbaef Add new preprocess template 2023-04-12 23:31:32 +03:00
allegroai
31a4ebb965 Add CLEARML_GRPC_* environement variable support to configure grpc channel options (notice CLEARML_GRPC_var is converted into grpc.var when setting grpc channel, casing does not change) #49 2023-04-12 23:30:59 +03:00
allegroai
b16c51e631 typo 2023-04-12 23:29:15 +03:00
Amir Mousavi
41df4eb287
Removes unnessary flatten (#50) 2023-04-11 09:15:54 +03:00
Sebastian Meyer
6fb0006776
Add environment vars for advanced usage (#45)
The documentation ([advanced setup](https://clear.ml/docs/latest/docs/clearml_serving/clearml_serving_setup#advanced-setup---s3gsazure-access-optional)) states that these variables must be set in the examples.env file. But they were missing from the docker-compose.yml file
2023-03-27 13:57:05 +03:00
Victor Sonck
a04d1bda03
Remove never-used but now deprecated np.int (#42) 2023-02-07 08:05:01 +02:00
allegroai
e09e636214 version bump 2022-10-08 14:41:53 +03:00
allegroai
0c5d9820df Optimize containers 2022-10-08 02:22:32 +03:00
allegroai
219fa308df Add huggingface transformers example 2022-10-08 02:12:31 +03:00
allegroai
363276ba79 Add raw bytes serving example 2022-10-08 02:12:18 +03:00
allegroai
395a547c04 Optimize async processing for increased speed 2022-10-08 02:12:04 +03:00
allegroai
f4aaf095a3 Add triton logging control 2022-10-08 02:10:46 +03:00
allegroai
4d4091281a add more model frameworks support 2022-10-08 02:10:34 +03:00
Allegro AI
1569f08d1d
Merge pull request #37 from codechem/feature/bytes-payload
Bytes request payload
2022-10-08 00:01:01 +03:00
Aleksandar Ivanovski
29c9732e8e [DEV] feature/bytes-payload | Add examples 2022-10-07 09:19:17 +02:00
Aleksandar Ivanovski
d89d1370d8 [DEV] feature/bytes-payload | Add typing 2022-10-06 16:01:31 +02:00
Aleksandar Ivanovski
2aa91a3d43 [DEV] feature/bytes-payload | Handle keys when req is bytes 2022-10-06 15:13:36 +02:00
Aleksandar Ivanovski
09ed480bc2 [DEV] feature/bytes-payload | Add bytes as payload 2022-10-06 13:31:54 +02:00