Commit Graph

143 Commits

Author SHA1 Message Date
allegroai
f4aaf095a3 Add triton logging control 2022-10-08 02:10:46 +03:00
allegroai
4d4091281a add more model frameworks support 2022-10-08 02:10:34 +03:00
Allegro AI
1569f08d1d
Merge pull request #37 from codechem/feature/bytes-payload
Bytes request payload
2022-10-08 00:01:01 +03:00
Aleksandar Ivanovski
29c9732e8e [DEV] feature/bytes-payload | Add examples 2022-10-07 09:19:17 +02:00
Aleksandar Ivanovski
d89d1370d8 [DEV] feature/bytes-payload | Add typing 2022-10-06 16:01:31 +02:00
Aleksandar Ivanovski
2aa91a3d43 [DEV] feature/bytes-payload | Handle keys when req is bytes 2022-10-06 15:13:36 +02:00
Aleksandar Ivanovski
09ed480bc2 [DEV] feature/bytes-payload | Add bytes as payload 2022-10-06 13:31:54 +02:00
Allegro AI
4b52103636
Update README.md 2022-09-03 00:46:52 +03:00
allegroai
748ab67be0 version bump 2022-09-03 00:02:33 +03:00
allegroai
f4eed33f10 Add Triton support for variable length requests, adds support for HuggingFace Transformers
Add triton_grpc_compression=False (default) for grpc connection compression control
2022-09-02 23:41:54 +03:00
allegroai
c6c40c9a36 Add support for Preprocess class inside a module (i.e. __init__.py with subfolders) 2022-09-02 21:50:41 +03:00
allegroai
0588f58405 Fix examples requirements.txt 2022-09-02 21:48:06 +03:00
allegroai
6005e238ca Add custom model serving example 2022-07-15 22:28:15 +03:00
allegroai
4f31c4c178 Add python 3.10 to support table 2022-07-15 22:28:15 +03:00
allegroai
7fa3f2e94a Fix --aux-config not working, issue #30 2022-07-15 22:28:15 +03:00
Allegro AI
826f503cf4
Update README.md 2022-06-07 17:00:13 +03:00
Allegro AI
a12311c7d6
Update README.md 2022-06-07 01:11:38 +03:00
allegroai
8a79f88040 version bump 2022-06-07 00:52:20 +03:00
allegroai
5beb077f51 Add support for update pre/post processing code to a live endpoint 2022-06-07 00:52:08 +03:00
allegroai
b5de243348 Update to do list 2022-06-07 00:20:42 +03:00
allegroai
48f720ac91 Optimize request serving statistics reporting 2022-06-07 00:20:33 +03:00
allegroai
4a55c10366 Change default log level to warning UVICORN_LOG_LEVEL 2022-06-07 00:19:51 +03:00
allegroai
723878f65d Add kubernetes helm chart 2022-06-05 17:17:19 +03:00
allegroai
f7b21b38b1 Add CLEARML_EXTRA_PYTHON_PACKAGES for additional runtime package installaiton
Upgrade kafka to 3.1.1
2022-06-05 16:15:34 +03:00
allegroai
517ddc1822 Update base triton container to v22.04 (Nvidia driver version 510+) 2022-06-05 16:15:03 +03:00
allegroai
0e240101db Add pandas to the default serving container, update triton client package 2022-06-05 16:12:22 +03:00
allegroai
782cd5dfc8 pep8 2022-06-05 16:11:55 +03:00
allegroai
5361bd3285 Fix statistics container auto reload configuration 2022-06-05 16:11:44 +03:00
allegroai
f2e207e2f2 Add per endpoint-variable add/remove statistics logging 2022-06-05 16:11:17 +03:00
allegroai
8778f723e6 Add pre/post processing callnack state dict, for safe per request state storage 2022-06-05 16:10:20 +03:00
Allegro AI
45d0877c71
Merge pull request #27 from thepycoder/bugfix/statistics_reload
Add task reload call that made statistics service not update correctly
2022-06-03 13:26:15 +03:00
Allegro AI
4c7d630895
Merge pull request #28 from thepycoder/bugfix/scalar_histogram_typo
Fix bug where custom buckets are not passed through correctly
2022-06-03 13:25:58 +03:00
Victor Sonck
dfe620eafc Fix bug where custom buckets are not passed through correctly 2022-06-01 17:14:31 +02:00
Victor Sonck
e3a8ed95b5 Add task reload call that made statistics service not update correctly 2022-06-01 09:54:02 +02:00
Allegro AI
c51e2d402e
Merge pull request #26 from thepycoder/bugfix/variable_value_mixup
Changed variable type to value
2022-05-31 17:32:37 +03:00
Victor Sonck
5a6c8abeb0 Changed variable type to value 2022-05-31 16:30:13 +02:00
allegroai
d15bfcade5 Fix triton model auto refresh default value 2022-04-29 03:10:58 +03:00
allegroai
c3f3008868 pep8 2022-04-29 03:10:35 +03:00
H4dr1en
a3062c08f3
Update readme.md (#21) 2022-04-25 12:05:35 +03:00
pollfly
827905cdc0
Fix link in README (#20) 2022-04-20 23:44:01 +03:00
allegroai
409fc156fd Add Preprocess.model_endpoint 2022-04-18 23:24:30 +03:00
allegroai
49e5acba53 Improve pipeline concurrency 2022-04-18 23:24:04 +03:00
allegroai
8314074edf Update diagram 2022-04-18 23:21:15 +03:00
allegroai
19fc4f8202 Update diagram 2022-04-03 21:37:34 +03:00
allegroai
619ef8da36 Fix print config help fails 2022-04-03 21:28:41 +03:00
Allegro AI
a54a9fbb7c
Update README.md 2022-04-01 19:22:18 +03:00
Allegro AI
9048d77cb6
Update README.md 2022-04-01 19:12:56 +03:00
allegroai
5ee6e244d4 Update diagram 2022-04-01 19:09:19 +03:00
Allegro AI
4c55b12343
Update preprocess.py 2022-03-30 20:31:05 +03:00
Allegro AI
0ca2d8ce3a
Update preprocess.py 2022-03-30 20:30:50 +03:00