Commit Graph

119 Commits

Author SHA1 Message Date
Michael Poluektov
fc31267a54 refac: re-use utils.misc 2024-08-06 11:31:45 +01:00
Michael Poluektov
44c781f414 cleanup 2024-08-06 10:50:22 +01:00
Michael Poluektov
831fe9f509 cleanup 2024-08-06 10:15:29 +01:00
Timothy J. Baek
8fcb5cee66 enh: min_p 2024-08-02 18:11:20 +02:00
Seth Rothschild
c3693c91b3 fix: allow temperature and seed to be 0 2024-07-20 06:53:52 -04:00
Timothy J. Baek
3d0f457306 refac 2024-07-17 10:16:27 +02:00
Timothy J. Baek
4dd77b785a fix 2024-07-11 14:12:44 -07:00
Timothy J. Baek
f462744fc8 refac 2024-07-11 13:43:44 -07:00
Timothy J. Baek
f6efda9e2f refac: ollama non stream response 2024-06-30 01:30:19 -07:00
Timothy J. Baek
c689356b31 refac 2024-06-20 03:57:36 -07:00
Timothy J. Baek
453f9be16c refac 2024-06-18 10:26:53 -07:00
Timothy J. Baek
686c5081e6 fix: model system prompt variable support 2024-06-17 13:47:48 -07:00
Timothy J. Baek
a28ad06bf0 fix 2024-06-16 23:36:21 -07:00
Timothy Jaeryang Baek
c8418da8c1
Merge pull request #3217 from theasp/better-body-logging
chore: Log API request bodies at debug level
2024-06-16 09:07:22 -07:00
Andrew Phillips
c0c875eae2 Use log.debug() for logging request bodies for the backend API 2024-06-16 12:40:16 -03:00
Timothy Jaeryang Baek
26505079b8
Merge pull request #3107 from TheTerrasque/defect/ollama-long-response-timeout
Fix: ollama long response timeout
2024-06-14 02:45:55 -07:00
Timothy J. Baek
454a386612 refac 2024-06-14 00:10:52 -07:00
Sam McLeod
3f5e36271f feat: add num_keep, num_batch 2024-06-14 16:21:20 +10:00
Mikael Turøy
e130ad74d1 Added timeout setting for ollama streaming response 2024-06-12 22:50:15 +02:00
Timothy J. Baek
a93645aee8 refac 2024-06-09 15:08:23 -07:00
Timothy J. Baek
28ca6fb678 refac 2024-06-09 15:04:33 -07:00
Timothy J. Baek
5e7237b9cb refac: title generation 2024-06-09 14:25:31 -07:00
Timothy J. Baek
84defafc14 feat: unified chat completions endpoint 2024-06-09 13:17:44 -07:00
Christoph Holthaus
97b39115a1 fix: temperature not passed correctly 2024-06-09 09:49:24 +02:00
Timothy J. Baek
d077b3dcdb fix: ollama version request when ollama api is disabled 2024-06-05 09:08:52 -07:00
mindspawn
74ed74f1a4
Enable http_proxy use for ollama calls. 2024-06-03 20:43:25 -07:00
Timothy Jaeryang Baek
c5ff4c24e1
Merge branch 'dev' into fix/ollama-cancellation 2024-06-02 16:27:01 -07:00
Timothy J. Baek
e0ba585204 feat: include num_thread in advanced params 2024-06-02 13:20:38 -07:00
Jun Siang Cheah
7f74426a22 fix: openai streaming cancellation using aiohttp 2024-06-02 18:48:45 +01:00
Jun Siang Cheah
4dd51badfe fix: ollama streaming cancellation using aiohttp 2024-06-02 18:06:12 +01:00
Jun Siang Cheah
24c35c308d fix: stream defaults to true, return request ID 2024-06-02 17:09:15 +01:00
Timothy J. Baek
e8d4e03c0d refac: openai allow empty key 2024-05-29 01:12:25 -07:00
Timothy J. Baek
555e4e32d5 feat: allow insecure pull 2024-05-26 01:31:17 -07:00
Timothy J. Baek
1fce466253 refac: folder rename web -> webui 2024-05-26 01:15:48 -07:00
Timothy J. Baek
42dcf1b08c refac: stop param 2024-05-25 02:26:26 -07:00
Timothy J. Baek
88d053833d feat: preset backend logic 2024-05-25 02:05:05 -07:00
Timothy J. Baek
dac9634242 feat: create model 2024-05-24 22:21:57 -07:00
Timothy J. Baek
110ed67468 feat: unified /models endpoint 2024-05-24 01:40:48 -07:00
Timothy Jaeryang Baek
8df0429c99
Merge branch 'dev' into feat/model-config 2024-05-21 21:37:04 -10:00
Timothy J. Baek
21ca55dd30 feat: toggleable ollama 2024-05-21 23:58:42 -07:00
Jun Siang Cheah
f21c8626d6 refac: switch to meta and params, remove source 2024-05-21 22:05:16 +01:00
Jun Siang Cheah
4002ead6af feat: store model configs in the database 2024-05-19 18:46:24 +08:00
Jun Siang Cheah
1bacd5d93f Merge branch 'dev' into feat/model-config 2024-05-19 13:13:17 +08:00
Timothy J. Baek
3aa6b0fea9 fix: model filter issue 2024-05-17 19:11:14 -07:00
Timothy J. Baek
014e52c072 fix: connection timeout 2024-05-17 10:49:12 -07:00
Jun Siang Cheah
5d3eddf7e9 feat: update to persistent config 2024-05-17 13:51:17 +08:00
Jun Siang Cheah
0665703401 Merge branch 'dev' into feat/model-config 2024-05-17 11:41:37 +08:00
Jun Siang Cheah
298e6848b3 feat: switch to config proxy, remove config_get/set 2024-05-10 15:03:24 +08:00
Jun Siang Cheah
058eb76568 feat: save UI config changes to config.json 2024-05-10 13:51:50 +08:00
Jun Siang Cheah
02a4412dfc feat: add UI support for updating model info 2024-05-09 23:54:21 +08:00