Commit Graph

759 Commits

Author SHA1 Message Date
Timothy J. Baek
d3822f782c feat: non-english youtube support 2024-05-08 10:47:05 -07:00
Timothy J. Baek
c40e634391 feat: better error message 2024-05-08 09:30:14 -07:00
Timothy J. Baek
01472c071b feat: support webui_auth false
#929
2024-05-08 08:40:18 -07:00
Timothy Jaeryang Baek
675328c881
Merge pull request #2002 from Yanyutin753/addAudio
🤩 Added custom openai tts models and role variables
2024-05-08 08:03:20 -07:00
Timothy J. Baek
9c190b56ae feat: /v1/models endpoint added for ollama proxy 2024-05-07 23:34:12 -07:00
Aarni Koskela
61bb1f1dc8 fix: do not use hardware ID in document ID generation 2024-05-07 11:42:05 +03:00
Yanyutin753
5d6517c537 update the name 2024-05-07 08:28:34 +08:00
Timothy Jaeryang Baek
635951b55c
Merge branch 'dev' into feat/backend-web-search 2024-05-06 16:26:44 -07:00
Timothy J. Baek
64ed0d1089 refac: include source name to citation 2024-05-06 16:16:26 -07:00
Timothy J. Baek
4c490132ba refac: styling 2024-05-06 16:16:26 -07:00
Jun Siang Cheah
0872bea790 feat: show RAG query results as citations 2024-05-06 16:14:10 -07:00
Timothy J. Baek
cecb87b8c2 feat: web_loader_ssl_verification setting 2024-05-06 14:50:55 -07:00
Timothy J. Baek
95f579cabe feat: rag ssl verification env var
Co-Authored-By: Tobias Steidle <tobias.steidle@softwaredev.de>
2024-05-06 13:12:08 -07:00
Jun Siang Cheah
8b3e370a6e fix: run formatter 2024-05-06 17:11:04 +08:00
Jun Siang Cheah
83f086ccdd fix: do not return raw search exception due to API keys in URLs 2024-05-06 17:09:04 +08:00
Jun Siang Cheah
99e4edd364 feat: add websearch endpoint to RAG API
fix: google PSE endpoint uses GET

fix: google PSE returns link, not url

fix: serper wrong field
2024-05-06 17:09:04 +08:00
Yanyutin753
5f7188b480 fix python test 2024-05-06 15:33:29 +08:00
Yanyutin753
761c66a8d8 🤩 Added custom openai tts models and role variables 2024-05-06 15:23:27 +08:00
Jun Siang Cheah
501ff7a98b feat: backend implementation of various search APIs 2024-05-06 12:28:41 +08:00
Timothy J. Baek
24c0dbec0d fix: pending permission issue 2024-05-04 01:31:08 -07:00
Timothy J. Baek
fa3c7bc218 fix 2024-05-03 15:34:08 -07:00
Timothy J. Baek
facb6edfdc refac: chat tags 2024-05-03 15:25:41 -07:00
Timothy J. Baek
e8085f80a7 fix: litellm warning message
>:(
2024-05-03 15:07:12 -07:00
Timothy J. Baek
683e6ca337 fix 2024-05-02 15:59:45 -07:00
Timothy J. Baek
989a4d3165 fix 2024-05-02 15:55:42 -07:00
Timothy J. Baek
482f010d22 fix: image gen 2024-05-02 15:54:31 -07:00
tabacoWang
fffd283b0c fix:
fix: Change the type from int to float
2024-05-02 13:45:19 +08:00
Timothy J. Baek
68cfccedee feat: super-admin (first one to signup) 2024-05-01 19:59:05 -07:00
Timothy J. Baek
20a6dbbe65 feat: csv bulk import 2024-05-01 19:28:35 -07:00
Timothy J. Baek
bd3b5f1edb feat: csv user import frontend 2024-05-01 19:02:25 -07:00
Timothy J. Baek
e6bcdba5ad feat: add user from admin panel 2024-05-01 18:06:02 -07:00
Timothy J. Baek
b7fcf14f6e refac: styling 2024-05-01 17:55:18 -07:00
Timothy J. Baek
0595c04909 feat: youtube rag 2024-05-01 17:17:00 -07:00
Timothy Jaeryang Baek
de62153d49
Merge pull request #1815 from Yanyutin753/new-dev
 expend the image format type after the file is downloaded
2024-04-30 11:52:30 -07:00
Timothy J. Baek
80413a7628 refac 2024-04-30 11:52:08 -07:00
Yanyutin753
c0bb32d768 📌 fixed a bug where RAG would not reply after not reading the file correctly 2024-04-30 13:51:30 +08:00
Timothy Jaeryang Baek
1afc49c1e4
Merge pull request #1862 from cheahjs/feat/filter-local-rag-fetch
feat: add ENABLE_LOCAL_WEB_FETCH to protect against SSRF attacks
2024-04-29 15:51:17 -07:00
Jun Siang Cheah
1c4e63f71e feat: add ENABLE_LOCAL_WEB_FETCH to protect against SSRF attacks 2024-04-29 20:55:17 +01:00
Steven Kreitzer
5b8fd14470 fix: various api rag results 2024-04-29 12:17:36 -05:00
Timothy J. Baek
9832e6edba enhancement: OpenAI API
api.together.xyz, api.replicate.com
2024-04-28 10:20:40 -07:00
Yanyutin753
3321a1b922 expend the image format type after the file is downloaded 2024-04-28 12:00:52 +08:00
Timothy J. Baek
71a75bccf5 fix 2024-04-27 20:06:07 -07:00
Timothy J. Baek
48ed701960 fix 2024-04-27 19:44:36 -07:00
Timothy J. Baek
5e97c9927b fix 2024-04-27 19:42:19 -07:00
Timothy J. Baek
8aa47ea6bc fix 2024-04-27 21:17:19 -04:00
Timothy Jaeryang Baek
386fc040b1
Merge pull request #1802 from Yanyutin753/tem-dev
feat added environment variables and sync.yml
2024-04-27 16:39:45 -07:00
Timothy J. Baek
9094536d37 feat: user last active 2024-04-27 19:38:51 -04:00
Yanyutin753
849a0b973d recompose the name of environment variables 2024-04-28 07:21:01 +08:00
Timothy J. Baek
01c4647dfc fix: ollama version string issue
#1800
2024-04-27 19:19:47 -04:00
Yanyutin753
b0245a7eff feat added environment variables and sync.yml 2024-04-28 06:54:26 +08:00
Timothy J. Baek
bcf78b4efa feat: show user chats in admin panel 2024-04-27 18:24:59 -04:00
Timothy J. Baek
098ac18762 refac: naming 2024-04-27 18:15:32 -04:00
Timothy J. Baek
4ea2eb7939 refac 2024-04-27 18:14:15 -04:00
Timothy J. Baek
10f27ebacf refac: naming 2024-04-27 18:12:57 -04:00
Timothy Jaeryang Baek
c1d85f8a6f
Merge pull request #1791 from cheahjs/feat/external-db-support
feat: add support for using postgres for the backend DB
2024-04-27 12:48:56 -07:00
Timothy J. Baek
ce9a5d12e0 refac: rag pipeline 2024-04-27 15:38:50 -04:00
Timothy J. Baek
8f1563a7a5 fix: typo 2024-04-27 15:03:49 -04:00
Timothy J. Baek
9be56d68e0 refac: naming convention 2024-04-27 15:02:57 -04:00
Jun Siang Cheah
47a33acfeb feat: show error toast if trying to download db on external db 2024-04-27 15:53:31 +01:00
Jun Siang Cheah
e91a49c455 feat: add support for using postgres for the backend DB 2024-04-27 15:33:20 +01:00
Timothy J. Baek
dbf7b15539 refac: naming convention
MODEL_FILTER_ENABLED -> ENABLE_MODEL_FILTER
2024-04-26 17:17:18 -04:00
Timothy J. Baek
cebf733b9d refac: naming convention 2024-04-26 14:41:39 -04:00
Steven Kreitzer
69822e4c25 fix: sort ranking hybrid 2024-04-26 07:56:41 -05:00
Steven Kreitzer
9755cd5baa feat: toggle hybrid search 2024-04-25 17:51:38 -05:00
Timothy J. Baek
984dbf13ab revert: original rag pipeline 2024-04-25 17:03:00 -04:00
Steven Kreitzer
1c1d2c254d fix: query collection api call 2024-04-25 13:38:18 -05:00
Steven Kreitzer
72090fab88 chore: update log line 2024-04-25 13:28:31 -05:00
Steven Kreitzer
c9c9660459 fix: address comment in pr #1687 2024-04-25 07:50:42 -05:00
Steven Kreitzer
d5f60b119c
Merge branch 'dev' into buroa/hybrid-search 2024-04-24 20:37:19 -05:00
Timothy J. Baek
7075837849 fix: missing import 2024-04-24 21:24:17 -04:00
Steven Kreitzer
adb009f388
Merge branch 'dev' into buroa/hybrid-search 2024-04-24 14:51:49 -05:00
Steven Kreitzer
c0259aad67 feat: hybrid search and reranking support 2024-04-24 07:55:10 -05:00
Jun Siang Cheah
5245d037ac fix: harden litellm exec command to prevent unintended commands
logic was previously to split on space for arguments, but if any of the user controlled variables LITELLM_PROXY_HOST or DATA_DIR had spaces in them, this would not behave correctly.
2024-04-23 19:25:43 +01:00
Jun Siang Cheah
58bead0398 fix: DATA_DIR was not respected when loading litellm configs 2024-04-23 19:22:41 +01:00
Jun Siang Cheah
9e9306fd2b feat: add LITELLM_PROXY_HOST to configure address litellm listens on 2024-04-23 19:19:16 +01:00
Jun Siang Cheah
0ea9e19d79 feat: add LITELLM_PROXY_PORT to configure internal proxy port 2024-04-23 19:14:01 +01:00
Timothy J. Baek
25d09363df feat: editable openai url for images 2024-04-23 07:14:31 -04:00
Timothy J. Baek
e3d253b040 feat: image env var 2024-04-23 06:53:04 -04:00
Steven Kreitzer
db801aee79
Merge branch 'dev' into buroa/hybrid-search 2024-04-22 18:35:32 -05:00
Steven Kreitzer
4e0b32b505 feat: hybrid search 2024-04-22 18:33:43 -05:00
Timothy Jaeryang Baek
0546ad58be
Merge pull request #1687 from buroa/buroa/huggingface-embeddings
feat: move to native `sentence_transformers`
2024-04-22 13:55:34 -07:00
Steven Kreitzer
f3e5700d49 feat: move to native sentence_transformer 2024-04-22 14:20:41 -05:00
Jun Siang Cheah
e2a8ad5fca address comments, rename to ENABLE_ADMIN_EXPORT 2024-04-22 19:55:46 +01:00
Jun Siang Cheah
190b934ab5 feat: add ALLOW_ADMIN_EXPORT to disable exporting of chats and the db 2024-04-22 19:44:24 +01:00
Timothy J. Baek
4651db8c09 refac: litellm model name validation 2024-04-21 18:25:53 -05:00
Timothy J. Baek
760c62739a refac: improved error handling 2024-04-21 17:37:59 -05:00
Timothy J. Baek
e627b8bf21 feat: litellm model add/delete 2024-04-21 17:26:22 -05:00
Timothy J. Baek
31124d9deb feat: litellm config update 2024-04-21 16:10:01 -05:00
Timothy Jaeryang Baek
56c93bc2ac
Merge branch 'dev' into litellm-as-subprocess 2024-04-21 12:58:19 -07:00
Timothy J. Baek
77426266d2 refac: port number update 2024-04-21 14:32:45 -05:00
dyamagishi
489c45ffdf fix: Update websocket protocol based on the original schema. 2024-04-22 01:19:34 +09:00
Timothy J. Baek
2717fe7c20 fix 2024-04-21 02:00:03 -05:00
Timothy J. Baek
51191168bc feat: restart subprocess route 2024-04-21 01:51:38 -05:00
Timothy J. Baek
a59fb6b9eb fix 2024-04-21 01:47:35 -05:00
Timothy J. Baek
3c382d4c6c refac: close subprocess gracefully 2024-04-21 01:46:09 -05:00
Timothy J. Baek
8651bec915 pwned :) 2024-04-21 01:22:02 -05:00
Timothy J. Baek
a41b195f46 DO NOT TRACK ME >:( 2024-04-21 01:13:24 -05:00
Timothy J. Baek
5e458d490a fix: run litellm as subprocess 2024-04-21 00:52:27 -05:00
Timothy J. Baek
1cf4fa96c1 fix 2024-04-20 21:15:39 -05:00
Timothy J. Baek
fe3291acb5 fix: multiuser duplicate tag issue 2024-04-20 21:12:59 -05:00
Timothy J. Baek
1e919abda3 fix: settings getModels issue 2024-04-20 20:49:16 -05:00
Timothy J. Baek
eefe01454f refac: include archived flag in exports 2024-04-20 19:32:32 -05:00
Timothy J. Baek
74dd9b561a revert: export chats to include archived chats 2024-04-20 19:24:58 -05:00
Timothy J. Baek
4c221eabef refac 2024-04-20 18:29:14 -05:00
Timothy J. Baek
b12edb4a7a refac: replace timestamp field 2024-04-20 18:24:18 -05:00
Timothy J. Baek
fbd520bf07 feat: archive chat 2024-04-20 17:03:39 -05:00
Timothy J. Baek
c468df2f71 feat: env var for audio 2024-04-20 16:04:16 -05:00
Timothy J. Baek
fa9593b4e8 refac: openai error message 2024-04-20 16:01:25 -05:00
Timothy J. Baek
cbd18ec63c feat: external openai tts support 2024-04-20 16:00:24 -05:00
Timothy J. Baek
713934edb6 refac 2024-04-20 15:21:52 -05:00
Timothy J. Baek
710850e442 refac: audio 2024-04-20 15:15:59 -05:00
Timothy J. Baek
741ed5dc4c fix 2024-04-14 19:56:33 -04:00
Timothy J. Baek
b1b72441bb feat: openai embeddings integration 2024-04-14 19:48:15 -04:00
Timothy J. Baek
b48e73fa43 feat: openai embeddings support 2024-04-14 19:15:39 -04:00
Timothy J. Baek
36ce157907 fix: integration 2024-04-14 18:47:45 -04:00
Timothy J. Baek
9cdb5bf9fe feat: frontend integration 2024-04-14 18:31:40 -04:00
Timothy J. Baek
2952e61167 feat: external embeddings support 2024-04-14 17:55:00 -04:00
Timothy Jaeryang Baek
b5d882606a
Merge pull request #1499 from lainedfles/whisper_auto_update
feat: introduce Whisper model auto-update control.
2024-04-14 13:58:17 -07:00
Timothy J. Baek
9091513c39 fix 2024-04-14 16:52:59 -04:00
Timothy J. Baek
0f5ecafc57 fix: api usage issue 2024-04-14 16:51:13 -04:00
Self Denial
067c94810a Fix open-webui/open-webui#1500
Looks like the convention update per commit 0981fae161 missed `config.py`.
2024-04-13 19:55:43 -06:00
Self Denial
faa5884150 Use log.warning instead of log.debug 2024-04-13 03:18:13 -06:00
Self Denial
ff01398812 Format fix 2024-04-10 23:39:11 -06:00
Self Denial
3b8ea55bc8 Add IMAGE_GENERATION_ENABLED env var
With default of `False`.
2024-04-10 23:21:12 -06:00
Self Denial
81c8717d75 Format fix 2024-04-10 20:44:44 -06:00
Self Denial
429242b4d3 Introduce Whisper model auto-update control.
* Introduce WHISPER_MODEL_AUTO_UPDATE env var
* Pass local_files_only to WhisperModel()
* Handle cases where auto-update is disabled but model is non-existent
2024-04-10 20:30:00 -06:00
Timothy Jaeryang Baek
b9cadff16b
Merge pull request #1419 from lainedfles/embedding-model-fix-and-manual-update
feat: improve embedding model update & resolve network dependency
2024-04-10 01:10:07 -07:00
Timothy J. Baek
582d11f191 refac: RAG_EMBEDDING_MODEL_PATH removed 2024-04-10 00:59:05 -07:00
Timothy J. Baek
cb2158a794 fix 2024-04-10 00:51:16 -07:00
Timothy J. Baek
abfcceecef refac 2024-04-10 00:46:09 -07:00
Timothy J. Baek
f4b87ecb23 refac 2024-04-10 00:33:45 -07:00
Steven Kreitzer
0bae789d39
fix: support batching chromadb 2024-04-09 10:13:29 -05:00
lainedfles
506a061387
Merge branch 'dev' into embedding-model-fix-and-manual-update 2024-04-08 14:57:54 -06:00
Jannik S
3b3d0cce1e
Merge branch 'dev' into dockerfile-optimisation 2024-04-08 09:15:00 +02:00
Timothy J. Baek
f64ac3269f fix: share chat permission issue 2024-04-07 01:21:12 -07:00
Timothy Jaeryang Baek
02d3fb427b
Merge pull request #1386 from dannyl1u/feat/profile-image-initials
feat: default profile image with user initials
2024-04-06 23:59:20 -07:00
Timothy J. Baek
f267f3f7b0 refac 2024-04-06 23:16:29 -07:00
Timothy Jaeryang Baek
782cce7c44
Merge pull request #1340 from joequant/main
allow version to work with -rc tag
2024-04-06 18:57:41 -07:00
Timothy J. Baek
395ca82175 refac: '-rc' tag handling 2024-04-06 18:55:51 -07:00
Timothy J. Baek
5a787ab2c5 refac: pdf styling 2024-04-06 02:04:28 -07:00
Timothy J. Baek
81dbc65853 refac: pdf generation 2024-04-06 01:54:59 -07:00
Timothy J. Baek
e61e1b079f fix: file upload issue 2024-04-04 17:38:59 -07:00
Self Denial
9f82f5abba Formatting... 2024-04-04 12:09:48 -06:00
Self Denial
075fbedb02 More format fixes 2024-04-04 12:07:42 -06:00
Self Denial
bcf79c8366 Format fixes 2024-04-04 12:02:48 -06:00
Self Denial
3b66aa55c0 Improve embedding model update & resolve network dependency
* Add config variable RAG_EMBEDDING_MODEL_AUTO_UPDATE to control update behavior
* Add RAG utils embedding_model_get_path() function to output the filesystem path in addition to update of the model using huggingface_hub
* Update and utilize existing RAG functions in main: get_embedding_model() & update_embedding_model()
* Add GUI setting to execute manual update process
2024-04-04 11:01:23 -06:00
Danny Liu
3b06096c52 run npm run lint:backend 2024-04-04 01:10:51 -07:00
Danny Liu
8d1db9a1c0 feat: api endpoint to receive profile_image_uirl on signup 2024-04-03 22:36:27 -07:00
Timothy J. Baek
1f85354856 feat: stylised pdf 2024-04-03 20:35:32 -07:00
Timothy Jaeryang Baek
d94bc21ac8
Merge pull request #1408 from Mmx233/main
fix: manually check the docs' filename
2024-04-03 10:19:10 -07:00
Mmx233
947c392f72
fix: manually check the docs' filename 2024-04-03 23:37:13 +08:00
Jannik S
f669c0e78e
Merge branch 'dev' into dockerfile-optimisation 2024-04-03 11:37:46 +02:00
Timothy J. Baek
da8646cae9 refac 2024-04-02 09:27:35 -07:00
Timothy J. Baek
ba0523cd69 refac: api_key field moved to user 2024-04-02 09:23:55 -07:00
Timothy J. Baek
38c34b4444 fix: import 2024-04-02 09:18:36 -07:00
Timothy J. Baek
b11af9ea0e fix 2024-04-02 09:18:15 -07:00
Timothy Jaeryang Baek
56369fea3a
Merge branch 'dev' into feature/support_auth_by_api_key 2024-04-02 09:12:19 -07:00
Timothy Jaeryang Baek
24fb77759e
Merge pull request #1347 from cheahjs/feat/trusted-email-header
feat: allow authenticating with a trusted email header
2024-04-02 09:11:25 -07:00
Timothy J. Baek
03a7f88dca chore: remove print statement 2024-04-02 08:58:03 -07:00
Timothy J. Baek
f61869d90d fix: cascade shared chat delete 2024-04-02 08:58:03 -07:00
Timothy J. Baek
95505bc4c1 feat: chat cascade delete 2024-04-02 08:58:03 -07:00
Timothy J. Baek
9975cb17a9 feat: update shared chat 2024-04-02 08:58:03 -07:00
Timothy J. Baek
0b823f90e6 feat: delete shared chat link 2024-04-02 08:58:03 -07:00
Timothy J. Baek
c0fff4c69f fix: typo 2024-04-02 08:58:03 -07:00
Timothy J. Baek
180dd3966b refac: share chat routes 2024-04-02 08:58:03 -07:00
Timothy J. Baek
4e9ca31146 Update chats.py 2024-04-02 08:58:03 -07:00
Timothy J. Baek
48e7376336 refac: shared chat user id 2024-04-02 08:58:03 -07:00
Timothy J. Baek
488301f150 Update 001_initial_schema.py 2024-04-02 08:58:03 -07:00
Jun Siang Cheah
e273a99153 feat: migrate db schema for local sharing 2024-04-02 08:58:03 -07:00
Jun Siang Cheah
151055590d feat: add ability to run db migrations 2024-04-02 08:58:03 -07:00
Jun Siang Cheah
94976e5ed3 feat: add backend functions for sharing chats 2024-04-02 08:58:03 -07:00
Jannik Streidl
9bcb37ea10 fixes and updates 2024-04-02 14:47:52 +02:00
Timothy Jaeryang Baek
f340178bb7
Merge pull request #1396 from open-webui/main
dev
2024-04-02 03:39:09 -07:00
Jannik S
099b1d066b
Revert "Merge Updates & Dockerfile improvements" (#3)
This reverts commit 9763d885be.
2024-04-02 11:28:04 +02:00
lainedfles
9763d885be
Merge Updates & Dockerfile improvements 2024-04-02 11:25:20 +02:00
Timothy J. Baek
57530d87f6 feat: /ollama head route 2024-04-02 02:03:13 -07:00
Timothy J. Baek
5558514ff1 fix 2024-04-01 15:23:12 -07:00
Timothy Jaeryang Baek
83c7633acb
Merge pull request from GHSA-9pgh-j74g-qj6m
Suggested mitigation for KL-CAN-2024-002.
2024-04-01 15:21:56 -07:00
Timothy J. Baek
d72653cdea fix: download allowed hosts 2024-04-01 14:01:05 -07:00
KoreLogic Disclosures
6c96361402
Suggested mitigation for KL-CAN-2024-002. 2024-04-01 15:55:14 -05:00
Timothy J. Baek
77b1edcd0f fix: allowed hosts 2024-04-01 13:24:48 -07:00
Jun Siang Cheah
562e40a7bd Merge branch 'dev' into feat/trusted-email-header 2024-03-31 22:08:58 +01:00
Jun Siang Cheah
0e3b7a11e3 chore: python formatting 2024-03-31 22:07:43 +01:00
Timothy J. Baek
a6c154d839 feat: rag context logging 2024-03-31 14:02:31 -07:00
Timothy Jaeryang Baek
a0935dec60
Merge branch 'dev' into feature/support_auth_by_api_key 2024-03-31 13:48:36 -07:00
Timothy Jaeryang Baek
587a8c5992
Merge pull request #1370 from lainedfles/logging-improvements
Improve logging.
2024-03-31 13:46:37 -07:00
Timothy J. Baek
4ddb7e124e fix: error message 2024-03-31 13:40:57 -07:00
Self Denial
144c9059a3 Improve logging. Move print() statements to appropiate log().
Add COMFYUI and WEBHOOK logging and associated environment variable
control. Add WEBHOOK payload & request debug logs.
2024-03-31 13:17:29 -06:00
Timothy J. Baek
5af8d0612a chore: py formatting 2024-03-31 01:13:39 -07:00
Jun Siang Cheah
150152ddbd fix: accidental indent during format changed logic 2024-03-29 21:04:30 +00:00
Timothy J. Baek
12287f8680 chore: code formatting 2024-03-29 13:06:18 -07:00
Joseph C Wang
c9f17ecb3a allow version to work with -rc tag 2024-03-29 01:44:37 +08:00
Jun Siang Cheah
50f6addd6f feat: auto signup/login with WEBUI_AUTH_TRUSTED_EMAIL_HEADER 2024-03-28 10:34:57 +00:00
Jun Siang Cheah
29f13f34d3 feat: add WEBUI_AUTH_TRUSTED_EMAIL_HEADER for authenticating users by a trusted header
This is very yolo code, use at your own risk
2024-03-27 09:28:03 +00:00
liu.vaayne
81e928030f backend support api key 2024-03-26 18:22:17 +08:00
Timothy J. Baek
3688955c77 fix: encoding issue 2024-03-25 23:50:52 -07:00
Timothy J. Baek
6307adfba1 feat: better error handling 2024-03-25 23:47:08 -07:00
Doug Danat
c91a5d8b1f switch to using BeautifulSoup HTML loader so title is also captured 2024-03-25 11:26:18 +01:00
Doug Danat
784a6ec85e include html langchain loader for RAG 2024-03-25 09:50:53 +01:00
Timothy Jaeryang Baek
371dfc1143
Merge branch 'dev' into debug_print 2024-03-24 18:04:03 -05:00
Timothy Jaeryang Baek
a1faa307b1
Merge pull request #1272 from anuraagdjain/feat/cancel-model-download
feat: cancel model download
2024-03-24 18:00:57 -05:00
Timothy J. Baek
ff8a55a861 refac: rag api 2024-03-24 00:41:41 -07:00
Timothy J. Baek
7e0ea8f77d feat: RAG text ingestion(store) api 2024-03-24 00:40:27 -07:00
Timothy J. Baek
98624a406f feat: comfyui integration 2024-03-23 17:01:13 -07:00
Timothy J. Baek
862c96fcef feat: comfyui support 2024-03-23 15:38:59 -07:00
Timothy Jaeryang Baek
3e0d9ad74f
Merge branch 'dev' into feat/cancel-model-download 2024-03-23 15:16:06 -05:00
Timothy J. Baek
e008738f30 feat: cancel download from backend 2024-03-23 13:12:54 -07:00
Timothy J. Baek
5c1e3a460e fix: remove aiofiles dependency 2024-03-22 21:47:53 -07:00
Jannik Streidl
fdef2abdfb cuda fix 2024-03-22 12:48:48 +01:00
Timothy J. Baek
92cc87d908 fix: ollama upload url 2024-03-22 00:58:38 -07:00
Timothy J. Baek
9e37d6edcc refac: gguf upload ui 2024-03-22 00:55:59 -07:00
Timothy J. Baek
77ec296ac3 chore: print removed 2024-03-22 00:11:17 -07:00
Timothy J. Baek
bc80f1438c fix: ollama gguf upload 2024-03-22 00:10:55 -07:00
Timothy J. Baek
af4caec4f5 refac: ollama gguf upload 2024-03-21 23:45:00 -07:00
Self Denial
f74f2ea765 Merge conflicts 2024-03-21 00:14:13 -06:00
Timothy Jaeryang Baek
5a90e90c0b
Merge pull request #1241 from 7a6ac0/duplicate_def
fix: delete duplicate function
2024-03-20 22:01:13 -05:00
Timothy J. Baek
8e52ba8b91 refac: auth required for litellm in dev 2024-03-20 19:33:27 -07:00
Timothy J. Baek
ed0d4b5a2a chore: comment clean up 2024-03-20 19:32:25 -07:00
tabaco.wang
a1412d0b55 fix: delete duplicate function 2024-03-21 10:31:25 +08:00
Timothy J. Baek
93c90dc186 feat: litellm model filter support 2024-03-20 19:28:33 -07:00
Timothy J. Baek
fa65be2ad2 refac: post webhook 2024-03-20 18:47:13 -07:00
Timothy J. Baek
2c6e2d5e8a feat: webhook backend 2024-03-20 18:35:02 -07:00
Self Denial
e6dd0bfbe0 Migrate to python logging module with env var control. 2024-03-20 17:11:36 -06:00
Jannik Streidl
1f6739337b docker improvements & changed universal device type env for different models used 2024-03-20 08:44:09 +01:00
Timothy J. Baek
e86db74333 refac: stream default value 2024-03-18 18:14:05 -07:00
Timothy J. Baek
b188143f01 fix: openai proxy issue 2024-03-18 11:04:22 -07:00
Timothy J. Baek
ec9895a14a fix: openai proxy issue 2024-03-18 11:02:09 -07:00
Timothy J. Baek
1bfcd801b7 fix: multiple openai issue 2024-03-18 01:11:48 -07:00
Timothy J. Baek
1e03871748 fix: openai issue 2024-03-16 03:25:20 -07:00
Timothy J. Baek
ed964260ba fix: openai urls issue 2024-03-16 02:45:24 -07:00
Timothy J. Baek
91efd6cb63 fix: file upload encoding issue 2024-03-15 23:52:37 -07:00
Timothy J. Baek
072b499a50 fix: backslash rag content issue 2024-03-15 13:34:52 -07:00
Timothy Jaeryang Baek
7cef008b44
Merge pull request #1163 from joequant/main
fix typo in uploading blob to ollama
2024-03-14 15:48:49 -05:00
Joseph C Wang
9ee0feae32 fix typo in uploading blob to ollama 2024-03-14 17:17:52 +08:00
Timothy J. Baek
7f78e58488 refac: image generation error handling 2024-03-12 13:35:30 -07:00
Timothy J. Baek
26a187f5ac refac: print removed 2024-03-12 00:26:53 -07:00
Timothy J. Baek
be3ab88c88 fix: error handling 2024-03-12 00:26:14 -07:00
Timothy J. Baek
b4c770d74b fix: disable openai model by default 2024-03-10 19:00:43 -07:00
Timothy J. Baek
8df6b137cb fix: rag 2024-03-10 18:40:50 -07:00
Timothy J. Baek
98948814fd feat: toggle pdf ocr 2024-03-10 13:32:34 -07:00
Timothy J. Baek
a4ca1fc5c4 feat: model filter list env var 2024-03-09 21:47:01 -08:00
Timothy J. Baek
81daf4ceb9 feat: model filter frontend integration 2024-03-09 21:29:04 -08:00
Timothy J. Baek
b550e23bf6 feat: model filter backend 2024-03-09 21:19:20 -08:00
Timothy J. Baek
c49491e516 refac: rag to backend 2024-03-08 22:34:47 -08:00
Timothy J. Baek
6ba62cf25d fix: dalle3 issue 2024-03-08 19:54:47 -08:00
Timothy J. Baek
7e5e2c42c9 refac: rag routes 2024-03-08 19:26:39 -08:00
Timothy J. Baek
0221acd163 feat: dall-e integration 2024-03-08 17:38:10 -08:00
Timothy J. Baek
2b84af878a refac: litellm 2024-03-08 13:33:56 -08:00
Timothy J. Baek
df49e4e1cc fix: default openai api value 2024-03-06 20:25:24 -08:00
Timothy J. Baek
53adc6a0ca fix: rag issue 2024-03-06 18:37:40 -08:00
Timothy J. Baek
b88c64f80e fix: ocr issue 2024-03-06 17:54:42 -08:00
Timothy Jaeryang Baek
dc6e91a23d
Merge pull request #1074 from open-webui/main
dev
2024-03-06 20:07:37 -05:00
Timothy J. Baek
bb98c10abb revert: ocr feature 2024-03-06 17:04:40 -08:00
Timothy J. Baek
c255cba198 feat: multiple openai apis 2024-03-06 16:13:25 -08:00
Timothy J. Baek
f741adc6c9 refac: OLLAMA_API_BASE_URL deprecated 2024-03-06 11:44:00 -08:00
Timothy Jaeryang Baek
8fb5f54751
Merge pull request #1050 from jannikstdl/rag-pdf-ocr
feat: added ocr functionality to the pdf loader
2024-03-06 00:45:33 -05:00
Jannik Streidl
089a63e0c6 feat: added ocr functionality to the pdf loader 2024-03-05 22:25:25 +01:00
Timothy J. Baek
124020f824 chore: added print url for debugging 2024-03-05 02:19:25 -08:00
Timothy J. Baek
fbdac832bb feat: multiple ollama model management 2024-03-05 02:12:55 -08:00
Timothy J. Baek
8626ae60dd chore: old_main removed 2024-03-05 01:43:33 -08:00
Timothy J. Baek
8d34324d12 feat: cancel request
Resolves #1006
2024-03-05 01:41:22 -08:00
Timothy J. Baek
b2dd2f191d refac: comment 2024-03-05 01:21:50 -08:00
Timothy J. Baek
8fd7bc342d refac: error message 2024-03-05 01:07:59 -08:00
Timothy J. Baek
f04d60b6d9 feat: multiple ollama support 2024-03-05 00:59:35 -08:00
Firat Birlik
6782e95c75 recreate rag collection is now optional and only used for web requests 2024-03-04 10:00:06 -06:00
Firat Birlik
5d4ff85228 recreate rag collection instead of falling back to stale version 2024-03-03 21:25:00 -06:00
Timothy J. Baek
47a05a47b4 feat: add rag top k value setting 2024-03-02 18:56:57 -08:00
Timothy J. Baek
901e7a33fa feat: chat playground backend integration 2024-03-02 18:16:02 -08:00
Timothy J. Baek
2379e94cbf feat: text completion playground 2024-03-02 03:01:44 -08:00
Timothy J. Baek
edb63c2280 feat: download db from admin settings 2024-03-02 00:33:20 -08:00
Timothy J. Baek
6d854125cc refac: ollama.db renamed to webui.db 2024-03-02 00:19:24 -08:00
Timothy J. Baek
74809e7330 fix: user chat delete loophole 2024-03-02 00:07:50 -08:00
Timothy J. Baek
59ae5b6d34 fix: openai filtering 2024-02-27 20:08:57 -08:00
Timothy J. Baek
781be2779b refac: unnecessary max_token value removed 2024-02-27 20:02:23 -08:00
Sakkus
bbeaa92904 Fix OpenAI integration:
from docker on mac get errors since num_ctx not recognized;
remove num_ctx from, and max_tokens to, body in API calls.
2024-02-26 12:25:08 +00:00
Timothy J. Baek
1d937ec2f2 fix: cleanup unused tags 2024-02-25 13:03:26 -08:00
Timothy Jaeryang Baek
271e5bf44d
Merge branch 'dev' into feature/img-gen-steps-setting 2024-02-24 21:09:06 -05:00
Timothy J. Baek
393531c9b0 fix 2024-02-24 18:08:35 -08:00
Timothy J. Baek
ec6f53e298 feat: litellm proxy frontend integration 2024-02-24 17:56:53 -08:00
Timothy J. Baek
e15e015db1 fix: images 2024-02-24 15:48:14 -08:00
Justin Firth
3fa79e59bf Allow configuration of steps, default to a1111 default 2024-02-24 10:44:08 -05:00
Ased Mammad
b473ad574f fix: RAG scan unsupported mimetype
This fixes an issue with RAG that stops loading documents as soon
as it reaches a file with unsupported mimetype.
2024-02-23 14:27:31 +03:30
Timothy J. Baek
7ec4c07bf9 feat: image size param 2024-02-22 19:32:36 -08:00
Timothy J. Baek
dc705c4984 refac: settings 2024-02-21 19:06:27 -08:00
Timothy J. Baek
797ed9ac7f feat: allow enabling after url is provided 2024-02-21 18:57:53 -08:00
Timothy J. Baek
cc50cc10e6 feat: sd frontend integration 2024-02-21 18:36:40 -08:00
Timothy J. Baek
733e963c44 feat: sd backend integration 2024-02-21 18:12:01 -08:00
Timothy J. Baek
7a730c3f0f refac: versioning using package 2024-02-21 17:10:27 -08:00
Timothy J. Baek
275523e32e feat: jwt utils 2024-02-19 20:44:00 -08:00
Timothy J. Baek
7c127c35fc feat: dynamic embedding model load 2024-02-19 11:05:45 -08:00
Jannik Streidl
acf999013b storing vectordb in project cache folder + device types 2024-02-19 07:51:17 +01:00
Timothy J. Baek
0cb0358485 refac: more descriptive var names 2024-02-18 11:16:10 -08:00
Jannik S
4b88e7e44f
Merge branch 'main' into choose-embedding-model 2024-02-18 09:20:54 +01:00
Jannik Streidl
bc3dd34d8b collection query fix 2024-02-18 09:17:43 +01:00
Timothy J. Baek
07b451995e feat: reset rag template 2024-02-17 22:49:18 -08:00
Timothy J. Baek
5270efa9e5 feat: editable rag template 2024-02-17 22:41:03 -08:00
Timothy J. Baek
ccf08fb91e feat: editable chunk params 2024-02-17 22:29:52 -08:00
Timothy J. Baek
a94e4161f7 fix: file content type issue 2024-02-17 21:31:46 -08:00
Timothy J. Baek
e07001e5f6 feat: rag folder scan support 2024-02-17 21:06:08 -08:00
Jannik Streidl
1846c1e80d choose embedding model when using docker 2024-02-17 19:38:29 +01:00
Timothy J. Baek
90bcd1644a rename to open-webui 2024-02-16 23:30:38 -08:00
Timothy Jaeryang Baek
1def55cf09
Merge pull request #725 from jnkstr/no-internet-whisper
fix: no internet connection for whisper if you use docker
2024-02-15 02:44:31 -05:00
Timothy J. Baek
63e6f39b31 refac 2024-02-14 23:32:54 -08:00
Timothy J. Baek
434e2c00e9 fix: user display limit 2024-02-14 13:24:40 -08:00
Timothy J. Baek
511e939b5d feat: admin settings 2024-02-14 01:17:43 -08:00
Jannik Streidl
8ab0338e71 no internet connection for whisper if you use docker 2024-02-13 15:11:53 +01:00
Timothy J. Baek
2ef4fc1215 fix: strip transcription text 2024-02-11 02:17:24 -08:00
Timothy J. Baek
a5b9bbf10b feat: whisper support 2024-02-11 00:17:50 -08:00
Timothy J. Baek
3af8d16e6a fix: admin issue 2024-02-10 17:54:33 -08:00
Timothy Jaeryang Baek
9f3346a6ec
Merge pull request #682 from explorigin/simplify-endpoint-code
Simplify endpoint role checking
2024-02-09 14:26:56 -08:00
Tim Farrell
08e8e922fd Endpoint role-checking was redundantly applied but FastAPI provides a nice abstraction mechanic...so I applied it. There should be no logical changes in this code; only simpler, cleaner ways for doing the same thing. 2024-02-08 18:05:01 -06:00
Kyle McLaren
d4fec48d9c
get ENABLE_SIGNUP from env 2024-02-06 20:58:07 +02:00
Timothy J. Baek
519e27978f refac 2024-02-05 22:58:02 -08:00
Timothy J. Baek
1b040143eb feat: cache request body 2024-02-05 22:57:24 -08:00
Timothy J. Baek
0b8df52c97 feat: openai tts support 2024-02-05 22:51:08 -08:00
Timothy J. Baek
7c2f297c84 feat: export all chats from db
admin only
2024-02-04 01:07:18 -08:00
Timothy Jaeryang Baek
323ec3787e
Merge pull request #624 from explorigin/session-security
Improve Session Security
2024-02-03 17:41:31 -08:00
Timothy J. Baek
683650ec00 feat: collection rag integration 2024-02-03 15:57:06 -08:00
Timothy J. Baek
00803c92f2 feat: doc tagging 2024-02-03 14:44:49 -08:00
Tim Farrell
44799e2018 Remove some extraneous imports 2024-02-02 09:02:07 -06:00
Tim Farrell
8c37edd027 Even though "User.email" is enforced as unique at signup, it is not a unique field in the database. Let's use "User.id" instead. This also makes it more difficult to do a session stealing attack. 2024-02-02 09:01:06 -06:00
Timothy J. Baek
50f7b20ac2 refac 2024-02-01 13:35:41 -08:00
Timothy J. Baek
28226a6f97 feat: web rag support 2024-01-26 22:17:28 -08:00
Timothy J. Baek
0c322063b5 feat: use local profile image by default 2024-01-26 21:38:33 -08:00
Timothy J. Baek
3ce8f3e8fb feat: profile update frontend integration 2024-01-26 21:22:25 -08:00
Timothy J. Baek
418da74756 feat: profile image update backend 2024-01-26 20:27:45 -08:00
Timothy Jaeryang Baek
a243e53bfe
Merge pull request #536 from lucasew/backend-data-dir
Unhardcode some stuff, flexibilize dotenv requirement
2024-01-25 00:42:12 -08:00
Timothy J. Baek
4e468dc58c refac 2024-01-25 00:24:49 -08:00
Timothy Jaeryang Baek
fa5918ad13
Merge branch 'main' into main 2024-01-25 00:13:12 -08:00
Marclass
8bfda730d9 add excel document support 2024-01-23 14:03:22 -07:00
lucasew
8da06f5e74 fixes after the refactor
Signed-off-by: lucasew <lucas59356@gmail.com>
2024-01-23 12:59:52 -03:00
Timothy Jaeryang Baek
ca943d0795
Merge pull request #549 from Marclass/main
Bugfix: Fix toast error popup when front end can't figure out file type.
2024-01-22 23:13:53 -08:00
Timothy Jaeryang Baek
7054f02891
Merge pull request #466 from baumandm/feat/epub-support
feat: Add epub support
2024-01-22 23:12:46 -08:00
Marclass
7eea3ef313 copy list of file ext from backend to front end 2024-01-23 00:00:07 -07:00
Timothy Jaeryang Baek
d517a3ebb4
Merge pull request #547 from Marclass/main
feat: Add reStructuredText specific parser for RAG
2024-01-22 22:19:41 -08:00
Timothy J. Baek
c4a039326f feat: editable prompt suggestions integration 2024-01-22 21:53:13 -08:00
Timothy J. Baek
4e1b52e91b feat: custom interface support 2024-01-22 21:07:40 -08:00
Marclass
2e4373c63e
Merge branch 'ollama-webui:main' into main 2024-01-22 21:01:33 -07:00
Timothy J. Baek
d67c632920 fix: openai 2024-01-22 09:45:56 -08:00
Timothy J. Baek
d2c5f3d591 refac: convert str var to f-string 2024-01-22 01:47:07 -08:00
Timothy Jaeryang Baek
1abe5a5487
Merge pull request #537 from CreatorGhost/fix-gpt-4-vision
Add max_tokens workaround for gpt-4-vision-preview model
2024-01-22 01:41:57 -08:00
Timothy J. Baek
83181b7968 fix: add max_token only when field not present 2024-01-22 01:41:00 -08:00
Timothy J. Baek
b26e0fb7e7 refac 2024-01-22 01:37:54 -08:00
Shiyinq
6a63c94153 feat: add guard clause to improve signup process 2024-01-20 21:54:53 +07:00
Aditya Pratap Singh
60afd6ecdd Add workaround for gpt-4-vision-preview model that support 4k tokens 2024-01-20 04:34:47 +05:30
Aditya Pratap Singh
8662437a9f Add workaround for gpt-4-vision-preview model 2024-01-20 04:17:06 +05:30
lucasew
5b26d2a686 backend: make the data directory and the artifacts from the frontend customizable using environment variables
Signed-off-by: lucasew <lucas59356@gmail.com>
2024-01-19 17:13:09 -03:00
Marclass
35ace57784 add rst document for RAG 2024-01-19 10:48:04 -07:00
Dave Bauman
f559068186
feat: Add epub support 2024-01-19 12:23:59 -05:00
Timothy Jaeryang Baek
f079cb6b56
Merge pull request #524 from Marclass/rag-arbitrary-files
feat: Allow RAG on XML and arbitrary text files including source code
2024-01-19 00:09:04 -08:00