Yanyutin753
c0bb32d768
📌 fixed a bug where RAG would not reply after not reading the file correctly
2024-04-30 13:51:30 +08:00
Timothy Jaeryang Baek
1afc49c1e4
Merge pull request #1862 from cheahjs/feat/filter-local-rag-fetch
...
feat: add ENABLE_LOCAL_WEB_FETCH to protect against SSRF attacks
2024-04-29 15:51:17 -07:00
Jun Siang Cheah
1c4e63f71e
feat: add ENABLE_LOCAL_WEB_FETCH to protect against SSRF attacks
2024-04-29 20:55:17 +01:00
Steven Kreitzer
5b8fd14470
fix: various api rag results
2024-04-29 12:17:36 -05:00
Timothy J. Baek
9832e6edba
enhancement: OpenAI API
...
api.together.xyz, api.replicate.com
2024-04-28 10:20:40 -07:00
Yanyutin753
3321a1b922
✨ expend the image format type after the file is downloaded
2024-04-28 12:00:52 +08:00
Timothy J. Baek
71a75bccf5
fix
2024-04-27 20:06:07 -07:00
Timothy J. Baek
48ed701960
fix
2024-04-27 19:44:36 -07:00
Timothy J. Baek
5e97c9927b
fix
2024-04-27 19:42:19 -07:00
Timothy J. Baek
8aa47ea6bc
fix
2024-04-27 21:17:19 -04:00
Timothy Jaeryang Baek
386fc040b1
Merge pull request #1802 from Yanyutin753/tem-dev
...
✨ feat added environment variables and sync.yml
2024-04-27 16:39:45 -07:00
Timothy J. Baek
9094536d37
feat: user last active
2024-04-27 19:38:51 -04:00
Yanyutin753
849a0b973d
recompose the name of environment variables
2024-04-28 07:21:01 +08:00
Timothy J. Baek
01c4647dfc
fix: ollama version string issue
...
#1800
2024-04-27 19:19:47 -04:00
Yanyutin753
b0245a7eff
✨ feat added environment variables and sync.yml
2024-04-28 06:54:26 +08:00
Timothy J. Baek
bcf78b4efa
feat: show user chats in admin panel
2024-04-27 18:24:59 -04:00
Timothy J. Baek
098ac18762
refac: naming
2024-04-27 18:15:32 -04:00
Timothy J. Baek
4ea2eb7939
refac
2024-04-27 18:14:15 -04:00
Timothy J. Baek
10f27ebacf
refac: naming
2024-04-27 18:12:57 -04:00
Timothy Jaeryang Baek
c1d85f8a6f
Merge pull request #1791 from cheahjs/feat/external-db-support
...
feat: add support for using postgres for the backend DB
2024-04-27 12:48:56 -07:00
Timothy J. Baek
ce9a5d12e0
refac: rag pipeline
2024-04-27 15:38:50 -04:00
Timothy J. Baek
8f1563a7a5
fix: typo
2024-04-27 15:03:49 -04:00
Timothy J. Baek
9be56d68e0
refac: naming convention
2024-04-27 15:02:57 -04:00
Jun Siang Cheah
47a33acfeb
feat: show error toast if trying to download db on external db
2024-04-27 15:53:31 +01:00
Jun Siang Cheah
e91a49c455
feat: add support for using postgres for the backend DB
2024-04-27 15:33:20 +01:00
Timothy J. Baek
dbf7b15539
refac: naming convention
...
MODEL_FILTER_ENABLED -> ENABLE_MODEL_FILTER
2024-04-26 17:17:18 -04:00
Timothy J. Baek
cebf733b9d
refac: naming convention
2024-04-26 14:41:39 -04:00
Steven Kreitzer
69822e4c25
fix: sort ranking hybrid
2024-04-26 07:56:41 -05:00
Steven Kreitzer
9755cd5baa
feat: toggle hybrid search
2024-04-25 17:51:38 -05:00
Timothy J. Baek
984dbf13ab
revert: original rag pipeline
2024-04-25 17:03:00 -04:00
Steven Kreitzer
1c1d2c254d
fix: query collection api call
2024-04-25 13:38:18 -05:00
Steven Kreitzer
72090fab88
chore: update log line
2024-04-25 13:28:31 -05:00
Steven Kreitzer
c9c9660459
fix: address comment in pr #1687
2024-04-25 07:50:42 -05:00
Steven Kreitzer
d5f60b119c
Merge branch 'dev' into buroa/hybrid-search
2024-04-24 20:37:19 -05:00
Timothy J. Baek
7075837849
fix: missing import
2024-04-24 21:24:17 -04:00
Steven Kreitzer
adb009f388
Merge branch 'dev' into buroa/hybrid-search
2024-04-24 14:51:49 -05:00
Steven Kreitzer
c0259aad67
feat: hybrid search and reranking support
2024-04-24 07:55:10 -05:00
Jun Siang Cheah
5245d037ac
fix: harden litellm exec command to prevent unintended commands
...
logic was previously to split on space for arguments, but if any of the user controlled variables LITELLM_PROXY_HOST or DATA_DIR had spaces in them, this would not behave correctly.
2024-04-23 19:25:43 +01:00
Jun Siang Cheah
58bead0398
fix: DATA_DIR was not respected when loading litellm configs
2024-04-23 19:22:41 +01:00
Jun Siang Cheah
9e9306fd2b
feat: add LITELLM_PROXY_HOST to configure address litellm listens on
2024-04-23 19:19:16 +01:00
Jun Siang Cheah
0ea9e19d79
feat: add LITELLM_PROXY_PORT to configure internal proxy port
2024-04-23 19:14:01 +01:00
Timothy J. Baek
25d09363df
feat: editable openai url for images
2024-04-23 07:14:31 -04:00
Timothy J. Baek
e3d253b040
feat: image env var
2024-04-23 06:53:04 -04:00
Steven Kreitzer
db801aee79
Merge branch 'dev' into buroa/hybrid-search
2024-04-22 18:35:32 -05:00
Steven Kreitzer
4e0b32b505
feat: hybrid search
2024-04-22 18:33:43 -05:00
Timothy Jaeryang Baek
0546ad58be
Merge pull request #1687 from buroa/buroa/huggingface-embeddings
...
feat: move to native `sentence_transformers`
2024-04-22 13:55:34 -07:00
Steven Kreitzer
f3e5700d49
feat: move to native sentence_transformer
2024-04-22 14:20:41 -05:00
Jun Siang Cheah
e2a8ad5fca
address comments, rename to ENABLE_ADMIN_EXPORT
2024-04-22 19:55:46 +01:00
Jun Siang Cheah
190b934ab5
feat: add ALLOW_ADMIN_EXPORT to disable exporting of chats and the db
2024-04-22 19:44:24 +01:00
Timothy J. Baek
4651db8c09
refac: litellm model name validation
2024-04-21 18:25:53 -05:00
Timothy J. Baek
760c62739a
refac: improved error handling
2024-04-21 17:37:59 -05:00
Timothy J. Baek
e627b8bf21
feat: litellm model add/delete
2024-04-21 17:26:22 -05:00
Timothy J. Baek
31124d9deb
feat: litellm config update
2024-04-21 16:10:01 -05:00
Timothy Jaeryang Baek
56c93bc2ac
Merge branch 'dev' into litellm-as-subprocess
2024-04-21 12:58:19 -07:00
Timothy J. Baek
77426266d2
refac: port number update
2024-04-21 14:32:45 -05:00
dyamagishi
489c45ffdf
fix: Update websocket protocol based on the original schema.
2024-04-22 01:19:34 +09:00
Timothy J. Baek
2717fe7c20
fix
2024-04-21 02:00:03 -05:00
Timothy J. Baek
51191168bc
feat: restart subprocess route
2024-04-21 01:51:38 -05:00
Timothy J. Baek
a59fb6b9eb
fix
2024-04-21 01:47:35 -05:00
Timothy J. Baek
3c382d4c6c
refac: close subprocess gracefully
2024-04-21 01:46:09 -05:00
Timothy J. Baek
8651bec915
pwned :)
2024-04-21 01:22:02 -05:00
Timothy J. Baek
a41b195f46
DO NOT TRACK ME >:(
2024-04-21 01:13:24 -05:00
Timothy J. Baek
5e458d490a
fix: run litellm as subprocess
2024-04-21 00:52:27 -05:00
Timothy J. Baek
1cf4fa96c1
fix
2024-04-20 21:15:39 -05:00
Timothy J. Baek
fe3291acb5
fix: multiuser duplicate tag issue
2024-04-20 21:12:59 -05:00
Timothy J. Baek
1e919abda3
fix: settings getModels issue
2024-04-20 20:49:16 -05:00
Timothy J. Baek
eefe01454f
refac: include archived flag in exports
2024-04-20 19:32:32 -05:00
Timothy J. Baek
74dd9b561a
revert: export chats to include archived chats
2024-04-20 19:24:58 -05:00
Timothy J. Baek
4c221eabef
refac
2024-04-20 18:29:14 -05:00
Timothy J. Baek
b12edb4a7a
refac: replace timestamp field
2024-04-20 18:24:18 -05:00
Timothy J. Baek
fbd520bf07
feat: archive chat
2024-04-20 17:03:39 -05:00
Timothy J. Baek
c468df2f71
feat: env var for audio
2024-04-20 16:04:16 -05:00
Timothy J. Baek
fa9593b4e8
refac: openai error message
2024-04-20 16:01:25 -05:00
Timothy J. Baek
cbd18ec63c
feat: external openai tts support
2024-04-20 16:00:24 -05:00
Timothy J. Baek
713934edb6
refac
2024-04-20 15:21:52 -05:00
Timothy J. Baek
710850e442
refac: audio
2024-04-20 15:15:59 -05:00
Timothy J. Baek
741ed5dc4c
fix
2024-04-14 19:56:33 -04:00
Timothy J. Baek
b1b72441bb
feat: openai embeddings integration
2024-04-14 19:48:15 -04:00
Timothy J. Baek
b48e73fa43
feat: openai embeddings support
2024-04-14 19:15:39 -04:00
Timothy J. Baek
36ce157907
fix: integration
2024-04-14 18:47:45 -04:00
Timothy J. Baek
9cdb5bf9fe
feat: frontend integration
2024-04-14 18:31:40 -04:00
Timothy J. Baek
2952e61167
feat: external embeddings support
2024-04-14 17:55:00 -04:00
Timothy Jaeryang Baek
b5d882606a
Merge pull request #1499 from lainedfles/whisper_auto_update
...
feat: introduce Whisper model auto-update control.
2024-04-14 13:58:17 -07:00
Timothy J. Baek
9091513c39
fix
2024-04-14 16:52:59 -04:00
Timothy J. Baek
0f5ecafc57
fix: api usage issue
2024-04-14 16:51:13 -04:00
Self Denial
067c94810a
Fix open-webui/open-webui#1500
...
Looks like the convention update per commit 0981fae161
missed `config.py`.
2024-04-13 19:55:43 -06:00
Self Denial
faa5884150
Use log.warning instead of log.debug
2024-04-13 03:18:13 -06:00
Self Denial
ff01398812
Format fix
2024-04-10 23:39:11 -06:00
Self Denial
3b8ea55bc8
Add IMAGE_GENERATION_ENABLED env var
...
With default of `False`.
2024-04-10 23:21:12 -06:00
Self Denial
81c8717d75
Format fix
2024-04-10 20:44:44 -06:00
Self Denial
429242b4d3
Introduce Whisper model auto-update control.
...
* Introduce WHISPER_MODEL_AUTO_UPDATE env var
* Pass local_files_only to WhisperModel()
* Handle cases where auto-update is disabled but model is non-existent
2024-04-10 20:30:00 -06:00
Timothy Jaeryang Baek
b9cadff16b
Merge pull request #1419 from lainedfles/embedding-model-fix-and-manual-update
...
feat: improve embedding model update & resolve network dependency
2024-04-10 01:10:07 -07:00
Timothy J. Baek
582d11f191
refac: RAG_EMBEDDING_MODEL_PATH removed
2024-04-10 00:59:05 -07:00
Timothy J. Baek
cb2158a794
fix
2024-04-10 00:51:16 -07:00
Timothy J. Baek
abfcceecef
refac
2024-04-10 00:46:09 -07:00
Timothy J. Baek
f4b87ecb23
refac
2024-04-10 00:33:45 -07:00
Steven Kreitzer
0bae789d39
fix: support batching chromadb
2024-04-09 10:13:29 -05:00
lainedfles
506a061387
Merge branch 'dev' into embedding-model-fix-and-manual-update
2024-04-08 14:57:54 -06:00
Jannik S
3b3d0cce1e
Merge branch 'dev' into dockerfile-optimisation
2024-04-08 09:15:00 +02:00
Timothy J. Baek
f64ac3269f
fix: share chat permission issue
2024-04-07 01:21:12 -07:00
Timothy Jaeryang Baek
02d3fb427b
Merge pull request #1386 from dannyl1u/feat/profile-image-initials
...
feat: default profile image with user initials
2024-04-06 23:59:20 -07:00
Timothy J. Baek
f267f3f7b0
refac
2024-04-06 23:16:29 -07:00
Timothy Jaeryang Baek
782cce7c44
Merge pull request #1340 from joequant/main
...
allow version to work with -rc tag
2024-04-06 18:57:41 -07:00
Timothy J. Baek
395ca82175
refac: '-rc' tag handling
2024-04-06 18:55:51 -07:00
Timothy J. Baek
5a787ab2c5
refac: pdf styling
2024-04-06 02:04:28 -07:00
Timothy J. Baek
81dbc65853
refac: pdf generation
2024-04-06 01:54:59 -07:00
Timothy J. Baek
e61e1b079f
fix: file upload issue
2024-04-04 17:38:59 -07:00
Self Denial
9f82f5abba
Formatting...
2024-04-04 12:09:48 -06:00
Self Denial
075fbedb02
More format fixes
2024-04-04 12:07:42 -06:00
Self Denial
bcf79c8366
Format fixes
2024-04-04 12:02:48 -06:00
Self Denial
3b66aa55c0
Improve embedding model update & resolve network dependency
...
* Add config variable RAG_EMBEDDING_MODEL_AUTO_UPDATE to control update behavior
* Add RAG utils embedding_model_get_path() function to output the filesystem path in addition to update of the model using huggingface_hub
* Update and utilize existing RAG functions in main: get_embedding_model() & update_embedding_model()
* Add GUI setting to execute manual update process
2024-04-04 11:01:23 -06:00
Danny Liu
3b06096c52
run npm run lint:backend
2024-04-04 01:10:51 -07:00
Danny Liu
8d1db9a1c0
feat: api endpoint to receive profile_image_uirl on signup
2024-04-03 22:36:27 -07:00
Timothy J. Baek
1f85354856
feat: stylised pdf
2024-04-03 20:35:32 -07:00
Timothy Jaeryang Baek
d94bc21ac8
Merge pull request #1408 from Mmx233/main
...
fix: manually check the docs' filename
2024-04-03 10:19:10 -07:00
Mmx233
947c392f72
fix: manually check the docs' filename
2024-04-03 23:37:13 +08:00
Jannik S
f669c0e78e
Merge branch 'dev' into dockerfile-optimisation
2024-04-03 11:37:46 +02:00
Timothy J. Baek
da8646cae9
refac
2024-04-02 09:27:35 -07:00
Timothy J. Baek
ba0523cd69
refac: api_key field moved to user
2024-04-02 09:23:55 -07:00
Timothy J. Baek
38c34b4444
fix: import
2024-04-02 09:18:36 -07:00
Timothy J. Baek
b11af9ea0e
fix
2024-04-02 09:18:15 -07:00
Timothy Jaeryang Baek
56369fea3a
Merge branch 'dev' into feature/support_auth_by_api_key
2024-04-02 09:12:19 -07:00
Timothy Jaeryang Baek
24fb77759e
Merge pull request #1347 from cheahjs/feat/trusted-email-header
...
feat: allow authenticating with a trusted email header
2024-04-02 09:11:25 -07:00
Timothy J. Baek
03a7f88dca
chore: remove print statement
2024-04-02 08:58:03 -07:00
Timothy J. Baek
f61869d90d
fix: cascade shared chat delete
2024-04-02 08:58:03 -07:00
Timothy J. Baek
95505bc4c1
feat: chat cascade delete
2024-04-02 08:58:03 -07:00
Timothy J. Baek
9975cb17a9
feat: update shared chat
2024-04-02 08:58:03 -07:00
Timothy J. Baek
0b823f90e6
feat: delete shared chat link
2024-04-02 08:58:03 -07:00
Timothy J. Baek
c0fff4c69f
fix: typo
2024-04-02 08:58:03 -07:00
Timothy J. Baek
180dd3966b
refac: share chat routes
2024-04-02 08:58:03 -07:00
Timothy J. Baek
4e9ca31146
Update chats.py
2024-04-02 08:58:03 -07:00
Timothy J. Baek
48e7376336
refac: shared chat user id
2024-04-02 08:58:03 -07:00
Timothy J. Baek
488301f150
Update 001_initial_schema.py
2024-04-02 08:58:03 -07:00
Jun Siang Cheah
e273a99153
feat: migrate db schema for local sharing
2024-04-02 08:58:03 -07:00
Jun Siang Cheah
151055590d
feat: add ability to run db migrations
2024-04-02 08:58:03 -07:00
Jun Siang Cheah
94976e5ed3
feat: add backend functions for sharing chats
2024-04-02 08:58:03 -07:00
Jannik Streidl
9bcb37ea10
fixes and updates
2024-04-02 14:47:52 +02:00
Timothy Jaeryang Baek
f340178bb7
Merge pull request #1396 from open-webui/main
...
dev
2024-04-02 03:39:09 -07:00
Jannik S
099b1d066b
Revert "Merge Updates & Dockerfile improvements" ( #3 )
...
This reverts commit 9763d885be
.
2024-04-02 11:28:04 +02:00
lainedfles
9763d885be
Merge Updates & Dockerfile improvements
2024-04-02 11:25:20 +02:00
Timothy J. Baek
57530d87f6
feat: /ollama head route
2024-04-02 02:03:13 -07:00
Timothy J. Baek
5558514ff1
fix
2024-04-01 15:23:12 -07:00
Timothy Jaeryang Baek
83c7633acb
Merge pull request from GHSA-9pgh-j74g-qj6m
...
Suggested mitigation for KL-CAN-2024-002.
2024-04-01 15:21:56 -07:00
Timothy J. Baek
d72653cdea
fix: download allowed hosts
2024-04-01 14:01:05 -07:00
KoreLogic Disclosures
6c96361402
Suggested mitigation for KL-CAN-2024-002.
2024-04-01 15:55:14 -05:00
Timothy J. Baek
77b1edcd0f
fix: allowed hosts
2024-04-01 13:24:48 -07:00
Jun Siang Cheah
562e40a7bd
Merge branch 'dev' into feat/trusted-email-header
2024-03-31 22:08:58 +01:00
Jun Siang Cheah
0e3b7a11e3
chore: python formatting
2024-03-31 22:07:43 +01:00
Timothy J. Baek
a6c154d839
feat: rag context logging
2024-03-31 14:02:31 -07:00
Timothy Jaeryang Baek
a0935dec60
Merge branch 'dev' into feature/support_auth_by_api_key
2024-03-31 13:48:36 -07:00
Timothy Jaeryang Baek
587a8c5992
Merge pull request #1370 from lainedfles/logging-improvements
...
Improve logging.
2024-03-31 13:46:37 -07:00
Timothy J. Baek
4ddb7e124e
fix: error message
2024-03-31 13:40:57 -07:00
Self Denial
144c9059a3
Improve logging. Move print()
statements to appropiate log()
.
...
Add COMFYUI and WEBHOOK logging and associated environment variable
control. Add WEBHOOK payload & request debug logs.
2024-03-31 13:17:29 -06:00
Timothy J. Baek
5af8d0612a
chore: py formatting
2024-03-31 01:13:39 -07:00
Jun Siang Cheah
150152ddbd
fix: accidental indent during format changed logic
2024-03-29 21:04:30 +00:00
Timothy J. Baek
12287f8680
chore: code formatting
2024-03-29 13:06:18 -07:00
Joseph C Wang
c9f17ecb3a
allow version to work with -rc tag
2024-03-29 01:44:37 +08:00
Jun Siang Cheah
50f6addd6f
feat: auto signup/login with WEBUI_AUTH_TRUSTED_EMAIL_HEADER
2024-03-28 10:34:57 +00:00
Jun Siang Cheah
29f13f34d3
feat: add WEBUI_AUTH_TRUSTED_EMAIL_HEADER for authenticating users by a trusted header
...
This is very yolo code, use at your own risk
2024-03-27 09:28:03 +00:00
liu.vaayne
81e928030f
backend support api key
2024-03-26 18:22:17 +08:00
Timothy J. Baek
3688955c77
fix: encoding issue
2024-03-25 23:50:52 -07:00
Timothy J. Baek
6307adfba1
feat: better error handling
2024-03-25 23:47:08 -07:00
Doug Danat
c91a5d8b1f
switch to using BeautifulSoup HTML loader so title is also captured
2024-03-25 11:26:18 +01:00
Doug Danat
784a6ec85e
include html langchain loader for RAG
2024-03-25 09:50:53 +01:00
Timothy Jaeryang Baek
371dfc1143
Merge branch 'dev' into debug_print
2024-03-24 18:04:03 -05:00
Timothy Jaeryang Baek
a1faa307b1
Merge pull request #1272 from anuraagdjain/feat/cancel-model-download
...
feat: cancel model download
2024-03-24 18:00:57 -05:00
Timothy J. Baek
ff8a55a861
refac: rag api
2024-03-24 00:41:41 -07:00
Timothy J. Baek
7e0ea8f77d
feat: RAG text ingestion(store) api
2024-03-24 00:40:27 -07:00
Timothy J. Baek
98624a406f
feat: comfyui integration
2024-03-23 17:01:13 -07:00
Timothy J. Baek
862c96fcef
feat: comfyui support
2024-03-23 15:38:59 -07:00
Timothy Jaeryang Baek
3e0d9ad74f
Merge branch 'dev' into feat/cancel-model-download
2024-03-23 15:16:06 -05:00
Timothy J. Baek
e008738f30
feat: cancel download from backend
2024-03-23 13:12:54 -07:00
Timothy J. Baek
5c1e3a460e
fix: remove aiofiles dependency
2024-03-22 21:47:53 -07:00
Jannik Streidl
fdef2abdfb
cuda fix
2024-03-22 12:48:48 +01:00
Timothy J. Baek
92cc87d908
fix: ollama upload url
2024-03-22 00:58:38 -07:00
Timothy J. Baek
9e37d6edcc
refac: gguf upload ui
2024-03-22 00:55:59 -07:00
Timothy J. Baek
77ec296ac3
chore: print removed
2024-03-22 00:11:17 -07:00
Timothy J. Baek
bc80f1438c
fix: ollama gguf upload
2024-03-22 00:10:55 -07:00
Timothy J. Baek
af4caec4f5
refac: ollama gguf upload
2024-03-21 23:45:00 -07:00
Self Denial
f74f2ea765
Merge conflicts
2024-03-21 00:14:13 -06:00
Timothy Jaeryang Baek
5a90e90c0b
Merge pull request #1241 from 7a6ac0/duplicate_def
...
fix: delete duplicate function
2024-03-20 22:01:13 -05:00
Timothy J. Baek
8e52ba8b91
refac: auth required for litellm in dev
2024-03-20 19:33:27 -07:00
Timothy J. Baek
ed0d4b5a2a
chore: comment clean up
2024-03-20 19:32:25 -07:00
tabaco.wang
a1412d0b55
fix: delete duplicate function
2024-03-21 10:31:25 +08:00
Timothy J. Baek
93c90dc186
feat: litellm model filter support
2024-03-20 19:28:33 -07:00
Timothy J. Baek
fa65be2ad2
refac: post webhook
2024-03-20 18:47:13 -07:00
Timothy J. Baek
2c6e2d5e8a
feat: webhook backend
2024-03-20 18:35:02 -07:00
Self Denial
e6dd0bfbe0
Migrate to python logging module with env var control.
2024-03-20 17:11:36 -06:00
Jannik Streidl
1f6739337b
docker improvements & changed universal device type env for different models used
2024-03-20 08:44:09 +01:00
Timothy J. Baek
e86db74333
refac: stream default value
2024-03-18 18:14:05 -07:00
Timothy J. Baek
b188143f01
fix: openai proxy issue
2024-03-18 11:04:22 -07:00
Timothy J. Baek
ec9895a14a
fix: openai proxy issue
2024-03-18 11:02:09 -07:00
Timothy J. Baek
1bfcd801b7
fix: multiple openai issue
2024-03-18 01:11:48 -07:00
Timothy J. Baek
1e03871748
fix: openai issue
2024-03-16 03:25:20 -07:00
Timothy J. Baek
ed964260ba
fix: openai urls issue
2024-03-16 02:45:24 -07:00
Timothy J. Baek
91efd6cb63
fix: file upload encoding issue
2024-03-15 23:52:37 -07:00
Timothy J. Baek
072b499a50
fix: backslash rag content issue
2024-03-15 13:34:52 -07:00
Timothy Jaeryang Baek
7cef008b44
Merge pull request #1163 from joequant/main
...
fix typo in uploading blob to ollama
2024-03-14 15:48:49 -05:00
Joseph C Wang
9ee0feae32
fix typo in uploading blob to ollama
2024-03-14 17:17:52 +08:00
Timothy J. Baek
7f78e58488
refac: image generation error handling
2024-03-12 13:35:30 -07:00
Timothy J. Baek
26a187f5ac
refac: print removed
2024-03-12 00:26:53 -07:00
Timothy J. Baek
be3ab88c88
fix: error handling
2024-03-12 00:26:14 -07:00
Timothy J. Baek
b4c770d74b
fix: disable openai model by default
2024-03-10 19:00:43 -07:00
Timothy J. Baek
8df6b137cb
fix: rag
2024-03-10 18:40:50 -07:00
Timothy J. Baek
98948814fd
feat: toggle pdf ocr
2024-03-10 13:32:34 -07:00
Timothy J. Baek
a4ca1fc5c4
feat: model filter list env var
2024-03-09 21:47:01 -08:00
Timothy J. Baek
81daf4ceb9
feat: model filter frontend integration
2024-03-09 21:29:04 -08:00
Timothy J. Baek
b550e23bf6
feat: model filter backend
2024-03-09 21:19:20 -08:00
Timothy J. Baek
c49491e516
refac: rag to backend
2024-03-08 22:34:47 -08:00
Timothy J. Baek
6ba62cf25d
fix: dalle3 issue
2024-03-08 19:54:47 -08:00
Timothy J. Baek
7e5e2c42c9
refac: rag routes
2024-03-08 19:26:39 -08:00
Timothy J. Baek
0221acd163
feat: dall-e integration
2024-03-08 17:38:10 -08:00
Timothy J. Baek
2b84af878a
refac: litellm
2024-03-08 13:33:56 -08:00
Timothy J. Baek
df49e4e1cc
fix: default openai api value
2024-03-06 20:25:24 -08:00
Timothy J. Baek
53adc6a0ca
fix: rag issue
2024-03-06 18:37:40 -08:00
Timothy J. Baek
b88c64f80e
fix: ocr issue
2024-03-06 17:54:42 -08:00
Timothy Jaeryang Baek
dc6e91a23d
Merge pull request #1074 from open-webui/main
...
dev
2024-03-06 20:07:37 -05:00
Timothy J. Baek
bb98c10abb
revert: ocr feature
2024-03-06 17:04:40 -08:00
Timothy J. Baek
c255cba198
feat: multiple openai apis
2024-03-06 16:13:25 -08:00
Timothy J. Baek
f741adc6c9
refac: OLLAMA_API_BASE_URL deprecated
2024-03-06 11:44:00 -08:00
Timothy Jaeryang Baek
8fb5f54751
Merge pull request #1050 from jannikstdl/rag-pdf-ocr
...
feat: added ocr functionality to the pdf loader
2024-03-06 00:45:33 -05:00
Jannik Streidl
089a63e0c6
feat: added ocr functionality to the pdf loader
2024-03-05 22:25:25 +01:00
Timothy J. Baek
124020f824
chore: added print url for debugging
2024-03-05 02:19:25 -08:00
Timothy J. Baek
fbdac832bb
feat: multiple ollama model management
2024-03-05 02:12:55 -08:00
Timothy J. Baek
8626ae60dd
chore: old_main removed
2024-03-05 01:43:33 -08:00
Timothy J. Baek
8d34324d12
feat: cancel request
...
Resolves #1006
2024-03-05 01:41:22 -08:00
Timothy J. Baek
b2dd2f191d
refac: comment
2024-03-05 01:21:50 -08:00
Timothy J. Baek
8fd7bc342d
refac: error message
2024-03-05 01:07:59 -08:00
Timothy J. Baek
f04d60b6d9
feat: multiple ollama support
2024-03-05 00:59:35 -08:00
Firat Birlik
6782e95c75
recreate rag collection is now optional and only used for web requests
2024-03-04 10:00:06 -06:00
Firat Birlik
5d4ff85228
recreate rag collection instead of falling back to stale version
2024-03-03 21:25:00 -06:00
Timothy J. Baek
47a05a47b4
feat: add rag top k value setting
2024-03-02 18:56:57 -08:00
Timothy J. Baek
901e7a33fa
feat: chat playground backend integration
2024-03-02 18:16:02 -08:00
Timothy J. Baek
2379e94cbf
feat: text completion playground
2024-03-02 03:01:44 -08:00
Timothy J. Baek
edb63c2280
feat: download db from admin settings
2024-03-02 00:33:20 -08:00
Timothy J. Baek
6d854125cc
refac: ollama.db renamed to webui.db
2024-03-02 00:19:24 -08:00
Timothy J. Baek
74809e7330
fix: user chat delete loophole
2024-03-02 00:07:50 -08:00
Timothy J. Baek
59ae5b6d34
fix: openai filtering
2024-02-27 20:08:57 -08:00
Timothy J. Baek
781be2779b
refac: unnecessary max_token value removed
2024-02-27 20:02:23 -08:00
Sakkus
bbeaa92904
Fix OpenAI integration:
...
from docker on mac get errors since num_ctx not recognized;
remove num_ctx from, and max_tokens to, body in API calls.
2024-02-26 12:25:08 +00:00
Timothy J. Baek
1d937ec2f2
fix: cleanup unused tags
2024-02-25 13:03:26 -08:00
Timothy Jaeryang Baek
271e5bf44d
Merge branch 'dev' into feature/img-gen-steps-setting
2024-02-24 21:09:06 -05:00
Timothy J. Baek
393531c9b0
fix
2024-02-24 18:08:35 -08:00
Timothy J. Baek
ec6f53e298
feat: litellm proxy frontend integration
2024-02-24 17:56:53 -08:00
Timothy J. Baek
e15e015db1
fix: images
2024-02-24 15:48:14 -08:00
Justin Firth
3fa79e59bf
Allow configuration of steps, default to a1111 default
2024-02-24 10:44:08 -05:00
Ased Mammad
b473ad574f
fix: RAG scan unsupported mimetype
...
This fixes an issue with RAG that stops loading documents as soon
as it reaches a file with unsupported mimetype.
2024-02-23 14:27:31 +03:30
Timothy J. Baek
7ec4c07bf9
feat: image size param
2024-02-22 19:32:36 -08:00
Timothy J. Baek
dc705c4984
refac: settings
2024-02-21 19:06:27 -08:00
Timothy J. Baek
797ed9ac7f
feat: allow enabling after url is provided
2024-02-21 18:57:53 -08:00
Timothy J. Baek
cc50cc10e6
feat: sd frontend integration
2024-02-21 18:36:40 -08:00
Timothy J. Baek
733e963c44
feat: sd backend integration
2024-02-21 18:12:01 -08:00
Timothy J. Baek
7a730c3f0f
refac: versioning using package
2024-02-21 17:10:27 -08:00
Timothy J. Baek
275523e32e
feat: jwt utils
2024-02-19 20:44:00 -08:00
Timothy J. Baek
7c127c35fc
feat: dynamic embedding model load
2024-02-19 11:05:45 -08:00
Jannik Streidl
acf999013b
storing vectordb in project cache folder + device types
2024-02-19 07:51:17 +01:00
Timothy J. Baek
0cb0358485
refac: more descriptive var names
2024-02-18 11:16:10 -08:00
Jannik S
4b88e7e44f
Merge branch 'main' into choose-embedding-model
2024-02-18 09:20:54 +01:00
Jannik Streidl
bc3dd34d8b
collection query fix
2024-02-18 09:17:43 +01:00
Timothy J. Baek
07b451995e
feat: reset rag template
2024-02-17 22:49:18 -08:00
Timothy J. Baek
5270efa9e5
feat: editable rag template
2024-02-17 22:41:03 -08:00
Timothy J. Baek
ccf08fb91e
feat: editable chunk params
2024-02-17 22:29:52 -08:00
Timothy J. Baek
a94e4161f7
fix: file content type issue
2024-02-17 21:31:46 -08:00
Timothy J. Baek
e07001e5f6
feat: rag folder scan support
2024-02-17 21:06:08 -08:00
Jannik Streidl
1846c1e80d
choose embedding model when using docker
2024-02-17 19:38:29 +01:00
Timothy J. Baek
90bcd1644a
rename to open-webui
2024-02-16 23:30:38 -08:00
Timothy Jaeryang Baek
1def55cf09
Merge pull request #725 from jnkstr/no-internet-whisper
...
fix: no internet connection for whisper if you use docker
2024-02-15 02:44:31 -05:00
Timothy J. Baek
63e6f39b31
refac
2024-02-14 23:32:54 -08:00
Timothy J. Baek
434e2c00e9
fix: user display limit
2024-02-14 13:24:40 -08:00
Timothy J. Baek
511e939b5d
feat: admin settings
2024-02-14 01:17:43 -08:00
Jannik Streidl
8ab0338e71
no internet connection for whisper if you use docker
2024-02-13 15:11:53 +01:00
Timothy J. Baek
2ef4fc1215
fix: strip transcription text
2024-02-11 02:17:24 -08:00
Timothy J. Baek
a5b9bbf10b
feat: whisper support
2024-02-11 00:17:50 -08:00
Timothy J. Baek
3af8d16e6a
fix: admin issue
2024-02-10 17:54:33 -08:00
Timothy Jaeryang Baek
9f3346a6ec
Merge pull request #682 from explorigin/simplify-endpoint-code
...
Simplify endpoint role checking
2024-02-09 14:26:56 -08:00
Tim Farrell
08e8e922fd
Endpoint role-checking was redundantly applied but FastAPI provides a nice abstraction mechanic...so I applied it. There should be no logical changes in this code; only simpler, cleaner ways for doing the same thing.
2024-02-08 18:05:01 -06:00
Kyle McLaren
d4fec48d9c
get ENABLE_SIGNUP
from env
2024-02-06 20:58:07 +02:00
Timothy J. Baek
519e27978f
refac
2024-02-05 22:58:02 -08:00
Timothy J. Baek
1b040143eb
feat: cache request body
2024-02-05 22:57:24 -08:00
Timothy J. Baek
0b8df52c97
feat: openai tts support
2024-02-05 22:51:08 -08:00
Timothy J. Baek
7c2f297c84
feat: export all chats from db
...
admin only
2024-02-04 01:07:18 -08:00
Timothy Jaeryang Baek
323ec3787e
Merge pull request #624 from explorigin/session-security
...
Improve Session Security
2024-02-03 17:41:31 -08:00
Timothy J. Baek
683650ec00
feat: collection rag integration
2024-02-03 15:57:06 -08:00
Timothy J. Baek
00803c92f2
feat: doc tagging
2024-02-03 14:44:49 -08:00
Tim Farrell
44799e2018
Remove some extraneous imports
2024-02-02 09:02:07 -06:00
Tim Farrell
8c37edd027
Even though "User.email" is enforced as unique at signup, it is not a unique field in the database. Let's use "User.id" instead. This also makes it more difficult to do a session stealing attack.
2024-02-02 09:01:06 -06:00
Timothy J. Baek
50f7b20ac2
refac
2024-02-01 13:35:41 -08:00
Timothy J. Baek
28226a6f97
feat: web rag support
2024-01-26 22:17:28 -08:00
Timothy J. Baek
0c322063b5
feat: use local profile image by default
2024-01-26 21:38:33 -08:00
Timothy J. Baek
3ce8f3e8fb
feat: profile update frontend integration
2024-01-26 21:22:25 -08:00
Timothy J. Baek
418da74756
feat: profile image update backend
2024-01-26 20:27:45 -08:00
Timothy Jaeryang Baek
a243e53bfe
Merge pull request #536 from lucasew/backend-data-dir
...
Unhardcode some stuff, flexibilize dotenv requirement
2024-01-25 00:42:12 -08:00
Timothy J. Baek
4e468dc58c
refac
2024-01-25 00:24:49 -08:00
Timothy Jaeryang Baek
fa5918ad13
Merge branch 'main' into main
2024-01-25 00:13:12 -08:00
Marclass
8bfda730d9
add excel document support
2024-01-23 14:03:22 -07:00
lucasew
8da06f5e74
fixes after the refactor
...
Signed-off-by: lucasew <lucas59356@gmail.com>
2024-01-23 12:59:52 -03:00
Timothy Jaeryang Baek
ca943d0795
Merge pull request #549 from Marclass/main
...
Bugfix: Fix toast error popup when front end can't figure out file type.
2024-01-22 23:13:53 -08:00
Timothy Jaeryang Baek
7054f02891
Merge pull request #466 from baumandm/feat/epub-support
...
feat: Add epub support
2024-01-22 23:12:46 -08:00
Marclass
7eea3ef313
copy list of file ext from backend to front end
2024-01-23 00:00:07 -07:00
Timothy Jaeryang Baek
d517a3ebb4
Merge pull request #547 from Marclass/main
...
feat: Add reStructuredText specific parser for RAG
2024-01-22 22:19:41 -08:00
Timothy J. Baek
c4a039326f
feat: editable prompt suggestions integration
2024-01-22 21:53:13 -08:00
Timothy J. Baek
4e1b52e91b
feat: custom interface support
2024-01-22 21:07:40 -08:00
Marclass
2e4373c63e
Merge branch 'ollama-webui:main' into main
2024-01-22 21:01:33 -07:00
Timothy J. Baek
d67c632920
fix: openai
2024-01-22 09:45:56 -08:00
Timothy J. Baek
d2c5f3d591
refac: convert str var to f-string
2024-01-22 01:47:07 -08:00
Timothy Jaeryang Baek
1abe5a5487
Merge pull request #537 from CreatorGhost/fix-gpt-4-vision
...
Add max_tokens workaround for gpt-4-vision-preview model
2024-01-22 01:41:57 -08:00
Timothy J. Baek
83181b7968
fix: add max_token only when field not present
2024-01-22 01:41:00 -08:00
Timothy J. Baek
b26e0fb7e7
refac
2024-01-22 01:37:54 -08:00
Shiyinq
6a63c94153
feat: add guard clause to improve signup process
2024-01-20 21:54:53 +07:00
Aditya Pratap Singh
60afd6ecdd
Add workaround for gpt-4-vision-preview model that support 4k tokens
2024-01-20 04:34:47 +05:30
Aditya Pratap Singh
8662437a9f
Add workaround for gpt-4-vision-preview model
2024-01-20 04:17:06 +05:30
lucasew
5b26d2a686
backend: make the data directory and the artifacts from the frontend customizable using environment variables
...
Signed-off-by: lucasew <lucas59356@gmail.com>
2024-01-19 17:13:09 -03:00
Marclass
35ace57784
add rst document for RAG
2024-01-19 10:48:04 -07:00
Dave Bauman
f559068186
feat: Add epub support
2024-01-19 12:23:59 -05:00
Timothy Jaeryang Baek
f079cb6b56
Merge pull request #524 from Marclass/rag-arbitrary-files
...
feat: Allow RAG on XML and arbitrary text files including source code
2024-01-19 00:09:04 -08:00
Marclass
aa1d386042
Allow any file to be used for RAG.
...
Changed RAG parser to prefer file extensions over MIME content types. If the type of file is not recognized assume it's a text file.
2024-01-18 20:41:14 -07:00
Timothy J. Baek
220530c450
feat: convo tag filtering
2024-01-18 02:55:25 -08:00
Timothy J. Baek
1eec176313
feat: save tags to chat data
2024-01-18 02:17:31 -08:00
Timothy J. Baek
987685dbf9
feat: convo tagging full integration
2024-01-18 02:10:07 -08:00
Timothy J. Baek
d5ed119687
feat: convo tagging api added
2024-01-18 01:04:24 -08:00
Timothy J. Baek
077f1fa34b
feat: convo tagging backend support
2024-01-18 00:58:45 -08:00
Timothy J. Baek
442e3d978a
feat: terminate request on user stop
2024-01-17 19:19:44 -08:00
Marclass
6070e6bcd1
add svelte type to RAG
2024-01-17 20:10:34 -07:00
Marclass
8dacc86ab0
Merge branch 'ollama-webui:main' into main
2024-01-17 16:20:52 -07:00
Timothy J. Baek
b6ab357e8c
fix: more edge cases
2024-01-17 14:47:56 -08:00
Marclass
cf6b3fa48a
remove html type and add js/css
2024-01-17 00:34:22 -07:00
Marclass
43d8466677
feat: Add RAG support for various programming languages
...
Enables RAG for golang, python, java, sh, bat, powershell, cmd, js, css, c/c++/c#, sql, logs, ini, perl, r, dart, docker, env, php, haskell, lua, conf, plsql, ruby, db2, scalla, bash, swift, vue, html, xml, and other arbitrary text files.
2024-01-17 00:09:47 -07:00
goecho
74f91bc74d
Fix bug: Header attributes (Host, Authorization, Origin, Referer) not sanitized
...
- Resolved an issue where header attributes Host, Authorization, Origin, and Referer were not being sanitized, resulting in two major issues:
1. Ollama requests inadvertently exposed user information, leading to data leakage.
2. When Ollama is deployed on different servers, and the intermediary proxy layer uses the host header to locate downstream services, it fails to find them.
Root Cause:
- In FastAPI, when accessing request.headers, all header names are converted to lowercase. This is because FastAPI, and its underlying framework Starlette, adhere to the HTTP/2 standard, which mandates lowercase header field names for performance and consistency.
- In HTTP/2, enforcing lowercase header field names reduces complexity in header processing as case sensitivity is no longer a concern. Thus, regardless of the case used in client-sent header fields, the server processes them uniformly in lowercase.
- This practice is adopted in FastAPI and other modern HTTP frameworks, even in an HTTP/1.1 context, to maintain consistency with HTTP/2 and improve overall performance. As a result, header field names are always presented in lowercase in FastAPI, even if the original request used capitalization or mixed case.
2024-01-11 14:36:34 +08:00
Timothy J. Baek
c1ec604f21
feat: rag md support
2024-01-09 15:24:53 -08:00
Timothy J. Baek
76d37393ee
feat: gguf upload
2024-01-09 13:25:42 -08:00
Timothy J. Baek
1ff3eb8038
feat: doc upload error handling
2024-01-08 01:54:03 -08:00
Timothy J. Baek
eddb6fc7b7
feat: documents backend integration
2024-01-08 01:49:20 -08:00
Timothy J. Baek
54c4e0761a
feat: documents file upload
2024-01-08 01:26:15 -08:00
Timothy J. Baek
cc3f84f916
feat: # to import doc
2024-01-07 23:43:32 -08:00
Timothy J. Baek
57c050326c
feat: docx support
2024-01-07 13:56:01 -08:00
Timothy J. Baek
9a63376e55
feat: file upload error handling
2024-01-07 09:33:34 -08:00
Timothy J. Baek
b37b157638
feat: reset vectordb storage support
2024-01-07 09:15:45 -08:00
Timothy J. Baek
d4b2578f6e
feat: rag csv support
2024-01-07 09:05:52 -08:00
Timothy J. Baek
d6a1bf1406
refac: file upload
2024-01-07 09:00:30 -08:00
Timothy J. Baek
ffd0a5a2a0
Update main.py
2024-01-07 08:34:05 -08:00
Timothy J. Baek
c68bb3b950
docker: slim
2024-01-07 08:28:35 -08:00
Timothy Jaeryang Baek
34e0f64fb3
Merge pull request #333 from ollama-webui/rag
...
feat: RAG support
2024-01-07 02:50:32 -08:00
Timothy J. Baek
464d0fb016
fix: update langchain.document_loaders
2024-01-07 02:49:13 -08:00
Timothy J. Baek
70d2571be1
feat: rag backend auth
2024-01-07 02:46:12 -08:00
Timothy J. Baek
142269374f
feat: vectordb query error handling
2024-01-07 01:59:00 -08:00
Timothy J. Baek
ad3d69be30
refac
2024-01-07 01:54:58 -08:00
Timothy J. Baek
9634e2da3e
feat: full integration
2024-01-07 01:40:36 -08:00
Timothy J. Baek
fef4725d56
feat: frontend file upload support
2024-01-07 00:57:10 -08:00
Timothy J. Baek
cd86c36953
feat: pdf data load
2024-01-06 23:40:51 -08:00
Timothy J. Baek
784b369cc9
feat: chromadb vector store api
2024-01-06 22:59:22 -08:00