Commit Graph

398 Commits

Author SHA1 Message Date
Timothy J. Baek
5a96fcbeaf enh: enable selecting individual files from collection 2024-10-12 02:31:10 -07:00
Timothy J. Baek
11d7aec61d fix 2024-10-11 16:21:56 -07:00
Timothy J. Baek
30d3d28b9f refac 2024-10-11 15:37:46 -07:00
Timothy J. Baek
1cad157071 fix 2024-10-11 15:29:58 -07:00
Timothy J. Baek
428fd202c5 fix: custom comfyui prompt issue 2024-10-11 13:11:17 -07:00
Timothy Jaeryang Baek
db35ea0ae1
Merge pull request #6129 from open-webui/main
refac
2024-10-11 12:11:47 -07:00
Willnow, Patrick
1c5b6987e2 add missing env mapping 2024-10-11 14:08:11 +02:00
Timothy J. Baek
ba2df1c33a refac 2024-10-11 00:00:13 -07:00
Timothy J. Baek
acb5dcf30a refac: tags 2024-10-10 23:22:53 -07:00
Peter De-Ath
c748d33192 support list[str] | str as input 2024-10-10 22:41:57 +01:00
Willnow, Patrick
edc15d0d7c rewrite oauth role management logic to allow any custom roles to be used for oauth role to open webui role mapping 2024-10-10 23:00:05 +02:00
JoeyShapiro
df824db042 fix: disallow empty files 2024-10-10 15:33:27 -05:00
Timothy J. Baek
e8babe62bc refac 2024-10-10 12:51:00 -07:00
Jannik Streidl
741230bcdb fix 2024-10-10 17:20:50 +02:00
Jannik Streidl
89c77f05a8 chromadb switch to cosine similarity 2024-10-10 16:46:14 +02:00
Timothy Jaeryang Baek
7e253df175
Merge pull request #6054 from jeeteshchel/bugfix/secure-cookie
fix: set token cookie secure and samesite per config
2024-10-09 12:15:19 -07:00
Timothy Jaeryang Baek
d7a71f3b34
Merge pull request #6050 from RobinBially/main
feat: add qdrant vector db connector
2024-10-09 12:12:48 -07:00
Timothy J. Baek
c157004e07 refac 2024-10-09 12:05:16 -07:00
Timothy J. Baek
451f1bae15 refac: embeddings function 2024-10-09 11:41:35 -07:00
Robin Bially
34150fc3ed add NO_LIMIT var 2024-10-09 18:34:04 +02:00
Robin Bially
54dc94317c improvements 2024-10-09 18:29:14 +02:00
Jeetesh Chellani
a2e889c8bb fix: set oauth token secure and samesite per config 2024-10-09 14:50:48 +03:00
Robin Bially
2c59f2dcaf fix critical bug 2024-10-09 13:23:04 +02:00
Robin Bially
b56f77ed47 improvements 2024-10-09 13:10:23 +02:00
Robin Bially
b185524a8c
Merge branch 'open-webui:main' into main 2024-10-09 12:52:13 +02:00
Robin Bially
878a570a2c add qdrant as vector db 2024-10-09 12:51:43 +02:00
Timothy J. Baek
37fdb0ea2e refac: move search to backend 2024-10-08 23:37:37 -07:00
Timothy J. Baek
d7a00af576 refac: convert chat.chat to json data type 2024-10-08 22:02:48 -07:00
Timothy Jaeryang Baek
a04f22d55f
Merge pull request #6044 from open-webui/main
dev
2024-10-08 20:30:00 -07:00
Timothy J. Baek
0da0e12096 refac: file download 2024-10-08 20:16:17 -07:00
Timothy J. Baek
3391a855f0 fix 2024-10-08 17:03:42 -07:00
Timothy J. Baek
0feaf6f649 refac 2024-10-08 13:39:27 -07:00
Timothy J. Baek
595cf191fb chore: rm documents 2024-10-08 13:38:16 -07:00
Timothy J. Baek
dcab991d44 fix: model dump issue 2024-10-08 11:05:57 -07:00
Saravanan Palanisamy
16dd352524 add offline_mode and disable version check 2024-10-08 09:13:49 +04:00
Timothy Jaeryang Baek
d05c2f56ea
Merge pull request #4715 from Peter-De-Ath/ollama-batch-embeddings
feat: support ollama batch processing embeddings
2024-10-07 18:32:08 -07:00
Timothy J. Baek
f099b277c8 enh: youtube watch param support 2024-10-07 18:19:13 -07:00
Peter De-Ath
b242460874 formatting 2024-10-08 00:04:35 +01:00
Peter De-Ath
3fcdca2f28 backwards comp: use RAG_EMBEDDING_OPENAI_BATCH_SIZE 2024-10-08 00:04:35 +01:00
Peter De-Ath
885b9f1ece refactor: Update GenerateEmbeddingsForm to support batch processing
refactor: Update embedding batch size handling in RAG configuration

refactor: add query_doc query caching

refactor: update logging statements in generate_chat_completion function

change embedding_batch_size to Optional
2024-10-08 00:04:35 +01:00
Timothy J. Baek
48e7f47558 refac 2024-10-07 14:03:42 -07:00
Jannik Streidl
9fc813cfa6 fix: only append if distances are available 2024-10-07 21:13:13 +02:00
Jannik Streidl
b105efa05f enh: append citations with distance scores 2024-10-07 21:11:04 +02:00
Timothy J. Baek
ee22ba9676 fix: web, youtube attachment issue 2024-10-06 19:44:02 -07:00
Timothy J. Baek
05c15b017d fix: milvus 2024-10-06 17:58:09 -07:00
Timothy J. Baek
da1e88a427 enh: __task_body__ param 2024-10-06 14:56:49 -07:00
Timothy J. Baek
d23f05fe0a refac 2024-10-06 14:52:12 -07:00
Sylvere Richard
9706b76b36 feat: db pool config #5935 2024-10-06 17:20:10 +02:00
Timothy J. Baek
55d0ecc879 refac 2024-10-05 12:41:18 -07:00
Timothy J. Baek
614f3d5f80 fix 2024-10-05 12:40:13 -07:00
Timothy J. Baek
378223aedb refac: comments 2024-10-05 10:08:48 -07:00
Timothy J. Baek
61b147441c refac 2024-10-05 10:05:12 -07:00
Timothy J. Baek
1f9b5b6456 refac: retain metadata for collection 2024-10-05 09:58:46 -07:00
Timothy J. Baek
0bd88090bb refac: DOCS_DIR deprecated 2024-10-05 01:45:22 -07:00
Timothy J. Baek
493745a70b refac 2024-10-04 19:32:33 -07:00
Timothy J. Baek
a909aa1c20 enh: sync directory 2024-10-04 18:44:57 -07:00
Timothy J. Baek
e3889522d6 refac 2024-10-04 18:28:48 -07:00
Timothy J. Baek
79c005a041 refac: deprecate docs_dir 2024-10-04 18:22:55 -07:00
Timothy J. Baek
a6c797d4c2 refac: process docs dir 2024-10-04 17:22:00 -07:00
Timothy J. Baek
5017ca90ff refac 2024-10-04 16:16:16 -07:00
Timothy J. Baek
8f22e911e0 fix: empty knowledge delete issue 2024-10-04 11:11:53 -07:00
Willnow, Patrick
f751d22a20 Refinement 2024-10-04 13:26:49 +02:00
Patrick Willnow
6ddd8c7241 fix logic 2024-10-04 10:14:20 +02:00
Timothy J. Baek
d1b8af6220 chore: format 2024-10-04 01:04:04 -07:00
Timothy Jaeryang Baek
0876c9b5ef
Merge pull request #5829 from jannikstdl/query-embedding-perf-fix
fix:  performance issues on large collections
2024-10-04 10:01:17 +02:00
Timothy Jaeryang Baek
ebc7da6f82
Merge pull request #5861 from open-webui/projects
feat: knowledge/projects
2024-10-04 10:00:47 +02:00
Timothy J. Baek
1fe1c27220 refac: legacy support 2024-10-04 00:59:19 -07:00
Timothy J. Baek
8013c152d0 feat: edit file content support 2024-10-04 00:46:32 -07:00
Timothy J. Baek
630a78cead fix 2024-10-04 00:24:51 -07:00
Timothy J. Baek
17c772831d refac 2024-10-04 00:23:14 -07:00
Timothy J. Baek
05970157f6 refac 2024-10-03 23:06:47 -07:00
Timothy J. Baek
d834bd2a18 refac 2024-10-03 22:35:43 -07:00
Timothy J. Baek
e9b68524e8 refac 2024-10-03 22:24:05 -07:00
Timothy J. Baek
b291271df3 refac 2024-10-03 22:22:22 -07:00
Timothy J. Baek
b862dff185 refac 2024-10-03 21:10:33 -07:00
Timothy J. Baek
6747478f67 refac 2024-10-03 21:05:55 -07:00
Timothy J. Baek
124a17e826 refac 2024-10-03 20:58:56 -07:00
Timothy J. Baek
57360b7a61 refac 2024-10-03 20:51:21 -07:00
Willnow, Patrick
79b9c8a677 handling no claim received when nested expected 2024-10-04 00:05:36 +02:00
Willnow, Patrick
8e4776ada1 add handling nested claims... 2024-10-03 23:25:00 +02:00
Willnow, Patrick
5b2e1ca7cd add more logging 2024-10-03 23:06:05 +02:00
Willnow, Patrick
0a7373dae1 add pending as role fallback
add logging to determine correct handling of oauth roles
2024-10-03 22:56:52 +02:00
Willnow, Patrick
c9d948f284 Remove copy pasta error of calling value on bool 2024-10-03 21:38:56 +02:00
Willnow, Patrick
dc92178641 Fix missing key mapping 2024-10-03 20:55:32 +02:00
Timothy J. Baek
2fc07fd6a2 enh: vector db hash collision check 2024-10-03 06:53:21 -07:00
Timothy J. Baek
78413d0c2e enh: add/remove file from knowledge 2024-10-03 06:46:20 -07:00
Timothy J. Baek
15a3c6b171 refac 2024-10-03 06:45:15 -07:00
Timothy J. Baek
d394f8b7be enh: add to vector db support 2024-10-03 06:44:17 -07:00
Timothy J. Baek
325ca98773 enh: vector db delete filter support 2024-10-03 06:43:50 -07:00
Patrick Willnow
9a691c0387 Add oauth role mapping
also add node env to allow local build to succeed
2024-10-03 11:12:14 +02:00
Timothy J. Baek
351b1dbf31 refac 2024-10-02 21:14:58 -07:00
Timothy J. Baek
a2eadb30f5 refac 2024-10-02 20:42:10 -07:00
Timothy Jaeryang Baek
2e7e346e19
Merge pull request #5871 from tcgumus/dev
fix: Unsupported JSON schema type {type_}
2024-10-03 05:07:30 +02:00
Jun Siang Cheah
318f61161e refac: lazy load big dependencies to reduce min memory usage 2024-10-02 22:18:42 +01:00
Timothy J. Baek
4aca1e86ad refac 2024-10-02 06:19:09 -07:00
t
bdb2ce9448 fix: Unsupported JSON schema type {type_} 2024-10-02 15:34:48 +03:00
Timothy J. Baek
08969ecf89 refac: rename projects -> knowledge 2024-10-01 22:45:04 -07:00
Timothy J. Baek
3e012f0219 refac 2024-10-01 21:48:15 -07:00
Timothy J. Baek
5933d7a216 enh: sort by descending order 2024-10-01 21:35:18 -07:00
Timothy J. Baek
1b7d363d32 refac 2024-10-01 21:32:59 -07:00
Timothy J. Baek
c2732a0990 refac 2024-10-01 17:46:56 -07:00
Timothy J. Baek
c5eb0a9732 refac: documents -> projects 2024-10-01 17:35:35 -07:00
Timothy J. Baek
bf57dd808e feat: project migration 2024-10-01 17:35:10 -07:00
Timothy J. Baek
fb083237cd refac 2024-10-01 14:00:19 -07:00
Timothy J. Baek
a0fb4a9b84 refac 2024-10-01 13:13:39 -07:00
Timothy J. Baek
5c9dd25459 refac: files migration 2024-10-01 11:01:26 -07:00
Timothy J. Baek
0907c32e10 refac 2024-10-01 09:51:58 -07:00
Timothy J. Baek
4752df9bd8 refac 2024-10-01 09:40:08 -07:00
Timothy J. Baek
c7a0e45bea refac 2024-09-30 16:32:38 +02:00
Jannik Streidl
6bff5a4d09 fix: do not embed the query every single time 2024-09-30 16:18:02 +02:00
Timothy J. Baek
1c4b6b9cd9 refac 2024-09-30 01:00:13 +02:00
Timothy J. Baek
3899405864 refac 2024-09-30 00:39:30 +02:00
Timothy J. Baek
7152af949b feat: compress audio
Co-Authored-By: Beck Bekmyradov <47065940+bekmuradov@users.noreply.github.com>
2024-09-30 00:30:12 +02:00
Timothy J. Baek
8206c47a47 refac 2024-09-29 23:20:37 +02:00
Timothy J. Baek
6afc686e17 refac 2024-09-29 23:08:55 +02:00
Timothy J. Baek
677c36c3aa refac 2024-09-29 22:55:53 +02:00
Timothy J. Baek
6d764ee55e feat: retrieval whole document mode 2024-09-29 22:52:27 +02:00
Timothy J. Baek
92dd173b27 refac 2024-09-29 18:55:26 +02:00
Timothy J. Baek
c93a10388b refac 2024-09-28 19:51:28 +02:00
Timothy J. Baek
276ce3374d refac 2024-09-28 19:17:21 +02:00
Timothy J. Baek
e77c3ab043 refac 2024-09-28 19:16:52 +02:00
Timothy J. Baek
90ec458c4c enh: show extracted file content 2024-09-28 10:53:25 +02:00
smonux
e039b4ec54
Merge branch 'open-webui:dev' into dev 2024-09-28 06:01:26 +02:00
Timothy J. Baek
9d2ed3d2be refac 2024-09-28 02:56:56 +02:00
Timothy J. Baek
b8b994a820 refac 2024-09-28 02:49:18 +02:00
Timothy J. Baek
00eb022450 refac 2024-09-28 02:38:59 +02:00
Timothy J. Baek
2428878f42 refac 2024-09-28 02:29:08 +02:00
Timothy J. Baek
af57a2c153 refac 2024-09-28 02:23:09 +02:00
Timothy J. Baek
a52e8cd537 refac 2024-09-28 01:35:31 +02:00
Timothy J. Baek
5b7cf88915 refac 2024-09-28 01:28:45 +02:00
Timothy J. Baek
e1103305f5 refac: "rag" endpoints renamed to "retrieval" 2024-09-28 01:27:46 +02:00
Timothy Jaeryang Baek
6e9db3e3c8
Merge pull request #5773 from HaldiH/main
fix: Chat completion 401 when no Authorization header
2024-09-27 21:34:58 +02:00
Hugo Haldi
eab30781e0
Chat completion 401 when no Authorization header
When we send a request to `/api/chat/completions` without the `Authorization` header, the server just crashes and creates a stack trace, returning "Internal Server Error" to the calling client. With this fix, the server sends a 401 to the client with the content `{"detail": "Not authenticated"}`.
2024-09-27 20:04:45 +02:00
Timothy Jaeryang Baek
c30c876659
Merge pull request #5758 from kivvi3412/fix_o1_system_message
Fix: O1 does not support the system parameter
2024-09-27 19:44:16 +02:00
Timothy J. Baek
4ead3c5b80 chore: format 2024-09-27 19:43:40 +02:00
kivvi
e13614e11b
Fix: O1 does not support the system parameter 2024-09-27 22:47:24 +08:00
Timothy J. Baek
0bd9d59c78 refac: update check timeout 2024-09-27 14:38:56 +02:00
Timothy J. Baek
719f4da1dc fix: milvus collection creation issue 2024-09-26 22:59:09 +02:00
smonux
d8f71e1d7f Some models produce almost correct json during function calling, but with additional data before of after it. This solves it. 2024-09-26 22:02:56 +02:00
Hwang In Tak
4fe1f2487d
fix: Fix OpenAI batch embedding 2024-09-26 20:48:14 +09:00
Hwang In Tak
a4bc0b2829
fix: Fix OpenAI batch embedding 2024-09-26 20:39:40 +09:00
Timothy J. Baek
9d25207b83 refac 2024-09-26 03:13:38 +02:00
Timothy Jaeryang Baek
cc19b8049a
Merge pull request #5710 from kivvi3412/fix_o1_max_tokens
Fix: o1 input parameter must be max_completion_tokens
2024-09-26 03:03:15 +02:00
Timothy J. Baek
3a163b6392 fix: pip install database save issue 2024-09-26 03:02:08 +02:00
kivvi
405d0561df
Fix: o1 input parameter must be max_completion_tokens 2024-09-26 08:49:59 +08:00
Timothy J. Baek
ee33b4e2a3 fix: ollama /embed form_data 2024-09-25 22:34:02 +02:00
Timothy J. Baek
92b1acd6fb fix: RESET_CONFIG_ON_START not working 2024-09-25 01:06:11 +02:00
Timothy J. Baek
e19406cdd7 fix 2024-09-24 17:43:43 +02:00
Timothy J. Baek
3cee507687 fix: dev2 2024-09-24 16:19:24 +02:00
Timothy J. Baek
ff651ddc36 fix: dev1 2024-09-24 16:07:49 +02:00