Commit Graph

429 Commits

Author SHA1 Message Date
Timothy J. Baek
d5c1c2f0a7 enh: faster whisper custom model support 2024-10-20 21:34:36 -07:00
Timothy Jaeryang Baek
de1e29eed0
Merge pull request #6109 from JoeyShapiro/dev
fix: disallow empty files
2024-10-20 20:41:56 -07:00
Timothy J. Baek
9936583477 chore: format 2024-10-20 18:38:06 -07:00
Timothy Jaeryang Baek
768b7e139c
Merge branch 'dev' into dev 2024-10-20 18:37:20 -07:00
Timothy J. Baek
e378f70f34 refac: tag restoration 2024-10-20 18:04:46 -07:00
Timothy J. Baek
d23252b8a9 enh: restore tags from chat import 2024-10-20 18:02:41 -07:00
Timothy J. Baek
30eb43f5b8 fix 2024-10-20 17:50:30 -07:00
Timothy J. Baek
4d46bfe03b refac: file table migration 2024-10-20 17:45:37 -07:00
Timothy J. Baek
7476bcaa2b enh: filter by untagged chat 2024-10-19 21:16:59 -07:00
Timothy J. Baek
86999157de refac: disable 'none' tag 2024-10-19 21:04:56 -07:00
Timothy J. Baek
7d322a7238 enh: folder export 2024-10-19 02:42:12 -07:00
Timothy Jaeryang Baek
2fc8fa1869
Merge pull request #6274 from open-webui/main
dev
2024-10-18 21:33:54 -07:00
Timothy J. Baek
988a5e2b8d refac: folder/pinned behaviour 2024-10-18 14:18:13 -07:00
Tom X Nguyen
11588af34c
fix: default to False if stream is unavailable 2024-10-18 11:33:08 +07:00
Timothy J. Baek
f821de9470 enh: drag and drop import to folders 2024-10-17 20:13:28 -07:00
Timothy J. Baek
e6f4da2bfc refac 2024-10-17 19:45:18 -07:00
Timothy J. Baek
351c29917b refac 2024-10-17 19:09:01 -07:00
Timothy J. Baek
6e4820cad8 refac 2024-10-17 18:42:36 -07:00
Timothy J. Baek
7ffa3cb022 refac: folder deletion 2024-10-17 18:24:58 -07:00
Timothy Jaeryang Baek
c9c79852a5
Merge branch 'dev' into dev 2024-10-17 13:25:39 -07:00
Timothy J. Baek
6336d34b59 fix: web attachment issue 2024-10-17 13:08:10 -07:00
Timothy J. Baek
d8b513023c feat: chat folder drag and drop support 2024-10-16 23:45:50 -07:00
Timothy J. Baek
36a541d6b0 enh: drag and drop folders 2024-10-16 23:06:53 -07:00
Timothy J. Baek
d5bf32f240 enh: save isExpanded state 2024-10-16 22:58:28 -07:00
Timothy J. Baek
29c39d44e1 fix: collapsible space toggle issue 2024-10-16 22:36:44 -07:00
Timothy J. Baek
7b97d7a718 enh: disable drag event listener if parent dragged 2024-10-16 22:04:21 -07:00
Timothy J. Baek
dea12360f4 refac: folder id -> uuid 2024-10-16 21:49:22 -07:00
Timothy J. Baek
a942c30ca8 feat: folder ui 2024-10-16 21:05:03 -07:00
Timothy J. Baek
ede71740d2 feat: folders table 2024-10-16 15:13:38 -07:00
Willnow, Patrick
b888ee17ff Merge branch 'main' into dev
# Conflicts:
#	backend/open_webui/main.py
2024-10-16 20:16:05 +02:00
Willnow, Patrick
57d54160d3 Merge branch 'implement-oauth-role-management'
# Conflicts:
#	backend/open_webui/main.py
2024-10-16 16:54:43 +02:00
Willnow, Patrick
08ff494754 WIP
- refactoring oauth functions to enable refresh functionality
2024-10-16 09:42:47 +02:00
Timothy J. Baek
bf0043881a refac 2024-10-15 03:11:03 -07:00
Timothy J. Baek
24f149f686 refac: pinned chat behaviour 2024-10-15 02:52:56 -07:00
Timothy J. Baek
b4cd503a02 refac 2024-10-15 02:51:08 -07:00
Timothy J. Baek
97bb9d41a6 refac 2024-10-15 02:48:41 -07:00
Timothy J. Baek
cf24a65caa fix: duplicate tags 2024-10-14 23:04:10 -07:00
Timothy J. Baek
9d2d53bfb5 fix 2024-10-14 22:59:17 -07:00
Timothy J. Baek
6703cacb99 fix: tag unarchive/archive issue 2024-10-14 22:57:11 -07:00
Timothy J. Baek
d8a30bd6ae refac: sidebar tag add behaviour 2024-10-14 21:21:45 -07:00
Timothy J. Baek
bc75870289 fix: tag search 2024-10-14 19:02:08 -07:00
Timothy J. Baek
8eb45acf10 refac 2024-10-14 18:47:41 -07:00
Timothy J. Baek
1db1ef7c26 refac: tag search 2024-10-14 17:31:52 -07:00
Timothy J. Baek
0b2c7046cd fix: archived chats 2024-10-14 15:29:43 -07:00
Jannik Streidl
f0f4de59eb Merge branch 'upstream-dev' into dev 2024-10-14 09:50:40 +02:00
Timothy J. Baek
ee8b8220f0 refac: OPENAI_MODEL_LIST_TIMEOUT -> AIOHTTP_CLIENT_TIMEOUT_OPENAI_MODEL_LIST 2024-10-13 22:56:33 -07:00
LuoChen
ebec6cd426
add: OPENAI_MODEL_LIST_TIMEOUT 2024-10-14 09:00:09 +08:00
Timothy J. Baek
586e005f0f enh: token text splitter support 2024-10-13 04:24:13 -07:00
Timothy J. Baek
8a0da6d376 enh: include file name to context 2024-10-13 03:58:51 -07:00
Timothy J. Baek
797afd0b72 fix: embedding metadata issue 2024-10-13 03:25:11 -07:00
Timothy J. Baek
92605fd59f refac 2024-10-13 03:16:18 -07:00
Timothy J. Baek
5ffd216fca refac 2024-10-13 03:02:02 -07:00
Timothy J. Baek
dff3732fcd enh: tiktoken/token splitter support 2024-10-13 02:07:50 -07:00
Timothy J. Baek
8ae605ec4b fix: multi-user tags issue 2024-10-13 01:00:38 -07:00
Timothy J. Baek
5273dc4535 refac 2024-10-13 00:21:06 -07:00
Timothy J. Baek
112cbdccbb revert: pdf gen 2024-10-13 00:05:28 -07:00
noczero
c41261e72b feat: PDF generator to export chat 2024-10-13 11:20:09 +07:00
Timothy J. Baek
333317a7ce refac: add embedding metadata 2024-10-12 18:30:21 -07:00
Jannik Streidl
f47c9c69e3 Merge branch 'upstream-dev' into dev 2024-10-12 15:18:59 +02:00
Timothy J. Baek
5a96fcbeaf enh: enable selecting individual files from collection 2024-10-12 02:31:10 -07:00
Timothy J. Baek
428fd202c5 fix: custom comfyui prompt issue 2024-10-11 13:11:17 -07:00
Timothy Jaeryang Baek
db35ea0ae1
Merge pull request #6129 from open-webui/main
refac
2024-10-11 12:11:47 -07:00
Willnow, Patrick
1c5b6987e2 add missing env mapping 2024-10-11 14:08:11 +02:00
Timothy J. Baek
ba2df1c33a refac 2024-10-11 00:00:13 -07:00
Timothy J. Baek
acb5dcf30a refac: tags 2024-10-10 23:22:53 -07:00
Peter De-Ath
c748d33192 support list[str] | str as input 2024-10-10 22:41:57 +01:00
Willnow, Patrick
edc15d0d7c rewrite oauth role management logic to allow any custom roles to be used for oauth role to open webui role mapping 2024-10-10 23:00:05 +02:00
JoeyShapiro
df824db042 fix: disallow empty files 2024-10-10 15:33:27 -05:00
Timothy J. Baek
e8babe62bc refac 2024-10-10 12:51:00 -07:00
Jannik Streidl
741230bcdb fix 2024-10-10 17:20:50 +02:00
Jannik Streidl
89c77f05a8 chromadb switch to cosine similarity 2024-10-10 16:46:14 +02:00
Timothy Jaeryang Baek
7e253df175
Merge pull request #6054 from jeeteshchel/bugfix/secure-cookie
fix: set token cookie secure and samesite per config
2024-10-09 12:15:19 -07:00
Timothy Jaeryang Baek
d7a71f3b34
Merge pull request #6050 from RobinBially/main
feat: add qdrant vector db connector
2024-10-09 12:12:48 -07:00
Timothy J. Baek
c157004e07 refac 2024-10-09 12:05:16 -07:00
Timothy J. Baek
451f1bae15 refac: embeddings function 2024-10-09 11:41:35 -07:00
Robin Bially
34150fc3ed add NO_LIMIT var 2024-10-09 18:34:04 +02:00
Robin Bially
54dc94317c improvements 2024-10-09 18:29:14 +02:00
Jeetesh Chellani
a2e889c8bb fix: set oauth token secure and samesite per config 2024-10-09 14:50:48 +03:00
Robin Bially
2c59f2dcaf fix critical bug 2024-10-09 13:23:04 +02:00
Robin Bially
b56f77ed47 improvements 2024-10-09 13:10:23 +02:00
Robin Bially
b185524a8c
Merge branch 'open-webui:main' into main 2024-10-09 12:52:13 +02:00
Robin Bially
878a570a2c add qdrant as vector db 2024-10-09 12:51:43 +02:00
Timothy J. Baek
37fdb0ea2e refac: move search to backend 2024-10-08 23:37:37 -07:00
Timothy J. Baek
d7a00af576 refac: convert chat.chat to json data type 2024-10-08 22:02:48 -07:00
Timothy Jaeryang Baek
a04f22d55f
Merge pull request #6044 from open-webui/main
dev
2024-10-08 20:30:00 -07:00
Timothy J. Baek
0da0e12096 refac: file download 2024-10-08 20:16:17 -07:00
Timothy J. Baek
3391a855f0 fix 2024-10-08 17:03:42 -07:00
Timothy J. Baek
0feaf6f649 refac 2024-10-08 13:39:27 -07:00
Timothy J. Baek
dcab991d44 fix: model dump issue 2024-10-08 11:05:57 -07:00
Peter De-Ath
885b9f1ece refactor: Update GenerateEmbeddingsForm to support batch processing
refactor: Update embedding batch size handling in RAG configuration

refactor: add query_doc query caching

refactor: update logging statements in generate_chat_completion function

change embedding_batch_size to Optional
2024-10-08 00:04:35 +01:00
Timothy J. Baek
48e7f47558 refac 2024-10-07 14:03:42 -07:00
Jannik Streidl
9fc813cfa6 fix: only append if distances are available 2024-10-07 21:13:13 +02:00
Jannik Streidl
b105efa05f enh: append citations with distance scores 2024-10-07 21:11:04 +02:00
Timothy J. Baek
ee22ba9676 fix: web, youtube attachment issue 2024-10-06 19:44:02 -07:00
Timothy J. Baek
05c15b017d fix: milvus 2024-10-06 17:58:09 -07:00
Timothy J. Baek
da1e88a427 enh: __task_body__ param 2024-10-06 14:56:49 -07:00
Sylvere Richard
9706b76b36 feat: db pool config #5935 2024-10-06 17:20:10 +02:00
Timothy J. Baek
378223aedb refac: comments 2024-10-05 10:08:48 -07:00
Timothy J. Baek
61b147441c refac 2024-10-05 10:05:12 -07:00
Timothy J. Baek
1f9b5b6456 refac: retain metadata for collection 2024-10-05 09:58:46 -07:00
Timothy J. Baek
0bd88090bb refac: DOCS_DIR deprecated 2024-10-05 01:45:22 -07:00
Timothy J. Baek
493745a70b refac 2024-10-04 19:32:33 -07:00
Timothy J. Baek
a909aa1c20 enh: sync directory 2024-10-04 18:44:57 -07:00
Timothy J. Baek
e3889522d6 refac 2024-10-04 18:28:48 -07:00
Timothy J. Baek
79c005a041 refac: deprecate docs_dir 2024-10-04 18:22:55 -07:00
Timothy J. Baek
a6c797d4c2 refac: process docs dir 2024-10-04 17:22:00 -07:00
Timothy J. Baek
5017ca90ff refac 2024-10-04 16:16:16 -07:00
Timothy J. Baek
8f22e911e0 fix: empty knowledge delete issue 2024-10-04 11:11:53 -07:00
Timothy J. Baek
d1b8af6220 chore: format 2024-10-04 01:04:04 -07:00
Timothy Jaeryang Baek
0876c9b5ef
Merge pull request #5829 from jannikstdl/query-embedding-perf-fix
fix:  performance issues on large collections
2024-10-04 10:01:17 +02:00
Timothy Jaeryang Baek
ebc7da6f82
Merge pull request #5861 from open-webui/projects
feat: knowledge/projects
2024-10-04 10:00:47 +02:00
Timothy J. Baek
1fe1c27220 refac: legacy support 2024-10-04 00:59:19 -07:00
Timothy J. Baek
8013c152d0 feat: edit file content support 2024-10-04 00:46:32 -07:00
Timothy J. Baek
630a78cead fix 2024-10-04 00:24:51 -07:00
Timothy J. Baek
17c772831d refac 2024-10-04 00:23:14 -07:00
Timothy J. Baek
05970157f6 refac 2024-10-03 23:06:47 -07:00
Timothy J. Baek
d834bd2a18 refac 2024-10-03 22:35:43 -07:00
Timothy J. Baek
e9b68524e8 refac 2024-10-03 22:24:05 -07:00
Timothy J. Baek
b291271df3 refac 2024-10-03 22:22:22 -07:00
Timothy J. Baek
b862dff185 refac 2024-10-03 21:10:33 -07:00
Timothy J. Baek
6747478f67 refac 2024-10-03 21:05:55 -07:00
Timothy J. Baek
124a17e826 refac 2024-10-03 20:58:56 -07:00
Timothy J. Baek
57360b7a61 refac 2024-10-03 20:51:21 -07:00
Willnow, Patrick
dc92178641 Fix missing key mapping 2024-10-03 20:55:32 +02:00
Timothy J. Baek
2fc07fd6a2 enh: vector db hash collision check 2024-10-03 06:53:21 -07:00
Timothy J. Baek
78413d0c2e enh: add/remove file from knowledge 2024-10-03 06:46:20 -07:00
Timothy J. Baek
15a3c6b171 refac 2024-10-03 06:45:15 -07:00
Timothy J. Baek
d394f8b7be enh: add to vector db support 2024-10-03 06:44:17 -07:00
Timothy J. Baek
325ca98773 enh: vector db delete filter support 2024-10-03 06:43:50 -07:00
Timothy J. Baek
351b1dbf31 refac 2024-10-02 21:14:58 -07:00
Timothy J. Baek
a2eadb30f5 refac 2024-10-02 20:42:10 -07:00
Jun Siang Cheah
318f61161e refac: lazy load big dependencies to reduce min memory usage 2024-10-02 22:18:42 +01:00
Timothy J. Baek
4aca1e86ad refac 2024-10-02 06:19:09 -07:00
Timothy J. Baek
08969ecf89 refac: rename projects -> knowledge 2024-10-01 22:45:04 -07:00
Timothy J. Baek
5933d7a216 enh: sort by descending order 2024-10-01 21:35:18 -07:00
Timothy J. Baek
1b7d363d32 refac 2024-10-01 21:32:59 -07:00
Timothy J. Baek
c5eb0a9732 refac: documents -> projects 2024-10-01 17:35:35 -07:00
Timothy J. Baek
fb083237cd refac 2024-10-01 14:00:19 -07:00
Timothy J. Baek
a0fb4a9b84 refac 2024-10-01 13:13:39 -07:00
Timothy J. Baek
5c9dd25459 refac: files migration 2024-10-01 11:01:26 -07:00
Timothy J. Baek
0907c32e10 refac 2024-10-01 09:51:58 -07:00
Timothy J. Baek
c7a0e45bea refac 2024-09-30 16:32:38 +02:00
Jannik Streidl
6bff5a4d09 fix: do not embed the query every single time 2024-09-30 16:18:02 +02:00
Timothy J. Baek
1c4b6b9cd9 refac 2024-09-30 01:00:13 +02:00
Timothy J. Baek
3899405864 refac 2024-09-30 00:39:30 +02:00
Timothy J. Baek
7152af949b feat: compress audio
Co-Authored-By: Beck Bekmyradov <47065940+bekmuradov@users.noreply.github.com>
2024-09-30 00:30:12 +02:00
Timothy J. Baek
8206c47a47 refac 2024-09-29 23:20:37 +02:00
Timothy J. Baek
6afc686e17 refac 2024-09-29 23:08:55 +02:00
Timothy J. Baek
677c36c3aa refac 2024-09-29 22:55:53 +02:00
Timothy J. Baek
6d764ee55e feat: retrieval whole document mode 2024-09-29 22:52:27 +02:00
Timothy J. Baek
92dd173b27 refac 2024-09-29 18:55:26 +02:00
Timothy J. Baek
c93a10388b refac 2024-09-28 19:51:28 +02:00
Timothy J. Baek
276ce3374d refac 2024-09-28 19:17:21 +02:00
Timothy J. Baek
e77c3ab043 refac 2024-09-28 19:16:52 +02:00
Timothy J. Baek
90ec458c4c enh: show extracted file content 2024-09-28 10:53:25 +02:00
Timothy J. Baek
9d2ed3d2be refac 2024-09-28 02:56:56 +02:00
Timothy J. Baek
b8b994a820 refac 2024-09-28 02:49:18 +02:00
Timothy J. Baek
00eb022450 refac 2024-09-28 02:38:59 +02:00
Timothy J. Baek
2428878f42 refac 2024-09-28 02:29:08 +02:00
Timothy J. Baek
af57a2c153 refac 2024-09-28 02:23:09 +02:00
Timothy J. Baek
a52e8cd537 refac 2024-09-28 01:35:31 +02:00
Timothy J. Baek
5b7cf88915 refac 2024-09-28 01:28:45 +02:00
Timothy J. Baek
e1103305f5 refac: "rag" endpoints renamed to "retrieval" 2024-09-28 01:27:46 +02:00
Timothy J. Baek
4ead3c5b80 chore: format 2024-09-27 19:43:40 +02:00
kivvi
e13614e11b
Fix: O1 does not support the system parameter 2024-09-27 22:47:24 +08:00
Timothy J. Baek
719f4da1dc fix: milvus collection creation issue 2024-09-26 22:59:09 +02:00
Hwang In Tak
4fe1f2487d
fix: Fix OpenAI batch embedding 2024-09-26 20:48:14 +09:00
Hwang In Tak
a4bc0b2829
fix: Fix OpenAI batch embedding 2024-09-26 20:39:40 +09:00
Timothy Jaeryang Baek
cc19b8049a
Merge pull request #5710 from kivvi3412/fix_o1_max_tokens
Fix: o1 input parameter must be max_completion_tokens
2024-09-26 03:03:15 +02:00
kivvi
405d0561df
Fix: o1 input parameter must be max_completion_tokens 2024-09-26 08:49:59 +08:00
Timothy J. Baek
ee33b4e2a3 fix: ollama /embed form_data 2024-09-25 22:34:02 +02:00
Timothy J. Baek
e19406cdd7 fix 2024-09-24 17:43:43 +02:00
Timothy J. Baek
3cee507687 fix: dev2 2024-09-24 16:19:24 +02:00
Timothy J. Baek
a44e9a8dda refac 2024-09-24 15:41:23 +02:00
Timothy J. Baek
504d910557 fix: no running event loop issue 2024-09-24 15:31:55 +02:00
Timothy J. Baek
e268ee5675 enh: audio/x-m4a support 2024-09-24 11:00:47 +02:00
Etienne Perot
fdd27aa321
fix: close temporary file after creating it.
This fixes "The process cannot access the file
because it is being used by another process"
errors on Windows.

The file is still automatically deleted by the
`os.unlink` call later in the function.

Updates #5606
Fixes #5642
2024-09-23 23:22:47 -07:00
Timothy J. Baek
c292fd89f9 refac 2024-09-22 02:55:45 +02:00
Timothy J. Baek
768717aaf9 refac 2024-09-22 02:35:25 +02:00
Timothy J. Baek
d055e1f888 refac 2024-09-22 02:14:59 +02:00
Timothy J. Baek
5f84145a2d enh: socket full redis support 2024-09-22 02:12:55 +02:00
Timothy J. Baek
e35883ca9c fix: openai payload issue 2024-09-21 21:35:00 +02:00
Timothy J. Baek
00f6b4bf09 refac 2024-09-21 15:35:35 +02:00
Timothy J. Baek
9126ceac08 fix: WEBUI_AUTH=False not working issue 2024-09-21 15:33:34 +02:00
Timothy Jaeryang Baek
273787fe78
Merge pull request #5541 from kivvi3412/fix-title-generate
[fix] Fix title generate
2024-09-21 03:58:28 +02:00
Timothy J. Baek
ee6b1376c3 fix: rag duplicate collection issue 2024-09-21 03:53:53 +02:00
kivvi
e1ea0c23eb Fixed the issue of being unable to generate titles 2024-09-21 09:06:28 +08:00
Timothy J. Baek
657d443a3e fix 2024-09-21 02:24:30 +02:00
Timothy J. Baek
ffd7d74f77 enh: websocket redis support 2024-09-20 23:43:22 +02:00
Timothy J. Baek
b7ad82757d refac 2024-09-20 03:18:14 +02:00
Timothy J. Baek
d12b6cda4e refac: openai image async gen 2024-09-20 03:16:08 +02:00
Timothy J. Baek
eb9ad47ef8 refac: temp tools & functions files 2024-09-20 00:12:52 +02:00
Timothy J. Baek
39c57c0e94 refac 2024-09-19 22:40:06 +02:00
Timothy J. Baek
9be73ea94a refac 2024-09-19 22:17:32 +02:00
Timothy J. Baek
cd117f5b67 refac 2024-09-19 21:51:45 +02:00
Timothy J. Baek
2dad9b9432 refac 2024-09-19 20:56:13 +02:00
Timothy J. Baek
cba2d31175 refac 2024-09-19 18:40:23 +02:00
Timothy J. Baek
a2b77fd072 refac 2024-09-19 18:08:52 +02:00
Timothy J. Baek
9b83e57372 refac 2024-09-19 17:46:11 +02:00
Timothy J. Baek
687cae9b79 refac 2024-09-19 17:31:59 +02:00