Timothy J. Baek
dea12360f4
refac: folder id -> uuid
2024-10-16 21:49:22 -07:00
Timothy J. Baek
a942c30ca8
feat: folder ui
2024-10-16 21:05:03 -07:00
Timothy J. Baek
ede71740d2
feat: folders table
2024-10-16 15:13:38 -07:00
Willnow, Patrick
b888ee17ff
Merge branch 'main' into dev
...
# Conflicts:
# backend/open_webui/main.py
2024-10-16 20:16:05 +02:00
Willnow, Patrick
57d54160d3
Merge branch 'implement-oauth-role-management'
...
# Conflicts:
# backend/open_webui/main.py
2024-10-16 16:54:43 +02:00
Willnow, Patrick
08ff494754
WIP
...
- refactoring oauth functions to enable refresh functionality
2024-10-16 09:42:47 +02:00
Timothy J. Baek
bf0043881a
refac
2024-10-15 03:11:03 -07:00
Timothy J. Baek
24f149f686
refac: pinned chat behaviour
2024-10-15 02:52:56 -07:00
Timothy J. Baek
b4cd503a02
refac
2024-10-15 02:51:08 -07:00
Timothy J. Baek
97bb9d41a6
refac
2024-10-15 02:48:41 -07:00
Timothy J. Baek
cf24a65caa
fix: duplicate tags
2024-10-14 23:04:10 -07:00
Timothy J. Baek
9d2d53bfb5
fix
2024-10-14 22:59:17 -07:00
Timothy J. Baek
6703cacb99
fix: tag unarchive/archive issue
2024-10-14 22:57:11 -07:00
Timothy J. Baek
d8a30bd6ae
refac: sidebar tag add behaviour
2024-10-14 21:21:45 -07:00
Timothy J. Baek
bc75870289
fix: tag search
2024-10-14 19:02:08 -07:00
Timothy J. Baek
8eb45acf10
refac
2024-10-14 18:47:41 -07:00
Timothy J. Baek
1db1ef7c26
refac: tag search
2024-10-14 17:31:52 -07:00
Timothy J. Baek
0b2c7046cd
fix: archived chats
2024-10-14 15:29:43 -07:00
Jannik Streidl
f0f4de59eb
Merge branch 'upstream-dev' into dev
2024-10-14 09:50:40 +02:00
Timothy J. Baek
ee8b8220f0
refac: OPENAI_MODEL_LIST_TIMEOUT -> AIOHTTP_CLIENT_TIMEOUT_OPENAI_MODEL_LIST
2024-10-13 22:56:33 -07:00
LuoChen
ebec6cd426
add: OPENAI_MODEL_LIST_TIMEOUT
2024-10-14 09:00:09 +08:00
Timothy J. Baek
586e005f0f
enh: token text splitter support
2024-10-13 04:24:13 -07:00
Timothy J. Baek
8a0da6d376
enh: include file name to context
2024-10-13 03:58:51 -07:00
Timothy J. Baek
797afd0b72
fix: embedding metadata issue
2024-10-13 03:25:11 -07:00
Timothy J. Baek
92605fd59f
refac
2024-10-13 03:16:18 -07:00
Timothy J. Baek
5ffd216fca
refac
2024-10-13 03:02:02 -07:00
Timothy J. Baek
dff3732fcd
enh: tiktoken/token splitter support
2024-10-13 02:07:50 -07:00
Timothy J. Baek
8ae605ec4b
fix: multi-user tags issue
2024-10-13 01:00:38 -07:00
Timothy J. Baek
5273dc4535
refac
2024-10-13 00:21:06 -07:00
Timothy J. Baek
112cbdccbb
revert: pdf gen
2024-10-13 00:05:28 -07:00
noczero
c41261e72b
feat: PDF generator to export chat
2024-10-13 11:20:09 +07:00
Timothy J. Baek
333317a7ce
refac: add embedding metadata
2024-10-12 18:30:21 -07:00
Jannik Streidl
f47c9c69e3
Merge branch 'upstream-dev' into dev
2024-10-12 15:18:59 +02:00
Timothy J. Baek
5a96fcbeaf
enh: enable selecting individual files from collection
2024-10-12 02:31:10 -07:00
Timothy J. Baek
428fd202c5
fix: custom comfyui prompt issue
2024-10-11 13:11:17 -07:00
Timothy Jaeryang Baek
db35ea0ae1
Merge pull request #6129 from open-webui/main
...
refac
2024-10-11 12:11:47 -07:00
Willnow, Patrick
1c5b6987e2
add missing env mapping
2024-10-11 14:08:11 +02:00
Timothy J. Baek
ba2df1c33a
refac
2024-10-11 00:00:13 -07:00
Timothy J. Baek
acb5dcf30a
refac: tags
2024-10-10 23:22:53 -07:00
Peter De-Ath
c748d33192
support list[str] | str as input
2024-10-10 22:41:57 +01:00
Willnow, Patrick
edc15d0d7c
rewrite oauth role management logic to allow any custom roles to be used for oauth role to open webui role mapping
2024-10-10 23:00:05 +02:00
JoeyShapiro
df824db042
fix: disallow empty files
2024-10-10 15:33:27 -05:00
Timothy J. Baek
e8babe62bc
refac
2024-10-10 12:51:00 -07:00
Jannik Streidl
741230bcdb
fix
2024-10-10 17:20:50 +02:00
Jannik Streidl
89c77f05a8
chromadb switch to cosine similarity
2024-10-10 16:46:14 +02:00
Timothy Jaeryang Baek
7e253df175
Merge pull request #6054 from jeeteshchel/bugfix/secure-cookie
...
fix: set token cookie secure and samesite per config
2024-10-09 12:15:19 -07:00
Timothy Jaeryang Baek
d7a71f3b34
Merge pull request #6050 from RobinBially/main
...
feat: add qdrant vector db connector
2024-10-09 12:12:48 -07:00
Timothy J. Baek
c157004e07
refac
2024-10-09 12:05:16 -07:00
Timothy J. Baek
451f1bae15
refac: embeddings function
2024-10-09 11:41:35 -07:00
Robin Bially
34150fc3ed
add NO_LIMIT var
2024-10-09 18:34:04 +02:00
Robin Bially
54dc94317c
improvements
2024-10-09 18:29:14 +02:00
Jeetesh Chellani
a2e889c8bb
fix: set oauth token secure and samesite per config
2024-10-09 14:50:48 +03:00
Robin Bially
2c59f2dcaf
fix critical bug
2024-10-09 13:23:04 +02:00
Robin Bially
b56f77ed47
improvements
2024-10-09 13:10:23 +02:00
Robin Bially
b185524a8c
Merge branch 'open-webui:main' into main
2024-10-09 12:52:13 +02:00
Robin Bially
878a570a2c
add qdrant as vector db
2024-10-09 12:51:43 +02:00
Timothy J. Baek
37fdb0ea2e
refac: move search to backend
2024-10-08 23:37:37 -07:00
Timothy J. Baek
d7a00af576
refac: convert chat.chat to json data type
2024-10-08 22:02:48 -07:00
Timothy Jaeryang Baek
a04f22d55f
Merge pull request #6044 from open-webui/main
...
dev
2024-10-08 20:30:00 -07:00
Timothy J. Baek
0da0e12096
refac: file download
2024-10-08 20:16:17 -07:00
Timothy J. Baek
3391a855f0
fix
2024-10-08 17:03:42 -07:00
Timothy J. Baek
0feaf6f649
refac
2024-10-08 13:39:27 -07:00
Timothy J. Baek
dcab991d44
fix: model dump issue
2024-10-08 11:05:57 -07:00
Peter De-Ath
885b9f1ece
refactor: Update GenerateEmbeddingsForm to support batch processing
...
refactor: Update embedding batch size handling in RAG configuration
refactor: add query_doc query caching
refactor: update logging statements in generate_chat_completion function
change embedding_batch_size to Optional
2024-10-08 00:04:35 +01:00
Timothy J. Baek
48e7f47558
refac
2024-10-07 14:03:42 -07:00
Jannik Streidl
9fc813cfa6
fix: only append if distances are available
2024-10-07 21:13:13 +02:00
Jannik Streidl
b105efa05f
enh: append citations with distance scores
2024-10-07 21:11:04 +02:00
Timothy J. Baek
ee22ba9676
fix: web, youtube attachment issue
2024-10-06 19:44:02 -07:00
Timothy J. Baek
05c15b017d
fix: milvus
2024-10-06 17:58:09 -07:00
Timothy J. Baek
da1e88a427
enh: __task_body__ param
2024-10-06 14:56:49 -07:00
Sylvere Richard
9706b76b36
feat: db pool config #5935
2024-10-06 17:20:10 +02:00
Timothy J. Baek
378223aedb
refac: comments
2024-10-05 10:08:48 -07:00
Timothy J. Baek
61b147441c
refac
2024-10-05 10:05:12 -07:00
Timothy J. Baek
1f9b5b6456
refac: retain metadata for collection
2024-10-05 09:58:46 -07:00
Timothy J. Baek
0bd88090bb
refac: DOCS_DIR deprecated
2024-10-05 01:45:22 -07:00
Timothy J. Baek
493745a70b
refac
2024-10-04 19:32:33 -07:00
Timothy J. Baek
a909aa1c20
enh: sync directory
2024-10-04 18:44:57 -07:00
Timothy J. Baek
e3889522d6
refac
2024-10-04 18:28:48 -07:00
Timothy J. Baek
79c005a041
refac: deprecate docs_dir
2024-10-04 18:22:55 -07:00
Timothy J. Baek
a6c797d4c2
refac: process docs dir
2024-10-04 17:22:00 -07:00
Timothy J. Baek
5017ca90ff
refac
2024-10-04 16:16:16 -07:00
Timothy J. Baek
8f22e911e0
fix: empty knowledge delete issue
2024-10-04 11:11:53 -07:00
Timothy J. Baek
d1b8af6220
chore: format
2024-10-04 01:04:04 -07:00
Timothy Jaeryang Baek
0876c9b5ef
Merge pull request #5829 from jannikstdl/query-embedding-perf-fix
...
fix: performance issues on large collections
2024-10-04 10:01:17 +02:00
Timothy Jaeryang Baek
ebc7da6f82
Merge pull request #5861 from open-webui/projects
...
feat: knowledge/projects
2024-10-04 10:00:47 +02:00
Timothy J. Baek
1fe1c27220
refac: legacy support
2024-10-04 00:59:19 -07:00
Timothy J. Baek
8013c152d0
feat: edit file content support
2024-10-04 00:46:32 -07:00
Timothy J. Baek
630a78cead
fix
2024-10-04 00:24:51 -07:00
Timothy J. Baek
17c772831d
refac
2024-10-04 00:23:14 -07:00
Timothy J. Baek
05970157f6
refac
2024-10-03 23:06:47 -07:00
Timothy J. Baek
d834bd2a18
refac
2024-10-03 22:35:43 -07:00
Timothy J. Baek
e9b68524e8
refac
2024-10-03 22:24:05 -07:00
Timothy J. Baek
b291271df3
refac
2024-10-03 22:22:22 -07:00
Timothy J. Baek
b862dff185
refac
2024-10-03 21:10:33 -07:00
Timothy J. Baek
6747478f67
refac
2024-10-03 21:05:55 -07:00
Timothy J. Baek
124a17e826
refac
2024-10-03 20:58:56 -07:00
Timothy J. Baek
57360b7a61
refac
2024-10-03 20:51:21 -07:00
Willnow, Patrick
dc92178641
Fix missing key mapping
2024-10-03 20:55:32 +02:00
Timothy J. Baek
2fc07fd6a2
enh: vector db hash collision check
2024-10-03 06:53:21 -07:00
Timothy J. Baek
78413d0c2e
enh: add/remove file from knowledge
2024-10-03 06:46:20 -07:00
Timothy J. Baek
15a3c6b171
refac
2024-10-03 06:45:15 -07:00
Timothy J. Baek
d394f8b7be
enh: add to vector db support
2024-10-03 06:44:17 -07:00
Timothy J. Baek
325ca98773
enh: vector db delete filter support
2024-10-03 06:43:50 -07:00
Timothy J. Baek
351b1dbf31
refac
2024-10-02 21:14:58 -07:00
Timothy J. Baek
a2eadb30f5
refac
2024-10-02 20:42:10 -07:00
Jun Siang Cheah
318f61161e
refac: lazy load big dependencies to reduce min memory usage
2024-10-02 22:18:42 +01:00
Timothy J. Baek
4aca1e86ad
refac
2024-10-02 06:19:09 -07:00
Timothy J. Baek
08969ecf89
refac: rename projects -> knowledge
2024-10-01 22:45:04 -07:00
Timothy J. Baek
5933d7a216
enh: sort by descending order
2024-10-01 21:35:18 -07:00
Timothy J. Baek
1b7d363d32
refac
2024-10-01 21:32:59 -07:00
Timothy J. Baek
c5eb0a9732
refac: documents -> projects
2024-10-01 17:35:35 -07:00
Timothy J. Baek
fb083237cd
refac
2024-10-01 14:00:19 -07:00
Timothy J. Baek
a0fb4a9b84
refac
2024-10-01 13:13:39 -07:00
Timothy J. Baek
5c9dd25459
refac: files migration
2024-10-01 11:01:26 -07:00
Timothy J. Baek
0907c32e10
refac
2024-10-01 09:51:58 -07:00
Timothy J. Baek
c7a0e45bea
refac
2024-09-30 16:32:38 +02:00
Jannik Streidl
6bff5a4d09
fix: do not embed the query every single time
2024-09-30 16:18:02 +02:00
Timothy J. Baek
1c4b6b9cd9
refac
2024-09-30 01:00:13 +02:00
Timothy J. Baek
3899405864
refac
2024-09-30 00:39:30 +02:00
Timothy J. Baek
7152af949b
feat: compress audio
...
Co-Authored-By: Beck Bekmyradov <47065940+bekmuradov@users.noreply.github.com>
2024-09-30 00:30:12 +02:00
Timothy J. Baek
8206c47a47
refac
2024-09-29 23:20:37 +02:00
Timothy J. Baek
6afc686e17
refac
2024-09-29 23:08:55 +02:00
Timothy J. Baek
677c36c3aa
refac
2024-09-29 22:55:53 +02:00
Timothy J. Baek
6d764ee55e
feat: retrieval whole document mode
2024-09-29 22:52:27 +02:00
Timothy J. Baek
92dd173b27
refac
2024-09-29 18:55:26 +02:00
Timothy J. Baek
c93a10388b
refac
2024-09-28 19:51:28 +02:00
Timothy J. Baek
276ce3374d
refac
2024-09-28 19:17:21 +02:00
Timothy J. Baek
e77c3ab043
refac
2024-09-28 19:16:52 +02:00
Timothy J. Baek
90ec458c4c
enh: show extracted file content
2024-09-28 10:53:25 +02:00
Timothy J. Baek
9d2ed3d2be
refac
2024-09-28 02:56:56 +02:00
Timothy J. Baek
b8b994a820
refac
2024-09-28 02:49:18 +02:00
Timothy J. Baek
00eb022450
refac
2024-09-28 02:38:59 +02:00
Timothy J. Baek
2428878f42
refac
2024-09-28 02:29:08 +02:00
Timothy J. Baek
af57a2c153
refac
2024-09-28 02:23:09 +02:00
Timothy J. Baek
a52e8cd537
refac
2024-09-28 01:35:31 +02:00
Timothy J. Baek
5b7cf88915
refac
2024-09-28 01:28:45 +02:00
Timothy J. Baek
e1103305f5
refac: "rag" endpoints renamed to "retrieval"
2024-09-28 01:27:46 +02:00
Timothy J. Baek
4ead3c5b80
chore: format
2024-09-27 19:43:40 +02:00
kivvi
e13614e11b
Fix: O1 does not support the system parameter
2024-09-27 22:47:24 +08:00
Timothy J. Baek
719f4da1dc
fix: milvus collection creation issue
2024-09-26 22:59:09 +02:00
Hwang In Tak
4fe1f2487d
fix: Fix OpenAI batch embedding
2024-09-26 20:48:14 +09:00
Hwang In Tak
a4bc0b2829
fix: Fix OpenAI batch embedding
2024-09-26 20:39:40 +09:00
Timothy Jaeryang Baek
cc19b8049a
Merge pull request #5710 from kivvi3412/fix_o1_max_tokens
...
Fix: o1 input parameter must be max_completion_tokens
2024-09-26 03:03:15 +02:00
kivvi
405d0561df
Fix: o1 input parameter must be max_completion_tokens
2024-09-26 08:49:59 +08:00
Timothy J. Baek
ee33b4e2a3
fix: ollama /embed form_data
2024-09-25 22:34:02 +02:00
Timothy J. Baek
e19406cdd7
fix
2024-09-24 17:43:43 +02:00
Timothy J. Baek
3cee507687
fix: dev2
2024-09-24 16:19:24 +02:00
Timothy J. Baek
a44e9a8dda
refac
2024-09-24 15:41:23 +02:00
Timothy J. Baek
504d910557
fix: no running event loop issue
2024-09-24 15:31:55 +02:00
Timothy J. Baek
e268ee5675
enh: audio/x-m4a support
2024-09-24 11:00:47 +02:00
Etienne Perot
fdd27aa321
fix: close temporary file after creating it.
...
This fixes "The process cannot access the file
because it is being used by another process"
errors on Windows.
The file is still automatically deleted by the
`os.unlink` call later in the function.
Updates #5606
Fixes #5642
2024-09-23 23:22:47 -07:00
Timothy J. Baek
c292fd89f9
refac
2024-09-22 02:55:45 +02:00
Timothy J. Baek
768717aaf9
refac
2024-09-22 02:35:25 +02:00
Timothy J. Baek
d055e1f888
refac
2024-09-22 02:14:59 +02:00
Timothy J. Baek
5f84145a2d
enh: socket full redis support
2024-09-22 02:12:55 +02:00
Timothy J. Baek
e35883ca9c
fix: openai payload issue
2024-09-21 21:35:00 +02:00
Timothy J. Baek
00f6b4bf09
refac
2024-09-21 15:35:35 +02:00
Timothy J. Baek
9126ceac08
fix: WEBUI_AUTH=False not working issue
2024-09-21 15:33:34 +02:00
Timothy Jaeryang Baek
273787fe78
Merge pull request #5541 from kivvi3412/fix-title-generate
...
[fix] Fix title generate
2024-09-21 03:58:28 +02:00
Timothy J. Baek
ee6b1376c3
fix: rag duplicate collection issue
2024-09-21 03:53:53 +02:00
kivvi
e1ea0c23eb
Fixed the issue of being unable to generate titles
2024-09-21 09:06:28 +08:00
Timothy J. Baek
657d443a3e
fix
2024-09-21 02:24:30 +02:00
Timothy J. Baek
ffd7d74f77
enh: websocket redis support
2024-09-20 23:43:22 +02:00
Timothy J. Baek
b7ad82757d
refac
2024-09-20 03:18:14 +02:00
Timothy J. Baek
d12b6cda4e
refac: openai image async gen
2024-09-20 03:16:08 +02:00
Timothy J. Baek
eb9ad47ef8
refac: temp tools & functions files
2024-09-20 00:12:52 +02:00
Timothy J. Baek
39c57c0e94
refac
2024-09-19 22:40:06 +02:00
Timothy J. Baek
9be73ea94a
refac
2024-09-19 22:17:32 +02:00
Timothy J. Baek
cd117f5b67
refac
2024-09-19 21:51:45 +02:00
Timothy J. Baek
2dad9b9432
refac
2024-09-19 20:56:13 +02:00
Timothy J. Baek
cba2d31175
refac
2024-09-19 18:40:23 +02:00
Timothy J. Baek
a2b77fd072
refac
2024-09-19 18:08:52 +02:00
Timothy J. Baek
9b83e57372
refac
2024-09-19 17:46:11 +02:00
Timothy J. Baek
687cae9b79
refac
2024-09-19 17:31:59 +02:00
Timothy J. Baek
7b330d1490
refac
2024-09-19 17:05:49 +02:00
Timothy J. Baek
8426874426
fix
2024-09-19 16:54:34 +02:00
Timothy J. Baek
ff737a9e25
enh: openai error message handling
2024-09-19 16:20:00 +02:00
Timothy Jaeryang Baek
d52eaf19d6
Merge pull request #5511 from EtiennePerot/import-file
...
fix: restore `__file__` variable for imported toolkits and functions
2024-09-19 15:29:34 +02:00
Timothy Jaeryang Baek
5d3a89dd25
Merge pull request #5496 from pawel-ochman/azure-tts
...
Integrate Azure Speech service for TTS
2024-09-19 02:42:45 +02:00
Timothy J. Baek
afa42dd2e4
refac
2024-09-19 02:40:54 +02:00
Pawel Ochman
4d9677e808
Update configuration page, expose all Azure settings through ENV variables
2024-09-18 14:13:42 +01:00
Pawel Ochman
eacb69074e
remove dependency and migrate to raw rest calls
2024-09-18 12:24:55 +01:00
Etienne Perot
6477bf37fe
fix: restore __file__
variable for imported toolkits and functions
...
Commit cf86ba7786
changed the way toolkits
and functions were imported to use `exec`, whereas they previously were
written to files and `import`ed. The use of `exec` means that
module-global variables such as `__file__` are no longer defined.
This breaks https://github.com/EtiennePerot/open-webui-code-execution
(code execution tool for Open WebUI), as the module needs to re-execute
its own code in a subprocess in order to properly sandbox itself. This
is done using `__file__` in order to know where the module's code is
located.
This PR creates a temporary in-memory file that contains the imported
toolkit or function's code and exists only during the import process.
Then it injects the path to this in-memory file as the `__file__`
variable in the `exec` context. This restores the ability for the
toolkit or function being imported to rely on `__file__`.
2024-09-18 01:08:30 -07:00
Timothy J. Baek
7a9c0946a4
refac
2024-09-17 23:13:51 +02:00
Timothy J. Baek
7e0a26ef4e
refac
2024-09-17 23:07:04 +02:00
Timothy J. Baek
67f95ddfdc
refac
2024-09-17 22:58:06 +02:00
Pawel Ochman
d6b68f405e
added azure speech service support
2024-09-17 09:13:10 +01:00
Timothy J. Baek
06debb322b
refac: colbert cuda support
2024-09-16 12:42:48 +02:00
Timothy J. Baek
b7f0759485
refac
2024-09-16 12:36:43 +02:00
Timothy J. Baek
bc6f23f82f
fix
2024-09-16 12:33:55 +02:00
Timothy J. Baek
cb9e76c7f9
refac: default rag template
2024-09-16 12:01:04 +02:00
Timothy J. Baek
b38986a0aa
enh: colbert rerank support
2024-09-16 11:46:39 +02:00
Timothy J. Baek
db0c576f48
refac
2024-09-16 07:14:17 +02:00
Timothy J. Baek
d0df2cbe53
fix: disable "enable new sign ups" not working issue
2024-09-14 23:13:52 +01:00
Timothy Jaeryang Baek
27baa00afb
Merge pull request #5419 from cheahjs/fix/remove-doc-support
...
fix: remove unsupported .doc file ingest
2024-09-14 22:52:40 +01:00
Timothy J. Baek
869063c743
refac: better reranking model error handling
2024-09-14 20:58:42 +01:00
Jun Siang Cheah
3199e26500
fix: remove unsupported .doc file ingest
2024-09-14 12:44:51 +01:00
Timothy Jaeryang Baek
d75d638b9a
Merge pull request #5406 from open-webui/main
...
refac
2024-09-13 19:26:51 +01:00
Timothy J. Baek
b64c9d966a
refac
2024-09-13 14:26:32 -04:00
Timothy Jaeryang Baek
8a928e5356
Merge pull request #5405 from open-webui/main
...
refac: filter non chat completions models
2024-09-13 19:23:02 +01:00