468 Commits

Author	SHA1	Message	Date
Timothy J. Baek	0b2c7046cd	fix: archived chats	2024-10-14 15:29:43 -07:00
Timothy J. Baek	f0179270e2	fix: tag migration	2024-10-14 13:45:09 -07:00
Jannik Streidl	f0f4de59eb	Merge branch 'upstream-dev' into dev	2024-10-14 09:50:40 +02:00
Timothy Jaeryang Baek	6233494ed1	Merge pull request #6179 from shirayu/fix_typos ... fix: Fix typos	2024-10-14 00:29:59 -07:00
Timothy J. Baek	dce91a8557	fix: custom model action button issue	2024-10-14 00:28:21 -07:00
Yuta Hayashibe	12516c8a45	fix: Fix typos	2024-10-14 16:22:07 +09:00
Timothy J. Baek	ee8b8220f0	refac: OPENAI_MODEL_LIST_TIMEOUT -> AIOHTTP_CLIENT_TIMEOUT_OPENAI_MODEL_LIST	2024-10-13 22:56:33 -07:00
LuoChen	ebec6cd426	add: OPENAI_MODEL_LIST_TIMEOUT	2024-10-14 09:00:09 +08:00
Timothy J. Baek	586e005f0f	enh: token text splitter support	2024-10-13 04:24:13 -07:00
Timothy J. Baek	8a0da6d376	enh: include file name to context	2024-10-13 03:58:51 -07:00
Timothy J. Baek	797afd0b72	fix: embedding metadata issue	2024-10-13 03:25:11 -07:00
Timothy J. Baek	92605fd59f	refac	2024-10-13 03:16:18 -07:00
Timothy J. Baek	5ffd216fca	refac	2024-10-13 03:02:02 -07:00
Timothy J. Baek	dff3732fcd	enh: tiktoken/token splitter support	2024-10-13 02:07:50 -07:00
Timothy J. Baek	8ae605ec4b	fix: multi-user tags issue	2024-10-13 01:00:38 -07:00
Timothy J. Baek	5273dc4535	refac	2024-10-13 00:21:06 -07:00
Timothy J. Baek	112cbdccbb	revert: pdf gen	2024-10-13 00:05:28 -07:00
noczero	c41261e72b	feat: PDF generator to export chat	2024-10-13 11:20:09 +07:00
Timothy J. Baek	333317a7ce	refac: add embedding metadata	2024-10-12 18:30:21 -07:00
Jannik Streidl	f47c9c69e3	Merge branch 'upstream-dev' into dev	2024-10-12 15:18:59 +02:00
Timothy J. Baek	5a96fcbeaf	enh: enable selecting individual files from collection	2024-10-12 02:31:10 -07:00
Timothy J. Baek	11d7aec61d	fix	2024-10-11 16:21:56 -07:00
Timothy J. Baek	30d3d28b9f	refac	2024-10-11 15:37:46 -07:00
Timothy J. Baek	1cad157071	fix	2024-10-11 15:29:58 -07:00
Timothy J. Baek	428fd202c5	fix: custom comfyui prompt issue	2024-10-11 13:11:17 -07:00
Timothy Jaeryang Baek	db35ea0ae1	Merge pull request #6129 from open-webui/main ... refac	2024-10-11 12:11:47 -07:00
Willnow, Patrick	1c5b6987e2	add missing env mapping	2024-10-11 14:08:11 +02:00
Timothy J. Baek	ba2df1c33a	refac	2024-10-11 00:00:13 -07:00
Timothy J. Baek	acb5dcf30a	refac: tags	2024-10-10 23:22:53 -07:00
Peter De-Ath	c748d33192	support list[str] | str as input	2024-10-10 22:41:57 +01:00
Willnow, Patrick	edc15d0d7c	rewrite oauth role management logic to allow any custom roles to be used for oauth role to open webui role mapping	2024-10-10 23:00:05 +02:00
JoeyShapiro	df824db042	fix: disallow empty files	2024-10-10 15:33:27 -05:00
Timothy J. Baek	e8babe62bc	refac	2024-10-10 12:51:00 -07:00
Jannik Streidl	741230bcdb	fix	2024-10-10 17:20:50 +02:00
Jannik Streidl	89c77f05a8	chromadb switch to cosine similarity	2024-10-10 16:46:14 +02:00
Timothy Jaeryang Baek	7e253df175	Merge pull request #6054 from jeeteshchel/bugfix/secure-cookie ... fix: set token cookie secure and samesite per config	2024-10-09 12:15:19 -07:00
Timothy Jaeryang Baek	d7a71f3b34	Merge pull request #6050 from RobinBially/main ... feat: add qdrant vector db connector	2024-10-09 12:12:48 -07:00
Timothy J. Baek	c157004e07	refac	2024-10-09 12:05:16 -07:00
Timothy J. Baek	451f1bae15	refac: embeddings function	2024-10-09 11:41:35 -07:00
Robin Bially	34150fc3ed	add NO_LIMIT var	2024-10-09 18:34:04 +02:00
Robin Bially	54dc94317c	improvements	2024-10-09 18:29:14 +02:00
Jeetesh Chellani	a2e889c8bb	fix: set oauth token secure and samesite per config	2024-10-09 14:50:48 +03:00
Robin Bially	2c59f2dcaf	fix critical bug	2024-10-09 13:23:04 +02:00
Robin Bially	b56f77ed47	improvements	2024-10-09 13:10:23 +02:00
Robin Bially	b185524a8c	Merge branch 'open-webui:main' into main	2024-10-09 12:52:13 +02:00
Robin Bially	878a570a2c	add qdrant as vector db	2024-10-09 12:51:43 +02:00
Timothy J. Baek	37fdb0ea2e	refac: move search to backend	2024-10-08 23:37:37 -07:00
Timothy J. Baek	d7a00af576	refac: convert chat.chat to json data type	2024-10-08 22:02:48 -07:00
Timothy Jaeryang Baek	a04f22d55f	Merge pull request #6044 from open-webui/main ... dev	2024-10-08 20:30:00 -07:00
Timothy J. Baek	0da0e12096	refac: file download	2024-10-08 20:16:17 -07:00
Timothy J. Baek	3391a855f0	fix	2024-10-08 17:03:42 -07:00
Timothy J. Baek	0feaf6f649	refac	2024-10-08 13:39:27 -07:00
Timothy J. Baek	595cf191fb	chore: rm documents	2024-10-08 13:38:16 -07:00
Timothy J. Baek	dcab991d44	fix: model dump issue	2024-10-08 11:05:57 -07:00
Saravanan Palanisamy	16dd352524	add offline_mode and disable version check	2024-10-08 09:13:49 +04:00
Timothy Jaeryang Baek	d05c2f56ea	Merge pull request #4715 from Peter-De-Ath/ollama-batch-embeddings ... feat: support ollama batch processing embeddings	2024-10-07 18:32:08 -07:00
Timothy J. Baek	f099b277c8	enh: youtube watch param support	2024-10-07 18:19:13 -07:00
Peter De-Ath	b242460874	formatting	2024-10-08 00:04:35 +01:00
Peter De-Ath	3fcdca2f28	backwards comp: use RAG_EMBEDDING_OPENAI_BATCH_SIZE	2024-10-08 00:04:35 +01:00
Peter De-Ath	885b9f1ece	refactor: Update GenerateEmbeddingsForm to support batch processing ... refactor: Update embedding batch size handling in RAG configuration refactor: add query_doc query caching refactor: update logging statements in generate_chat_completion function change embedding_batch_size to Optional	2024-10-08 00:04:35 +01:00
Timothy J. Baek	48e7f47558	refac	2024-10-07 14:03:42 -07:00
Jannik Streidl	9fc813cfa6	fix: only append if distances are available	2024-10-07 21:13:13 +02:00
Jannik Streidl	b105efa05f	enh: append citations with distance scores	2024-10-07 21:11:04 +02:00
Timothy J. Baek	ee22ba9676	fix: web, youtube attachment issue	2024-10-06 19:44:02 -07:00
Timothy J. Baek	05c15b017d	fix: milvus	2024-10-06 17:58:09 -07:00
Timothy J. Baek	da1e88a427	enh: __task_body__ param	2024-10-06 14:56:49 -07:00
Timothy J. Baek	d23f05fe0a	refac	2024-10-06 14:52:12 -07:00
Sylvere Richard	9706b76b36	feat: db pool config #5935	2024-10-06 17:20:10 +02:00
Timothy J. Baek	55d0ecc879	refac	2024-10-05 12:41:18 -07:00
Timothy J. Baek	614f3d5f80	fix	2024-10-05 12:40:13 -07:00
Timothy J. Baek	378223aedb	refac: comments	2024-10-05 10:08:48 -07:00
Timothy J. Baek	61b147441c	refac	2024-10-05 10:05:12 -07:00
Timothy J. Baek	1f9b5b6456	refac: retain metadata for collection	2024-10-05 09:58:46 -07:00
Timothy J. Baek	0bd88090bb	refac: DOCS_DIR deprecated	2024-10-05 01:45:22 -07:00
Timothy J. Baek	493745a70b	refac	2024-10-04 19:32:33 -07:00
Timothy J. Baek	a909aa1c20	enh: sync directory	2024-10-04 18:44:57 -07:00
Timothy J. Baek	e3889522d6	refac	2024-10-04 18:28:48 -07:00
Timothy J. Baek	79c005a041	refac: deprecate docs_dir	2024-10-04 18:22:55 -07:00
Timothy J. Baek	a6c797d4c2	refac: process docs dir	2024-10-04 17:22:00 -07:00
Timothy J. Baek	5017ca90ff	refac	2024-10-04 16:16:16 -07:00
Timothy J. Baek	8f22e911e0	fix: empty knowledge delete issue	2024-10-04 11:11:53 -07:00
Willnow, Patrick	f751d22a20	Refinement	2024-10-04 13:26:49 +02:00
Patrick Willnow	6ddd8c7241	fix logic	2024-10-04 10:14:20 +02:00
Timothy J. Baek	d1b8af6220	chore: format	2024-10-04 01:04:04 -07:00
Timothy Jaeryang Baek	0876c9b5ef	Merge pull request #5829 from jannikstdl/query-embedding-perf-fix ... fix: performance issues on large collections	2024-10-04 10:01:17 +02:00
Timothy Jaeryang Baek	ebc7da6f82	Merge pull request #5861 from open-webui/projects ... feat: knowledge/projects	2024-10-04 10:00:47 +02:00
Timothy J. Baek	1fe1c27220	refac: legacy support	2024-10-04 00:59:19 -07:00
Timothy J. Baek	8013c152d0	feat: edit file content support	2024-10-04 00:46:32 -07:00
Timothy J. Baek	630a78cead	fix	2024-10-04 00:24:51 -07:00
Timothy J. Baek	17c772831d	refac	2024-10-04 00:23:14 -07:00
Timothy J. Baek	05970157f6	refac	2024-10-03 23:06:47 -07:00
Timothy J. Baek	d834bd2a18	refac	2024-10-03 22:35:43 -07:00
Timothy J. Baek	e9b68524e8	refac	2024-10-03 22:24:05 -07:00
Timothy J. Baek	b291271df3	refac	2024-10-03 22:22:22 -07:00
Timothy J. Baek	b862dff185	refac	2024-10-03 21:10:33 -07:00
Timothy J. Baek	6747478f67	refac	2024-10-03 21:05:55 -07:00
Timothy J. Baek	124a17e826	refac	2024-10-03 20:58:56 -07:00
Timothy J. Baek	57360b7a61	refac	2024-10-03 20:51:21 -07:00
Willnow, Patrick	79b9c8a677	handling no claim received when nested expected	2024-10-04 00:05:36 +02:00
Willnow, Patrick	8e4776ada1	add handling nested claims...	2024-10-03 23:25:00 +02:00
Willnow, Patrick	5b2e1ca7cd	add more logging	2024-10-03 23:06:05 +02:00
Willnow, Patrick	0a7373dae1	add pending as role fallback ... add logging to determine correct handling of oauth roles	2024-10-03 22:56:52 +02:00
Willnow, Patrick	c9d948f284	Remove copy pasta error of calling value on bool	2024-10-03 21:38:56 +02:00
Willnow, Patrick	dc92178641	Fix missing key mapping	2024-10-03 20:55:32 +02:00
Timothy J. Baek	2fc07fd6a2	enh: vector db hash collision check	2024-10-03 06:53:21 -07:00
Timothy J. Baek	78413d0c2e	enh: add/remove file from knowledge	2024-10-03 06:46:20 -07:00
Timothy J. Baek	15a3c6b171	refac	2024-10-03 06:45:15 -07:00
Timothy J. Baek	d394f8b7be	enh: add to vector db support	2024-10-03 06:44:17 -07:00
Timothy J. Baek	325ca98773	enh: vector db delete filter support	2024-10-03 06:43:50 -07:00
Patrick Willnow	9a691c0387	Add oauth role mapping ... also add node env to allow local build to succeed	2024-10-03 11:12:14 +02:00
Timothy J. Baek	351b1dbf31	refac	2024-10-02 21:14:58 -07:00
Timothy J. Baek	a2eadb30f5	refac	2024-10-02 20:42:10 -07:00
Timothy Jaeryang Baek	2e7e346e19	Merge pull request #5871 from tcgumus/dev ... fix: Unsupported JSON schema type {type_}	2024-10-03 05:07:30 +02:00
Jun Siang Cheah	318f61161e	refac: lazy load big dependencies to reduce min memory usage	2024-10-02 22:18:42 +01:00
Timothy J. Baek	4aca1e86ad	refac	2024-10-02 06:19:09 -07:00
t	bdb2ce9448	fix: Unsupported JSON schema type {type_}	2024-10-02 15:34:48 +03:00
Timothy J. Baek	08969ecf89	refac: rename projects -> knowledge	2024-10-01 22:45:04 -07:00
Timothy J. Baek	3e012f0219	refac	2024-10-01 21:48:15 -07:00
Timothy J. Baek	5933d7a216	enh: sort by descending order	2024-10-01 21:35:18 -07:00
Timothy J. Baek	1b7d363d32	refac	2024-10-01 21:32:59 -07:00
Timothy J. Baek	c2732a0990	refac	2024-10-01 17:46:56 -07:00
Timothy J. Baek	c5eb0a9732	refac: documents -> projects	2024-10-01 17:35:35 -07:00
Timothy J. Baek	bf57dd808e	feat: project migration	2024-10-01 17:35:10 -07:00
Timothy J. Baek	fb083237cd	refac	2024-10-01 14:00:19 -07:00
Timothy J. Baek	a0fb4a9b84	refac	2024-10-01 13:13:39 -07:00
Timothy J. Baek	5c9dd25459	refac: files migration	2024-10-01 11:01:26 -07:00
Timothy J. Baek	0907c32e10	refac	2024-10-01 09:51:58 -07:00
Timothy J. Baek	4752df9bd8	refac	2024-10-01 09:40:08 -07:00
Timothy J. Baek	c7a0e45bea	refac	2024-09-30 16:32:38 +02:00
Jannik Streidl	6bff5a4d09	fix: do not embed the query every single time	2024-09-30 16:18:02 +02:00
Timothy J. Baek	1c4b6b9cd9	refac	2024-09-30 01:00:13 +02:00
Timothy J. Baek	3899405864	refac	2024-09-30 00:39:30 +02:00
Timothy J. Baek	7152af949b	feat: compress audio ... Co-Authored-By: Beck Bekmyradov <47065940+bekmuradov@users.noreply.github.com>	2024-09-30 00:30:12 +02:00
Timothy J. Baek	8206c47a47	refac	2024-09-29 23:20:37 +02:00
Timothy J. Baek	6afc686e17	refac	2024-09-29 23:08:55 +02:00
Timothy J. Baek	677c36c3aa	refac	2024-09-29 22:55:53 +02:00
Timothy J. Baek	6d764ee55e	feat: retrieval whole document mode	2024-09-29 22:52:27 +02:00
Timothy J. Baek	92dd173b27	refac	2024-09-29 18:55:26 +02:00
Timothy J. Baek	c93a10388b	refac	2024-09-28 19:51:28 +02:00
Timothy J. Baek	276ce3374d	refac	2024-09-28 19:17:21 +02:00
Timothy J. Baek	e77c3ab043	refac	2024-09-28 19:16:52 +02:00
Timothy J. Baek	90ec458c4c	enh: show extracted file content	2024-09-28 10:53:25 +02:00
smonux	e039b4ec54	Merge branch 'open-webui:dev' into dev	2024-09-28 06:01:26 +02:00
Timothy J. Baek	9d2ed3d2be	refac	2024-09-28 02:56:56 +02:00
Timothy J. Baek	b8b994a820	refac	2024-09-28 02:49:18 +02:00
Timothy J. Baek	00eb022450	refac	2024-09-28 02:38:59 +02:00
Timothy J. Baek	2428878f42	refac	2024-09-28 02:29:08 +02:00
Timothy J. Baek	af57a2c153	refac	2024-09-28 02:23:09 +02:00
Timothy J. Baek	a52e8cd537	refac	2024-09-28 01:35:31 +02:00
Timothy J. Baek	5b7cf88915	refac	2024-09-28 01:28:45 +02:00
Timothy J. Baek	e1103305f5	refac: "rag" endpoints renamed to "retrieval"	2024-09-28 01:27:46 +02:00
Timothy Jaeryang Baek	6e9db3e3c8	Merge pull request #5773 from HaldiH/main ... fix: Chat completion 401 when no Authorization header	2024-09-27 21:34:58 +02:00
Hugo Haldi	eab30781e0	Chat completion 401 when no Authorization header ... When we send a request to `/api/chat/completions` without the `Authorization` header, the server just crashes and creates a stack trace, returning "Internal Server Error" to the calling client. With this fix, the server sends a 401 to the client with the content `{"detail": "Not authenticated"}`.	2024-09-27 20:04:45 +02:00
Timothy Jaeryang Baek	c30c876659	Merge pull request #5758 from kivvi3412/fix_o1_system_message ... Fix: O1 does not support the system parameter	2024-09-27 19:44:16 +02:00
Timothy J. Baek	4ead3c5b80	chore: format	2024-09-27 19:43:40 +02:00
kivvi	e13614e11b	Fix: O1 does not support the system parameter	2024-09-27 22:47:24 +08:00
Timothy J. Baek	0bd9d59c78	refac: update check timeout	2024-09-27 14:38:56 +02:00
Timothy J. Baek	719f4da1dc	fix: milvus collection creation issue	2024-09-26 22:59:09 +02:00
smonux	d8f71e1d7f	Some models produce almost correct json during function calling, but with additional data before of after it. This solves it.	2024-09-26 22:02:56 +02:00
Hwang In Tak	4fe1f2487d	fix: Fix OpenAI batch embedding	2024-09-26 20:48:14 +09:00
Hwang In Tak	a4bc0b2829	fix: Fix OpenAI batch embedding	2024-09-26 20:39:40 +09:00
Timothy J. Baek	9d25207b83	refac	2024-09-26 03:13:38 +02:00
Timothy Jaeryang Baek	cc19b8049a	Merge pull request #5710 from kivvi3412/fix_o1_max_tokens ... Fix: o1 input parameter must be max_completion_tokens	2024-09-26 03:03:15 +02:00
Timothy J. Baek	3a163b6392	fix: pip install database save issue	2024-09-26 03:02:08 +02:00
kivvi	405d0561df	Fix: o1 input parameter must be max_completion_tokens	2024-09-26 08:49:59 +08:00
Timothy J. Baek	ee33b4e2a3	fix: ollama /embed form_data	2024-09-25 22:34:02 +02:00
Timothy J. Baek	92b1acd6fb	fix: RESET_CONFIG_ON_START not working	2024-09-25 01:06:11 +02:00
Timothy J. Baek	e19406cdd7	fix	2024-09-24 17:43:43 +02:00
Timothy J. Baek	3cee507687	fix: dev2	2024-09-24 16:19:24 +02:00
Timothy J. Baek	ff651ddc36	fix: dev1	2024-09-24 16:07:49 +02:00
Timothy J. Baek	a44e9a8dda	refac	2024-09-24 15:41:23 +02:00
Timothy J. Baek	504d910557	fix: no running event loop issue	2024-09-24 15:31:55 +02:00
Timothy J. Baek	31b311c3c9	refac ... Co-Authored-By: MicroDev <70126934+microdev1@users.noreply.github.com>	2024-09-24 13:28:00 +02:00
Timothy J. Baek	e268ee5675	enh: audio/x-m4a support	2024-09-24 11:00:47 +02:00
Etienne Perot	fdd27aa321	fix: close temporary file after creating it. ... This fixes "The process cannot access the file because it is being used by another process" errors on Windows. The file is still automatically deleted by the `os.unlink` call later in the function. Updates #5606 Fixes #5642	2024-09-23 23:22:47 -07:00
Timothy J. Baek	c292fd89f9	refac	2024-09-22 02:55:45 +02:00
Timothy J. Baek	768717aaf9	refac	2024-09-22 02:35:25 +02:00
Timothy J. Baek	d055e1f888	refac	2024-09-22 02:14:59 +02:00
Timothy J. Baek	5f84145a2d	enh: socket full redis support	2024-09-22 02:12:55 +02:00
Timothy J. Baek	e35883ca9c	fix: openai payload issue	2024-09-21 21:35:00 +02:00
Timothy J. Baek	00f6b4bf09	refac	2024-09-21 15:35:35 +02:00
Timothy J. Baek	9126ceac08	fix: WEBUI_AUTH=False not working issue	2024-09-21 15:33:34 +02:00
Timothy Jaeryang Baek	273787fe78	Merge pull request #5541 from kivvi3412/fix-title-generate ... [fix] Fix title generate	2024-09-21 03:58:28 +02:00
Timothy J. Baek	ee6b1376c3	fix: rag duplicate collection issue	2024-09-21 03:53:53 +02:00
kivvi	e1ea0c23eb	Fixed the issue of being unable to generate titles	2024-09-21 09:06:28 +08:00
Timothy J. Baek	657d443a3e	fix	2024-09-21 02:24:30 +02:00
Timothy J. Baek	95985e7bbb	refac	2024-09-21 02:03:58 +02:00
Timothy J. Baek	3a0a1aca11	refac: task ollama stream support	2024-09-21 01:07:57 +02:00
Timothy J. Baek	41926172d3	fix/refac: use ollama /api/chat endpoint for tasks	2024-09-21 00:30:13 +02:00
Timothy J. Baek	585b9eb84a	refac	2024-09-20 23:48:03 +02:00
Timothy J. Baek	ffd7d74f77	enh: websocket redis support	2024-09-20 23:43:22 +02:00
Timothy J. Baek	b7ad82757d	refac	2024-09-20 03:18:14 +02:00
Timothy J. Baek	d12b6cda4e	refac: openai image async gen	2024-09-20 03:16:08 +02:00
Timothy J. Baek	eb9ad47ef8	refac: temp tools & functions files	2024-09-20 00:12:52 +02:00
Timothy J. Baek	39c57c0e94	refac	2024-09-19 22:40:06 +02:00
Timothy J. Baek	9be73ea94a	refac	2024-09-19 22:17:32 +02:00
Timothy J. Baek	cd117f5b67	refac	2024-09-19 21:51:45 +02:00
Timothy J. Baek	2dad9b9432	refac	2024-09-19 20:56:13 +02:00
Timothy J. Baek	cba2d31175	refac	2024-09-19 18:40:23 +02:00
Timothy J. Baek	a2b77fd072	refac	2024-09-19 18:08:52 +02:00