Commit Graph

2058 Commits

Author SHA1 Message Date
Timothy J. Baek
78413d0c2e enh: add/remove file from knowledge 2024-10-03 06:46:20 -07:00
Timothy J. Baek
15a3c6b171 refac 2024-10-03 06:45:15 -07:00
Timothy J. Baek
d394f8b7be enh: add to vector db support 2024-10-03 06:44:17 -07:00
Timothy J. Baek
325ca98773 enh: vector db delete filter support 2024-10-03 06:43:50 -07:00
Patrick Willnow
9a691c0387 Add oauth role mapping
also add node env to allow local build to succeed
2024-10-03 11:12:14 +02:00
Timothy J. Baek
351b1dbf31 refac 2024-10-02 21:14:58 -07:00
Timothy J. Baek
a2eadb30f5 refac 2024-10-02 20:42:10 -07:00
Timothy Jaeryang Baek
2e7e346e19
Merge pull request #5871 from tcgumus/dev
fix: Unsupported JSON schema type {type_}
2024-10-03 05:07:30 +02:00
Jun Siang Cheah
318f61161e refac: lazy load big dependencies to reduce min memory usage 2024-10-02 22:18:42 +01:00
Timothy J. Baek
4aca1e86ad refac 2024-10-02 06:19:09 -07:00
t
bdb2ce9448 fix: Unsupported JSON schema type {type_} 2024-10-02 15:34:48 +03:00
Timothy J. Baek
08969ecf89 refac: rename projects -> knowledge 2024-10-01 22:45:04 -07:00
Timothy J. Baek
3e012f0219 refac 2024-10-01 21:48:15 -07:00
Timothy J. Baek
5933d7a216 enh: sort by descending order 2024-10-01 21:35:18 -07:00
Timothy J. Baek
1b7d363d32 refac 2024-10-01 21:32:59 -07:00
Timothy J. Baek
c2732a0990 refac 2024-10-01 17:46:56 -07:00
Timothy J. Baek
c5eb0a9732 refac: documents -> projects 2024-10-01 17:35:35 -07:00
Timothy J. Baek
bf57dd808e feat: project migration 2024-10-01 17:35:10 -07:00
Timothy J. Baek
fb083237cd refac 2024-10-01 14:00:19 -07:00
Timothy J. Baek
a0fb4a9b84 refac 2024-10-01 13:13:39 -07:00
Timothy J. Baek
5c9dd25459 refac: files migration 2024-10-01 11:01:26 -07:00
Timothy J. Baek
0907c32e10 refac 2024-10-01 09:51:58 -07:00
Timothy J. Baek
4752df9bd8 refac 2024-10-01 09:40:08 -07:00
Timothy J. Baek
7b9b29253f Merge branch 'dev' of https://github.com/open-webui/open-webui into dev 2024-10-01 09:18:15 -07:00
Timothy Jaeryang Baek
126aff7a7d
Merge pull request #5839 from open-webui/dependabot/pip/backend/dev/langchain-chroma-0.1.4
chore(deps): bump langchain-chroma from 0.1.2 to 0.1.4 in /backend
2024-10-01 17:58:14 +02:00
Timothy Jaeryang Baek
6ca1de3601
Merge pull request #5838 from open-webui/dependabot/pip/backend/dev/duckduckgo-search-approx-eq-6.2.13
chore(deps): update duckduckgo-search requirement from ~=6.2.11 to ~=6.2.13 in /backend
2024-10-01 17:57:59 +02:00
Timothy Jaeryang Baek
fb8af637e1
Merge pull request #5837 from open-webui/dependabot/pip/backend/dev/aiohttp-3.10.8
chore(deps): bump aiohttp from 3.10.5 to 3.10.8 in /backend
2024-10-01 17:57:51 +02:00
Timothy Jaeryang Baek
ab983887cc
Merge pull request #5836 from open-webui/dependabot/pip/backend/dev/pandas-2.2.3
chore(deps): bump pandas from 2.2.2 to 2.2.3 in /backend
2024-10-01 17:57:40 +02:00
dependabot[bot]
736cbb961f
chore(deps): bump langchain-chroma from 0.1.2 to 0.1.4 in /backend
Bumps [langchain-chroma](https://github.com/langchain-ai/langchain) from 0.1.2 to 0.1.4.
- [Release notes](https://github.com/langchain-ai/langchain/releases)
- [Commits](https://github.com/langchain-ai/langchain/compare/langchain-chroma==0.1.2...langchain-chroma==0.1.4)

---
updated-dependencies:
- dependency-name: langchain-chroma
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2024-10-01 02:22:25 +00:00
dependabot[bot]
8d8c2752dc
chore(deps): update duckduckgo-search requirement in /backend
Updates the requirements on [duckduckgo-search](https://github.com/deedy5/duckduckgo_search) to permit the latest version.
- [Release notes](https://github.com/deedy5/duckduckgo_search/releases)
- [Commits](https://github.com/deedy5/duckduckgo_search/compare/v6.2.12...v6.2.13)

---
updated-dependencies:
- dependency-name: duckduckgo-search
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
2024-10-01 02:22:21 +00:00
dependabot[bot]
d78a7d431d
chore(deps): bump aiohttp from 3.10.5 to 3.10.8 in /backend
Bumps [aiohttp](https://github.com/aio-libs/aiohttp) from 3.10.5 to 3.10.8.
- [Release notes](https://github.com/aio-libs/aiohttp/releases)
- [Changelog](https://github.com/aio-libs/aiohttp/blob/master/CHANGES.rst)
- [Commits](https://github.com/aio-libs/aiohttp/compare/v3.10.5...v3.10.8)

---
updated-dependencies:
- dependency-name: aiohttp
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2024-10-01 02:22:18 +00:00
dependabot[bot]
91ca5c424b
chore(deps): bump pandas from 2.2.2 to 2.2.3 in /backend
Bumps [pandas](https://github.com/pandas-dev/pandas) from 2.2.2 to 2.2.3.
- [Release notes](https://github.com/pandas-dev/pandas/releases)
- [Commits](https://github.com/pandas-dev/pandas/compare/v2.2.2...v2.2.3)

---
updated-dependencies:
- dependency-name: pandas
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2024-10-01 02:22:08 +00:00
dependabot[bot]
7e1c55d2ed
chore(deps): bump pydantic from 2.8.2 to 2.9.2 in /backend
Bumps [pydantic](https://github.com/pydantic/pydantic) from 2.8.2 to 2.9.2.
- [Release notes](https://github.com/pydantic/pydantic/releases)
- [Changelog](https://github.com/pydantic/pydantic/blob/main/HISTORY.md)
- [Commits](https://github.com/pydantic/pydantic/compare/v2.8.2...v2.9.2)

---
updated-dependencies:
- dependency-name: pydantic
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
2024-10-01 02:22:04 +00:00
Timothy J. Baek
c7a0e45bea refac 2024-09-30 16:32:38 +02:00
Jannik Streidl
6bff5a4d09 fix: do not embed the query every single time 2024-09-30 16:18:02 +02:00
Timothy J. Baek
1c4b6b9cd9 refac 2024-09-30 01:00:13 +02:00
Timothy J. Baek
3899405864 refac 2024-09-30 00:39:30 +02:00
Timothy J. Baek
7152af949b feat: compress audio
Co-Authored-By: Beck Bekmyradov <47065940+bekmuradov@users.noreply.github.com>
2024-09-30 00:30:12 +02:00
Timothy J. Baek
8206c47a47 refac 2024-09-29 23:20:37 +02:00
Timothy J. Baek
6afc686e17 refac 2024-09-29 23:08:55 +02:00
Timothy J. Baek
677c36c3aa refac 2024-09-29 22:55:53 +02:00
Timothy J. Baek
6d764ee55e feat: retrieval whole document mode 2024-09-29 22:52:27 +02:00
Timothy J. Baek
92dd173b27 refac 2024-09-29 18:55:26 +02:00
Timothy J. Baek
c93a10388b refac 2024-09-28 19:51:28 +02:00
Timothy J. Baek
276ce3374d refac 2024-09-28 19:17:21 +02:00
Timothy J. Baek
e77c3ab043 refac 2024-09-28 19:16:52 +02:00
Timothy J. Baek
90ec458c4c enh: show extracted file content 2024-09-28 10:53:25 +02:00
smonux
e039b4ec54
Merge branch 'open-webui:dev' into dev 2024-09-28 06:01:26 +02:00
Timothy J. Baek
9d2ed3d2be refac 2024-09-28 02:56:56 +02:00
Timothy J. Baek
b8b994a820 refac 2024-09-28 02:49:18 +02:00
Timothy J. Baek
00eb022450 refac 2024-09-28 02:38:59 +02:00
Timothy J. Baek
2428878f42 refac 2024-09-28 02:29:08 +02:00
Timothy J. Baek
af57a2c153 refac 2024-09-28 02:23:09 +02:00
Timothy J. Baek
a52e8cd537 refac 2024-09-28 01:35:31 +02:00
Timothy J. Baek
5b7cf88915 refac 2024-09-28 01:28:45 +02:00
Timothy J. Baek
e1103305f5 refac: "rag" endpoints renamed to "retrieval" 2024-09-28 01:27:46 +02:00
Timothy Jaeryang Baek
6e9db3e3c8
Merge pull request #5773 from HaldiH/main
fix: Chat completion 401 when no Authorization header
2024-09-27 21:34:58 +02:00
Hugo Haldi
eab30781e0
Chat completion 401 when no Authorization header
When we send a request to `/api/chat/completions` without the `Authorization` header, the server just crashes and creates a stack trace, returning "Internal Server Error" to the calling client. With this fix, the server sends a 401 to the client with the content `{"detail": "Not authenticated"}`.
2024-09-27 20:04:45 +02:00
Timothy Jaeryang Baek
c30c876659
Merge pull request #5758 from kivvi3412/fix_o1_system_message
Fix: O1 does not support the system parameter
2024-09-27 19:44:16 +02:00
Timothy J. Baek
4ead3c5b80 chore: format 2024-09-27 19:43:40 +02:00
kivvi
e13614e11b
Fix: O1 does not support the system parameter 2024-09-27 22:47:24 +08:00
Timothy J. Baek
0bd9d59c78 refac: update check timeout 2024-09-27 14:38:56 +02:00
Timothy J. Baek
719f4da1dc fix: milvus collection creation issue 2024-09-26 22:59:09 +02:00
smonux
d8f71e1d7f Some models produce almost correct json during function calling, but with additional data before of after it. This solves it. 2024-09-26 22:02:56 +02:00
Timothy J. Baek
4c92a0f571 chore: chromadb, pymilvus bump 2024-09-26 21:33:37 +02:00
Hwang In Tak
4fe1f2487d
fix: Fix OpenAI batch embedding 2024-09-26 20:48:14 +09:00
Hwang In Tak
a4bc0b2829
fix: Fix OpenAI batch embedding 2024-09-26 20:39:40 +09:00
Timothy J. Baek
9d25207b83 refac 2024-09-26 03:13:38 +02:00
Timothy Jaeryang Baek
cc19b8049a
Merge pull request #5710 from kivvi3412/fix_o1_max_tokens
Fix: o1 input parameter must be max_completion_tokens
2024-09-26 03:03:15 +02:00
Timothy J. Baek
3a163b6392 fix: pip install database save issue 2024-09-26 03:02:08 +02:00
kivvi
405d0561df
Fix: o1 input parameter must be max_completion_tokens 2024-09-26 08:49:59 +08:00
Timothy J. Baek
ee33b4e2a3 fix: ollama /embed form_data 2024-09-25 22:34:02 +02:00
Timothy J. Baek
92b1acd6fb fix: RESET_CONFIG_ON_START not working 2024-09-25 01:06:11 +02:00
Timothy J. Baek
e19406cdd7 fix 2024-09-24 17:43:43 +02:00
Timothy J. Baek
3cee507687 fix: dev2 2024-09-24 16:19:24 +02:00
Timothy J. Baek
ff651ddc36 fix: dev1 2024-09-24 16:07:49 +02:00
Timothy J. Baek
a44e9a8dda refac 2024-09-24 15:41:23 +02:00
Timothy J. Baek
504d910557 fix: no running event loop issue 2024-09-24 15:31:55 +02:00
Timothy J. Baek
31b311c3c9 refac
Co-Authored-By: MicroDev <70126934+microdev1@users.noreply.github.com>
2024-09-24 13:28:00 +02:00
Timothy J. Baek
e268ee5675 enh: audio/x-m4a support 2024-09-24 11:00:47 +02:00
Etienne Perot
fdd27aa321
fix: close temporary file after creating it.
This fixes "The process cannot access the file
because it is being used by another process"
errors on Windows.

The file is still automatically deleted by the
`os.unlink` call later in the function.

Updates #5606
Fixes #5642
2024-09-23 23:22:47 -07:00
Timothy J. Baek
c292fd89f9 refac 2024-09-22 02:55:45 +02:00
Timothy J. Baek
768717aaf9 refac 2024-09-22 02:35:25 +02:00
Timothy J. Baek
d055e1f888 refac 2024-09-22 02:14:59 +02:00
Timothy J. Baek
5f84145a2d enh: socket full redis support 2024-09-22 02:12:55 +02:00
Timothy J. Baek
e35883ca9c fix: openai payload issue 2024-09-21 21:35:00 +02:00
Timothy J. Baek
00f6b4bf09 refac 2024-09-21 15:35:35 +02:00
Timothy J. Baek
9126ceac08 fix: WEBUI_AUTH=False not working issue 2024-09-21 15:33:34 +02:00
Timothy Jaeryang Baek
273787fe78
Merge pull request #5541 from kivvi3412/fix-title-generate
[fix] Fix title generate
2024-09-21 03:58:28 +02:00
Timothy J. Baek
ee6b1376c3 fix: rag duplicate collection issue 2024-09-21 03:53:53 +02:00
kivvi
e1ea0c23eb Fixed the issue of being unable to generate titles 2024-09-21 09:06:28 +08:00
Timothy J. Baek
657d443a3e fix 2024-09-21 02:24:30 +02:00
Timothy J. Baek
95985e7bbb refac 2024-09-21 02:03:58 +02:00
Timothy J. Baek
3a0a1aca11 refac: task ollama stream support 2024-09-21 01:07:57 +02:00
Timothy J. Baek
41926172d3 fix/refac: use ollama /api/chat endpoint for tasks 2024-09-21 00:30:13 +02:00
Timothy J. Baek
585b9eb84a refac 2024-09-20 23:48:03 +02:00
Timothy J. Baek
ffd7d74f77 enh: websocket redis support 2024-09-20 23:43:22 +02:00
Timothy J. Baek
b7ad82757d refac 2024-09-20 03:18:14 +02:00
Timothy J. Baek
d12b6cda4e refac: openai image async gen 2024-09-20 03:16:08 +02:00
Timothy J. Baek
eb9ad47ef8 refac: temp tools & functions files 2024-09-20 00:12:52 +02:00
Timothy J. Baek
39c57c0e94 refac 2024-09-19 22:40:06 +02:00
Timothy J. Baek
9be73ea94a refac 2024-09-19 22:17:32 +02:00
Timothy J. Baek
cd117f5b67 refac 2024-09-19 21:51:45 +02:00
Timothy J. Baek
2dad9b9432 refac 2024-09-19 20:56:13 +02:00
Timothy J. Baek
b0bc36f2af fix 2024-09-19 18:47:02 +02:00
Timothy J. Baek
1688f5ecaf refac 2024-09-19 18:42:01 +02:00
Timothy J. Baek
cba2d31175 refac 2024-09-19 18:40:23 +02:00
Timothy J. Baek
a2b77fd072 refac 2024-09-19 18:08:52 +02:00
Timothy J. Baek
9b83e57372 refac 2024-09-19 17:46:11 +02:00
Timothy J. Baek
687cae9b79 refac 2024-09-19 17:31:59 +02:00
Timothy J. Baek
f8fffdd288 refac: max_tokens -> max_completion_tokens 2024-09-19 17:19:31 +02:00
Timothy J. Baek
7b330d1490 refac 2024-09-19 17:05:49 +02:00
Timothy J. Baek
8426874426 fix 2024-09-19 16:54:34 +02:00
Timothy J. Baek
70dd790afc refac: default rag params 2024-09-19 16:44:33 +02:00
Timothy J. Baek
ff737a9e25 enh: openai error message handling 2024-09-19 16:20:00 +02:00
Timothy Jaeryang Baek
d52eaf19d6
Merge pull request #5511 from EtiennePerot/import-file
fix: restore `__file__` variable for imported toolkits and functions
2024-09-19 15:29:34 +02:00
Timothy J. Baek
1053863175 chore: format 2024-09-19 03:24:39 +02:00
Timothy Jaeryang Baek
5d3a89dd25
Merge pull request #5496 from pawel-ochman/azure-tts
Integrate Azure Speech service for TTS
2024-09-19 02:42:45 +02:00
Timothy J. Baek
b4f1a0b5a6 refac 2024-09-19 02:42:24 +02:00
Timothy J. Baek
afa42dd2e4 refac 2024-09-19 02:40:54 +02:00
Pawel Ochman
4d9677e808 Update configuration page, expose all Azure settings through ENV variables 2024-09-18 14:13:42 +01:00
Pawel Ochman
eacb69074e remove dependency and migrate to raw rest calls 2024-09-18 12:24:55 +01:00
Etienne Perot
6477bf37fe
fix: restore __file__ variable for imported toolkits and functions
Commit cf86ba7786 changed the way toolkits
and functions were imported to use `exec`, whereas they previously were
written to files and `import`ed. The use of `exec` means that
module-global variables such as `__file__` are no longer defined.

This breaks https://github.com/EtiennePerot/open-webui-code-execution
(code execution tool for Open WebUI), as the module needs to re-execute
its own code in a subprocess in order to properly sandbox itself. This
is done using `__file__` in order to know where the module's code is
located.

This PR creates a temporary in-memory file that contains the imported
toolkit or function's code and exists only during the import process.
Then it injects the path to this in-memory file as the `__file__`
variable in the `exec` context. This restores the ability for the
toolkit or function being imported to rely on `__file__`.
2024-09-18 01:08:30 -07:00
Timothy J. Baek
7a9c0946a4 refac 2024-09-17 23:13:51 +02:00
Timothy J. Baek
7e0a26ef4e refac 2024-09-17 23:07:04 +02:00
Timothy J. Baek
67f95ddfdc refac 2024-09-17 22:58:06 +02:00
Timothy Jaeryang Baek
a5c9160b7d
Merge pull request #5466 from phil-ogb/add-security-response-headers
feat: security response headers
2024-09-17 17:18:28 +02:00
Pawel Ochman
d6b68f405e added azure speech service support 2024-09-17 09:13:10 +01:00
Phil Ogbonna
896baf021b update comment block 2024-09-16 22:02:55 -03:00
Phil Ogbonna
499e5e4f60 feat: security response headers 2024-09-16 21:53:30 -03:00
Timothy J. Baek
af92184c93 chore: colbert-ai requirement 2024-09-16 16:19:40 +02:00
Timothy J. Baek
06debb322b refac: colbert cuda support 2024-09-16 12:42:48 +02:00
Timothy J. Baek
b7f0759485 refac 2024-09-16 12:36:43 +02:00
Timothy J. Baek
bc6f23f82f fix 2024-09-16 12:33:55 +02:00
Timothy J. Baek
cb9e76c7f9 refac: default rag template 2024-09-16 12:01:04 +02:00
Timothy J. Baek
b38986a0aa enh: colbert rerank support 2024-09-16 11:46:39 +02:00
Timothy J. Baek
db0c576f48 refac 2024-09-16 07:14:17 +02:00
Timothy J. Baek
d0df2cbe53 fix: disable "enable new sign ups" not working issue 2024-09-14 23:13:52 +01:00
Timothy Jaeryang Baek
27baa00afb
Merge pull request #5419 from cheahjs/fix/remove-doc-support
fix: remove unsupported .doc file ingest
2024-09-14 22:52:40 +01:00
Timothy J. Baek
869063c743 refac: better reranking model error handling 2024-09-14 20:58:42 +01:00
Timothy Jaeryang Baek
2f9f568dd9
Merge pull request #5400 from thiswillbeyourgithub/fix_fallback_cuda
fix: if cuda is not available fallback to cpu
2024-09-14 20:57:14 +01:00
Jun Siang Cheah
3199e26500 fix: remove unsupported .doc file ingest 2024-09-14 12:44:51 +01:00
Timothy Jaeryang Baek
d75d638b9a
Merge pull request #5406 from open-webui/main
refac
2024-09-13 19:26:51 +01:00
Timothy J. Baek
b64c9d966a refac 2024-09-13 14:26:32 -04:00
Timothy Jaeryang Baek
8a928e5356
Merge pull request #5405 from open-webui/main
refac: filter non chat completions models
2024-09-13 19:23:02 +01:00
Timothy J. Baek
adf958559b refac: filter non chat completions models 2024-09-13 14:20:27 -04:00
thiswillbeyourgithub
82b35492af pep8 2024-09-13 17:18:44 +02:00
thiswillbeyourgithub
a7ea07036e fix: if cuda is not available fallback to cpu 2024-09-13 17:12:00 +02:00
Timothy Jaeryang Baek
c1d3481c41
Merge pull request #5399 from open-webui/main
fix: allow o1
2024-09-13 15:01:48 +01:00
Timothy J. Baek
bc0baa35e6 fix: allow o1 2024-09-13 09:59:41 -04:00
Timothy J. Baek
f549cb1f87 fix 2024-09-13 01:30:30 -04:00
Timothy J. Baek
823093eea6 fix: hybrid search 2024-09-13 01:21:47 -04:00
Timothy J. Baek
939bfd153e refac 2024-09-13 01:18:20 -04:00
Timothy J. Baek
b943b7d337 refac 2024-09-13 01:08:02 -04:00
Timothy J. Baek
a1f3ece528 refac 2024-09-13 01:07:03 -04:00
Timothy J. Baek
8a4b3e6bc9 refac: allow multiple [context] in prompt 2024-09-13 01:06:51 -04:00
Timothy J. Baek
a9c497612b refac: rm assert 2024-09-13 00:56:50 -04:00
Timothy J. Baek
7df997c992 chore: format 2024-09-13 00:49:23 -04:00
Timothy J. Baek
bebc0d2073 chore: format 2024-09-13 00:48:54 -04:00
Timothy J. Baek
47e9c12fc2 refac 2024-09-13 00:41:20 -04:00
Timothy Jaeryang Baek
5970dadead
Merge pull request #5256 from Bazsalanszky/main
feat: More options for AUTOMATIC1111
2024-09-13 05:40:09 +01:00
Timothy Jaeryang Baek
7dc4cb30b2
Merge pull request #5378 from thiswillbeyourgithub/fix_RAG_and_web
fix: RAG and Web Search + RAG enhancements
2024-09-13 05:38:53 +01:00
Peter De-Ath
ca9874757f fix: change metadata to metadatas 2024-09-12 20:14:14 +01:00
thiswillbeyourgithub
65d5545cf0 added a few type hints 2024-09-12 17:22:22 +02:00
thiswillbeyourgithub
e872f5dc78 log: added a debug log if detecting a potential prompt injection attack 2024-09-12 17:22:22 +02:00
thiswillbeyourgithub
b4ad64586a fix: add check that the context for RAG is not empty if the threshold is 0 2024-09-12 17:22:22 +02:00
thiswillbeyourgithub
9661fee554 fix: handle case where [query] happens in the RAG context 2024-09-12 17:22:22 +02:00
thiswillbeyourgithub
adf26789b8 logs: crash if rag_template would be wrong 2024-09-12 17:22:22 +02:00
thiswillbeyourgithub
209e246e6f fix: much improved RAG template 2024-09-12 17:22:22 +02:00
thiswillbeyourgithub
ed2a1e7db9 enh: use non hybrid search as fallback if hybrid search failed 2024-09-12 17:22:22 +02:00
thiswillbeyourgithub
53f03f6556 fix: log exception when issues of collection querying 2024-09-12 16:51:37 +02:00
Timothy J. Baek
62f1933e3c refac: audio input (audio/ogg support) 2024-09-12 09:18:20 -04:00
Timothy J. Baek
0b30dc357c refac: remove prints 2024-09-12 09:13:21 -04:00
Balazs Toldi
d05ba042c0 Make the optional AUTOMATIC1111 values nullable
This commit makes the optional AUTOMATIC1111 options default to None, and if the value is removed, it resets to None.

Signed-off-by: Balazs Toldi <balazs@toldi.eu>
2024-09-12 14:00:24 +02:00
Timothy Jaeryang Baek
675403d26d
Merge pull request #5364 from open-webui/multiple-vector-dbs
refac: vector db clients
2024-09-12 07:00:55 +01:00
Timothy J. Baek
8be6e16513 refac: vector db clients 2024-09-12 02:00:31 -04:00
Timothy Jaeryang Baek
c7fc17da69
Merge pull request #5312 from open-webui/multiple-vector-dbs
feat: various vector db support
2024-09-12 06:53:47 +01:00
Timothy J. Baek
4775fe43d8 feat: milvus support 2024-09-12 01:52:19 -04:00
Timothy Jaeryang Baek
61ee4bd629
Merge pull request #5319 from Liuzhch1/fix-openai_timeout
fix: get OpenAI models only if OpenAI API Enabled; timeout for querying OpenAI models
2024-09-10 23:03:20 +01:00
Liuzhch1
26700ac4ac fix: get OpenAI models only if OpenAI Enabled;timeout for query OpenAI models 2024-09-10 19:22:05 +08:00
Timothy J. Baek
0886b3a0a4 refac: comments 2024-09-10 04:46:40 +01:00
Timothy J. Baek
522afbb0a0 refac 2024-09-10 04:37:06 +01:00
Timothy Jaeryang Baek
3d6d8c91dd
Merge branch 'multiple-vector-dbs' into dev 2024-09-10 02:29:55 +01:00
Timothy J. Baek
4354f270ce refac 2024-09-10 02:27:50 +01:00
Timothy J. Baek
28087ccf40 refac 2024-09-10 01:37:36 +01:00
Timothy J. Baek
eb0e683b47 refac 2024-09-10 01:34:27 +01:00
Timothy Jaeryang Baek
1023ff8454
Merge pull request #5270 from cheahjs/fix/websocket-take-2
fix: socket.io connections failing when websockets are not available
2024-09-09 23:19:05 +01:00
Jun Siang Cheah
9401f6c821 fix: workaround socketio upstream bug when websockets are not available 2024-09-09 23:17:34 +01:00
Jun Siang Cheah
827c419251 feat: add ENABLE_WEBSOCKET_SUPPORT to force socket.io to ignore websocket upgrades 2024-09-09 23:17:17 +01:00
Timothy J. Baek
f1fae805a2 fix: separate /embed and /embedding ollama endpoint 2024-09-09 23:02:26 +01:00
Michał Surmaczewski
8e6ea49e0e fix: incorrect casting of top_p and frequency_penalty 2024-09-08 17:52:58 +02:00
Jun Siang Cheah
698976add0 feat: add ENABLE_WEBSOCKET_SUPPORT to force socket.io to ignore websocket upgrades 2024-09-08 12:00:36 +01:00
Timothy J. Baek
666086a806 refac 2024-09-08 01:17:02 +01:00
Timothy J. Baek
9bdbe88bda refac: default search query prompt 2024-09-08 01:04:57 +01:00
Timothy J. Baek
214722d39e enh: search query generation prompt 2024-09-08 00:51:12 +01:00
Balazs Toldi
7f6dae41f0 More options for AUTOMATIC1111
This commit adds 3 new options to the AUTOMATIC1111 settings:
- CFG Scale
- Sampler
- Scheduler

These options allow users to configure these parameters directly through the admin settings, without needing to modify the source code, which was previously required to change the default values in  AUTOMATIC1111.

Signed-off-by: Balazs Toldi <balazs@toldi.eu>
2024-09-07 17:21:17 +02:00
Timothy J. Baek
1a6ce1d5d9 refac: default search generation prompt 2024-09-07 05:41:55 +01:00
Timothy J. Baek
2e40719f4e fix 2024-09-07 05:18:52 +01:00
Timothy J. Baek
1c20db775c refac: enable /api/embed 2024-09-07 05:12:46 +01:00
Timothy J. Baek
90a064972c fix 2024-09-07 05:07:37 +01:00
Timothy J. Baek
5c8fb4b3d5 refac: web search 2024-09-07 04:50:29 +01:00
Timothy J. Baek
ff46fe2b4a refac 2024-09-07 03:09:57 +01:00
Timothy J. Baek
02d5bca44d fix: tools & function not installing requirements 2024-09-06 18:35:43 +02:00
Timothy J. Baek
14eda1bf5b fix: pdf download FONTS_DIR issue 2024-09-06 15:52:23 +02:00
Timothy J. Baek
9fe62fc80d refac 2024-09-06 05:30:16 +02:00
Timothy J. Baek
bfb12a7851 refac 2024-09-06 04:59:20 +02:00
Timothy J. Baek
b35bbaade2 fix: extract_frontmatter issue 2024-09-05 20:35:58 +02:00
Timothy J. Baek
0c1fab09ff refac 2024-09-05 18:55:31 +02:00
Timothy J. Baek
d0869bbfbc fix: migrations 2024-09-05 16:23:19 +02:00
Timothy J. Baek
8a411decac fix 2024-09-05 16:13:40 +02:00
Timothy J. Baek
85fc35492d refac 2024-09-05 16:11:07 +02:00
vikrantrathore
74169b0320
fix: avoid overriding DATA_DIR and prevent errors when directories are the same
Previously, the `DATA_DIR` environment variable was always overridden by defaulting to `OPEN_WEBUI_DIR / "data"`, which ignored user-defined `DATA_DIR` values. Additionally, when `DATA_DIR` and `NEW_DATA_DIR` were the same, the script attempted to copy files into themselves, leading to errors or redundant operations.

This commit ensures that:
1. The `DATA_DIR` environment variable is respected and not overridden.
2. Copy operations between `DATA_DIR` and `NEW_DATA_DIR` are only performed if the directories are different, preventing errors when they point to the same location.

These changes resolve potential file copy errors and preserve user configurations.
2024-09-05 14:17:58 +08:00
Timothy J. Baek
a0be3822bf refac 2024-09-04 23:00:01 +02:00
Pol Dellaiera
004700c125
feat: add OVERRIDE_PIP_INSTALL environment variable 2024-09-04 22:44:59 +02:00
Pascal Lim
998616c0fd fix scripts to point to correct path 2024-09-04 20:27:30 +02:00
Timothy J. Baek
92a88df484 refac 2024-09-04 20:00:47 +02:00
Timothy J. Baek
f2f713023d refac 2024-09-04 19:57:41 +02:00
Timothy J. Baek
cf86ba7786 refac: tools & functions 2024-09-04 19:55:20 +02:00
Timothy J. Baek
d6fc0ccf65 fix 2024-09-04 19:03:51 +02:00
Timothy J. Baek
3afd66d50f fix: tools & functions import 2024-09-04 18:59:50 +02:00
Timothy J. Baek
8f6369374d refac: error handling 2024-09-04 17:52:59 +02:00
Timothy J. Baek
e5cfa6501b dev6 2024-09-04 17:47:51 +02:00
Timothy J. Baek
175ffc5c66 dev5 2024-09-04 17:33:39 +02:00
Timothy J. Baek
c0441ab2b8 dev4 2024-09-04 17:14:24 +02:00
Timothy J. Baek
6d1bd3ab66 dev4 2024-09-04 17:02:10 +02:00
Timothy J. Baek
1779e6fecc chore: format 2024-09-04 16:58:28 +02:00
Timothy J. Baek
03d5a670f6 refac: mv backend files to /open_webui dir 2024-09-04 16:54:48 +02:00
Timothy J. Baek
76806a998f fix: automatic1111 model update issue 2024-09-04 15:25:31 +02:00
Timothy J. Baek
9bcbf5e9b3 Update config.py 2024-09-03 21:46:40 +02:00
Timothy J. Baek
6bbb755997 feat: import/export config 2024-09-03 21:16:07 +02:00
Timothy Jaeryang Baek
aec7cd572c
Merge pull request #5127 from open-webui/dependabot/pip/pip-5bab50f10f
build(deps): bump the pip group across 2 directories with 1 update
2024-09-03 20:17:04 +02:00
dependabot[bot]
856759d350
build(deps): bump the pip group across 2 directories with 1 update
Bumps the pip group with 1 update in the / directory: [flask-cors](https://github.com/corydolphin/flask-cors).
Bumps the pip group with 1 update in the /backend directory: [flask-cors](https://github.com/corydolphin/flask-cors).


Updates `flask-cors` from 4.0.1 to 5.0.0
- [Release notes](https://github.com/corydolphin/flask-cors/releases)
- [Changelog](https://github.com/corydolphin/flask-cors/blob/main/CHANGELOG.md)
- [Commits](https://github.com/corydolphin/flask-cors/compare/4.0.1...5.0.0)

Updates `flask-cors` from 4.0.1 to 5.0.0
- [Release notes](https://github.com/corydolphin/flask-cors/releases)
- [Changelog](https://github.com/corydolphin/flask-cors/blob/main/CHANGELOG.md)
- [Commits](https://github.com/corydolphin/flask-cors/compare/4.0.1...5.0.0)

---
updated-dependencies:
- dependency-name: flask-cors
  dependency-type: direct:production
  dependency-group: pip
- dependency-name: flask-cors
  dependency-type: direct:production
  dependency-group: pip
...

Signed-off-by: dependabot[bot] <support@github.com>
2024-09-03 15:32:52 +00:00
Timothy J. Baek
5f92f7e41f enh: prevent trailing / from comfyui base url
Co-Authored-By: qwertyoriuop <41389168+qwertyoriuop@users.noreply.github.com>
2024-09-03 16:19:34 +02:00
Timothy Jaeryang Baek
df0bb4b4b0
Merge pull request #5070 from open-webui/dependabot/pip/backend/dev/authlib-1.3.2
build(deps): bump authlib from 1.3.1 to 1.3.2 in /backend
2024-09-03 14:51:30 +02:00
Timothy Jaeryang Baek
fdfa96ba51
Merge pull request #5069 from open-webui/dependabot/pip/backend/dev/duckduckgo-search-approx-eq-6.2.11
build(deps): update duckduckgo-search requirement from ~=6.2.1 to ~=6.2.11 in /backend
2024-09-03 14:51:24 +02:00
Timothy Jaeryang Baek
ff94a8e57f
Merge pull request #5068 from open-webui/dependabot/pip/backend/dev/aiohttp-3.10.5
build(deps): bump aiohttp from 3.10.2 to 3.10.5 in /backend
2024-09-03 14:51:17 +02:00
Timothy Jaeryang Baek
41369aefdf
Merge pull request #5067 from open-webui/dependabot/pip/backend/dev/langchain-0.2.15
build(deps): bump langchain from 0.2.14 to 0.2.15 in /backend
2024-09-03 14:51:11 +02:00
dependabot[bot]
665c851f66
build(deps): bump authlib from 1.3.1 to 1.3.2 in /backend
Bumps [authlib](https://github.com/lepture/authlib) from 1.3.1 to 1.3.2.
- [Release notes](https://github.com/lepture/authlib/releases)
- [Changelog](https://github.com/lepture/authlib/blob/master/docs/changelog.rst)
- [Commits](https://github.com/lepture/authlib/compare/v1.3.1...v1.3.2)

---
updated-dependencies:
- dependency-name: authlib
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2024-09-01 02:56:51 +00:00
dependabot[bot]
115503098e
build(deps): update duckduckgo-search requirement in /backend
Updates the requirements on [duckduckgo-search](https://github.com/deedy5/duckduckgo_search) to permit the latest version.
- [Release notes](https://github.com/deedy5/duckduckgo_search/releases)
- [Commits](https://github.com/deedy5/duckduckgo_search/compare/v6.2.1...v6.2.11)

---
updated-dependencies:
- dependency-name: duckduckgo-search
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
2024-09-01 02:56:47 +00:00
dependabot[bot]
b7cda48a03
build(deps): bump aiohttp from 3.10.2 to 3.10.5 in /backend
Bumps [aiohttp](https://github.com/aio-libs/aiohttp) from 3.10.2 to 3.10.5.
- [Release notes](https://github.com/aio-libs/aiohttp/releases)
- [Changelog](https://github.com/aio-libs/aiohttp/blob/master/CHANGES.rst)
- [Commits](https://github.com/aio-libs/aiohttp/compare/v3.10.2...v3.10.5)

---
updated-dependencies:
- dependency-name: aiohttp
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2024-09-01 02:56:42 +00:00
dependabot[bot]
7780640938
build(deps): bump langchain from 0.2.14 to 0.2.15 in /backend
Bumps [langchain](https://github.com/langchain-ai/langchain) from 0.2.14 to 0.2.15.
- [Release notes](https://github.com/langchain-ai/langchain/releases)
- [Commits](https://github.com/langchain-ai/langchain/compare/langchain==0.2.14...langchain==0.2.15)

---
updated-dependencies:
- dependency-name: langchain
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2024-09-01 02:56:33 +00:00
dependabot[bot]
92488c254d
build(deps): bump unstructured from 0.15.7 to 0.15.9 in /backend
Bumps [unstructured](https://github.com/Unstructured-IO/unstructured) from 0.15.7 to 0.15.9.
- [Release notes](https://github.com/Unstructured-IO/unstructured/releases)
- [Changelog](https://github.com/Unstructured-IO/unstructured/blob/main/CHANGELOG.md)
- [Commits](https://github.com/Unstructured-IO/unstructured/compare/0.15.7...0.15.9)

---
updated-dependencies:
- dependency-name: unstructured
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2024-09-01 02:56:28 +00:00
Timothy Jaeryang Baek
bccc6e08cc
Merge pull request #4957 from pascallim/fix/imports
fix: sort and fix backend imports
2024-08-31 20:09:04 +02:00
Jun Siang Cheah
953beb369c fix: return proxied response headers during chat completion 2024-08-31 15:15:21 +01:00
Pascal Lim
9232e03102 fix imports 2024-08-30 22:29:45 +02:00
Pascal Lim
c386d0b1a5 sort and fix backend imports 2024-08-30 22:26:22 +02:00
Timothy J. Baek
08efabc696 refac 2024-08-30 10:56:31 -07:00
Timothy Jaeryang Baek
d3bcfd4d5f
Merge pull request #4974 from SearchApi/add-search-api
feat: Add support for SearchApi as alternative to WebSearch
2024-08-30 19:42:36 +02:00
Timothy Jaeryang Baek
5367d5ec3b
Merge pull request #5030 from Peter-De-Ath/fix-comfy-ui-403
fix: add useragent default headers comfyui
2024-08-30 19:38:50 +02:00
Peter De-Ath
a26f4306a4 fix: add useragent default headers comfyui 2024-08-29 23:38:37 +01:00
Su YR
45363a2abb
fix: type_ == "literal" 2024-08-29 15:55:12 +08:00
Rajendra Kadam
7e1923fcfe Add searchapi as an alternative web search
Add config changes for SearchApi api key and engine

Add searchapi results json in testdata
2024-08-28 15:26:33 +05:30
Su YR
0525dd2bb5
feat: support Literal type in Tools 2024-08-28 15:16:56 +08:00
Peter De-Ath
025f0f390e refac: support list in json schema to pydantic 2024-08-27 21:42:22 +01:00
Timothy Jaeryang Baek
9dade91ef5
Merge pull request #4917 from Yanyutin753/upload_files_limit
🤖 Limit the size and number of uploaded files
2024-08-27 17:09:52 +02:00
Timothy J. Baek
6a21a77ee9 refac 2024-08-27 17:05:24 +02:00
Timothy J. Baek
69c4687a53 refac 2024-08-27 15:53:29 +02:00
Timothy J. Baek
09cba5b87a refac: rm sub standard code 2024-08-27 15:51:40 +02:00
Timothy J. Baek
600409682e refac: do not change default behaviour 2024-08-27 15:30:57 +02:00
Timothy J. Baek
689b05a73d enh: add content-type: application/x-ndjson to ollama /api/chat 2024-08-27 14:06:58 +02:00
Timothy J. Baek
062649e483 refac: endpoints regarding db operations 2024-08-27 14:01:00 +02:00
Timothy Jaeryang Baek
7c841c9f63
Merge pull request #4924 from Peter-De-Ath/fix-duplicate-system-prompt
fix: stop system prompt being duplicated
2024-08-27 13:07:26 +02:00
Peter De-Ath
b2e682e263 fix: stop system prompt being duplicated 2024-08-26 21:25:57 +01:00
Clivia
775478534a 👀 Fix Common users cannot upload files
💄Fix format

💄Fix format i18

 Feat paste upload files and make restrictions

 Feat paste upload files and make restrictions
2024-08-26 23:36:13 +08:00
Clivia
b6da4baa97 💄 Limit the size and number of uploaded files
💄 Limit the size and number of uploaded files
2024-08-26 23:36:13 +08:00
Timothy Jaeryang Baek
b148865ee8
Merge pull request #4886 from kiosion/dev
feat: Add control for how message content is split for TTS generation requests
2024-08-26 15:02:30 +02:00
Timothy J. Baek
b96239fb0b enh: block api user with model filter 2024-08-26 14:24:56 +02:00
Timothy J. Baek
faeabfb3d4 fix: include __files__ param to pipe function 2024-08-26 12:36:04 +02:00
Timothy J. Baek
de6b5a7bbe refac 2024-08-26 12:27:00 +02:00
Timothy J. Baek
efd4b03f78 enh: repopulate tools & functions from db if non existent 2024-08-26 12:18:12 +02:00
Timothy J. Baek
e98a20fce9 fix: .md processing issue 2024-08-26 12:08:55 +02:00
Timothy J. Baek
5a0e1c5f75 refac: disable signups when ENABLE_LOGIN_FORM is set to false 2024-08-26 11:54:55 +02:00
kiosion
3967c34261
feat: Add control for how message content is split for TTS generation reqs 2024-08-25 20:03:21 -04:00
Timothy J. Baek
f568389235 refac 2024-08-25 18:42:27 +02:00
Timothy J. Baek
a44bae2d3a fix 2024-08-25 17:54:51 +02:00
Timothy J. Baek
fd0370d801 fix 2024-08-25 16:57:01 +02:00
Timothy J. Baek
58cf1be20c feat: config.json db migration 2024-08-25 16:52:36 +02:00
Timothy J. Baek
e442b3b169 fix: async image gen automatic1111 2024-08-23 16:51:34 +02:00
Timothy J. Baek
4519ddd0e9 refac: files rbac 2024-08-23 16:19:04 +02:00
Timothy J. Baek
0a5a2e67e8 fix: uploaded files leaking to other user chats issue
#4601
2024-08-23 15:02:23 +02:00
Michael Poluektov
83de28bac2 fix: tools param 2024-08-23 12:58:43 +01:00
Timothy J. Baek
25de3e753d fix 2024-08-22 16:34:12 +02:00
Timothy J. Baek
673b893a8a refac 2024-08-22 16:11:19 +02:00
Timothy J. Baek
d8d2f3529f refac 2024-08-22 16:08:03 +02:00
Timothy J. Baek
63ba8145b9 refac 2024-08-22 16:02:29 +02:00
Timothy J. Baek
a3089e0472 fix 2024-08-22 15:24:48 +02:00
Timothy Jaeryang Baek
9186abf9c1
Merge branch 'dev' into fix-user-valves 2024-08-22 15:23:59 +02:00
Timothy J. Baek
97808ba1c3 refac 2024-08-22 15:23:32 +02:00
Timothy J. Baek
589420c208 refac 2024-08-22 15:20:19 +02:00
Timothy J. Baek
3bf7d569c6 refac 2024-08-22 15:11:31 +02:00
Timothy J. Baek
14187b027d refac 2024-08-22 15:09:06 +02:00
Timothy J. Baek
06f067fda9 refacfix 2024-08-22 15:03:39 +02:00
Michael Poluektov
9b5dfe64b7 fix: is not None 2024-08-22 13:58:10 +01:00
Timothy J. Baek
1c89c91f07 refac 2024-08-22 14:53:14 +02:00
Michael Poluektov
16ec25d296 fix user valves 2024-08-22 13:34:35 +01:00
Timothy Jaeryang Baek
14f0e6a2ba
Merge pull request #4783 from open-webui/dependabot/pip/backend/dev/langchain-community-0.2.12
chore(deps): bump langchain-community from 0.2.10 to 0.2.12 in /backend
2024-08-22 14:26:41 +02:00
dependabot[bot]
4031cb9eda
chore(deps): bump langchain-community from 0.2.10 to 0.2.12 in /backend
Bumps [langchain-community](https://github.com/langchain-ai/langchain) from 0.2.10 to 0.2.12.
- [Release notes](https://github.com/langchain-ai/langchain/releases)
- [Commits](https://github.com/langchain-ai/langchain/compare/langchain-community==0.2.10...langchain-community==0.2.12)

---
updated-dependencies:
- dependency-name: langchain-community
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2024-08-22 12:10:43 +00:00
dependabot[bot]
ee6b8c5b72
chore(deps): bump markdown from 3.6 to 3.7 in /backend
Bumps [markdown](https://github.com/Python-Markdown/markdown) from 3.6 to 3.7.
- [Release notes](https://github.com/Python-Markdown/markdown/releases)
- [Changelog](https://github.com/Python-Markdown/markdown/blob/master/docs/changelog.md)
- [Commits](https://github.com/Python-Markdown/markdown/compare/3.6...3.7)

---
updated-dependencies:
- dependency-name: markdown
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
2024-08-22 12:07:04 +00:00
Timothy Jaeryang Baek
11aecbe79a
Merge pull request #4768 from zhaofengli/db-url-fixes
fix: Fix parameter handling for PostgreSQL URLs
2024-08-22 14:01:28 +02:00
Timothy Jaeryang Baek
a9bace0f97
Merge pull request #4784 from open-webui/dependabot/pip/backend/dev/langchain-0.2.14
chore(deps): bump langchain from 0.2.12 to 0.2.14 in /backend
2024-08-22 13:59:27 +02:00