Commit Graph

1458 Commits

Author SHA1 Message Date
Michael Poluektov
9fb70969d7 factor out get_content_from_response 2024-08-14 21:40:00 +01:00
Michael Poluektov
0c9119d619 move task to metadata 2024-08-14 21:40:00 +01:00
Michael Poluektov
556141cdd8 refactor task 2024-08-14 21:40:00 +01:00
Michael Poluektov
60003c976a rename to chat_completions_inlet_handler for clarity 2024-08-14 21:40:00 +01:00
Michael Poluektov
23f1bee7bd cleanup 2024-08-14 21:40:00 +01:00
Michael Poluektov
589efcdc5f is_chat_completion_request helper, remove nesting 2024-08-14 21:40:00 +01:00
Michael Poluektov
3befadb29f remove unnecessary nesting, remove unused endpoint 2024-08-14 21:40:00 +01:00
Michael Poluektov
0470146d7b replace Tuple with tuple 2024-08-14 13:58:37 +01:00
Michael Poluektov
a518d50477 format backend 2024-08-14 13:49:18 +01:00
Michael Poluektov
29f904db45 remove List imports 2024-08-14 13:46:31 +01:00
Michael Poluektov
038fc48ac0 replace == None with is None 2024-08-14 13:39:53 +01:00
Michael Poluektov
6f72def1ac replace except: with except Exception: 2024-08-14 13:38:19 +01:00
Timothy Jaeryang Baek
9682806476
Merge pull request #4372 from JTHesse/main
build: Adding ability to install requirements from frontmatter for tools and functions
2024-08-13 18:18:26 +02:00
Timothy Jaeryang Baek
fc6fa7887b
Merge pull request #4579 from alexandregodard/main
Update main.py
2024-08-13 18:17:27 +02:00
Timothy J. Baek
e1e69cfbcb refac: sft -> default to safetensors 2024-08-13 17:15:20 +01:00
Alexandre GODARD
7a8f8960c5
Update main.py
Fix typo in update_reranking_model
2024-08-13 17:51:25 +02:00
Timothy Jaeryang Baek
30c44d431b
Merge pull request #4538 from open-webui/dependabot/pip/backend/dev/chromadb-0.5.5
chore(deps): bump chromadb from 0.5.4 to 0.5.5 in /backend
2024-08-13 12:22:56 +02:00
Timothy Jaeryang Baek
b177976f29
Merge pull request #4539 from open-webui/dependabot/pip/backend/dev/langchain-0.2.12
chore(deps): bump langchain from 0.2.11 to 0.2.12 in /backend
2024-08-13 12:22:48 +02:00
Timothy J. Baek
a1888b3757 refac 2024-08-13 11:21:17 +01:00
Timothy J. Baek
70f580ec45 fix 2024-08-12 15:10:08 +01:00
Timothy J. Baek
eae35dddc2 refac 2024-08-12 12:47:54 +01:00
Timothy Jaeryang Baek
bb979c9a78
Merge pull request #4540 from open-webui/dependabot/pip/backend/dev/pytest-approx-eq-8.3.2
chore(deps): update pytest requirement from ~=8.2.2 to ~=8.3.2 in /backend
2024-08-12 13:31:02 +02:00
Timothy Jaeryang Baek
4f959c31de
Merge pull request #4537 from open-webui/dependabot/pip/backend/dev/langfuse-2.43.3
chore(deps): bump langfuse from 2.39.2 to 2.43.3 in /backend
2024-08-12 13:30:52 +02:00
dependabot[bot]
41460e1335
chore(deps): bump pyjwt[crypto] from 2.8.0 to 2.9.0 in /backend
Bumps [pyjwt[crypto]](https://github.com/jpadilla/pyjwt) from 2.8.0 to 2.9.0.
- [Release notes](https://github.com/jpadilla/pyjwt/releases)
- [Changelog](https://github.com/jpadilla/pyjwt/blob/master/CHANGELOG.rst)
- [Commits](https://github.com/jpadilla/pyjwt/compare/2.8.0...2.9.0)

---
updated-dependencies:
- dependency-name: pyjwt[crypto]
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
2024-08-12 03:15:42 +00:00
dependabot[bot]
ffdb44f887
chore(deps): update pytest requirement in /backend
Updates the requirements on [pytest](https://github.com/pytest-dev/pytest) to permit the latest version.
- [Release notes](https://github.com/pytest-dev/pytest/releases)
- [Changelog](https://github.com/pytest-dev/pytest/blob/main/CHANGELOG.rst)
- [Commits](https://github.com/pytest-dev/pytest/compare/8.2.2...8.3.2)

---
updated-dependencies:
- dependency-name: pytest
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
2024-08-12 03:15:40 +00:00
dependabot[bot]
549d3b4d10
chore(deps): bump langchain from 0.2.11 to 0.2.12 in /backend
Bumps [langchain](https://github.com/langchain-ai/langchain) from 0.2.11 to 0.2.12.
- [Release notes](https://github.com/langchain-ai/langchain/releases)
- [Commits](https://github.com/langchain-ai/langchain/compare/langchain==0.2.11...langchain==0.2.12)

---
updated-dependencies:
- dependency-name: langchain
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2024-08-12 03:15:35 +00:00
dependabot[bot]
879f85802a
chore(deps): bump chromadb from 0.5.4 to 0.5.5 in /backend
Bumps [chromadb](https://github.com/chroma-core/chroma) from 0.5.4 to 0.5.5.
- [Release notes](https://github.com/chroma-core/chroma/releases)
- [Changelog](https://github.com/chroma-core/chroma/blob/main/RELEASE_PROCESS.md)
- [Commits](https://github.com/chroma-core/chroma/compare/0.5.4...0.5.5)

---
updated-dependencies:
- dependency-name: chromadb
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2024-08-12 03:15:30 +00:00
dependabot[bot]
d652a1bbb1
chore(deps): bump langfuse from 2.39.2 to 2.43.3 in /backend
Bumps [langfuse](https://github.com/langfuse/langfuse) from 2.39.2 to 2.43.3.
- [Release notes](https://github.com/langfuse/langfuse/releases)
- [Commits](https://github.com/langfuse/langfuse/commits)

---
updated-dependencies:
- dependency-name: langfuse
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
2024-08-12 03:15:25 +00:00
Timothy Jaeryang Baek
9c2429ff97
Merge pull request #4402 from michaelpoluektov/remove-ollama
refactor: re-use utils in Ollama
2024-08-12 00:45:15 +02:00
Timothy Jaeryang Baek
d0645d3c4f
Merge pull request #4503 from open-webui/dependabot/pip/pip-621ce9c937
chore(deps): bump the pip group across 2 directories with 1 update
2024-08-12 00:40:46 +02:00
Michael Poluektov
547611b703 Merge branch 'dev' of https://github.com/open-webui/open-webui into remove-ollama 2024-08-10 11:47:20 +01:00
dependabot[bot]
208833d9f2
chore(deps): bump the pip group across 2 directories with 1 update
Bumps the pip group with 1 update in the / directory: [aiohttp](https://github.com/aio-libs/aiohttp).
Bumps the pip group with 1 update in the /backend directory: [aiohttp](https://github.com/aio-libs/aiohttp).


Updates `aiohttp` from 3.9.5 to 3.10.2
- [Release notes](https://github.com/aio-libs/aiohttp/releases)
- [Changelog](https://github.com/aio-libs/aiohttp/blob/master/CHANGES.rst)
- [Commits](https://github.com/aio-libs/aiohttp/compare/v3.9.5...v3.10.2)

Updates `aiohttp` from 3.9.5 to 3.10.2
- [Release notes](https://github.com/aio-libs/aiohttp/releases)
- [Changelog](https://github.com/aio-libs/aiohttp/blob/master/CHANGES.rst)
- [Commits](https://github.com/aio-libs/aiohttp/compare/v3.9.5...v3.10.2)

---
updated-dependencies:
- dependency-name: aiohttp
  dependency-type: direct:production
  dependency-group: pip
- dependency-name: aiohttp
  dependency-type: direct:production
  dependency-group: pip
...

Signed-off-by: dependabot[bot] <support@github.com>
2024-08-09 18:21:50 +00:00
Timothy Jaeryang Baek
52fd701f2e
Merge pull request #4465 from open-webui/main
dev
2024-08-08 14:23:33 +02:00
Michael Poluektov
204a4fbe7a fix: backend format test 2024-08-08 12:45:23 +01:00
Michael Poluektov
fa4d1d42a5 fix: backend format test 2024-08-08 12:41:41 +01:00
Michael Poluektov
309cd645f1 undo del 2024-08-08 12:30:07 +01:00
Michael Poluektov
a725801e55 fix: formatting test errors, remove print, merge dev 2024-08-08 11:34:48 +01:00
Michael Poluektov
8cdf9814bd fix: name differences 2024-08-08 11:01:00 +01:00
Michael Poluektov
e6bbce439d fix: repeat_penalty 2024-08-08 10:52:09 +01:00
Timothy Jaeryang Baek
8d257ed596
Merge commit from fork
SSRF Fix
2024-08-08 11:47:33 +02:00
Jan-Timo Hesse
367fa039a0 added install_frontmatter_requirements 2024-08-08 09:46:14 +02:00
Jan-Timo Hesse
71d88fe35d revert 2024-08-08 09:45:52 +02:00
John Karabudak
958fe9639a fix: ComfyUI generation no longer causes FastAPI to stall for all users
as the get_images() function involves a `while True` loop while waiting for a response from ComfyUI and is not async, when image generation is running the entire UI becomes unresponsive for all users.

furthermore, when image generation takes too long, the Docker health check starts failing.

this is certainly a bad fix as it does not convert everything to async, but rather just puts the blocking loop in a separate thread. however, it works and it at least fixes the problem for now.
2024-08-07 22:24:55 -02:30
Timothy Jaeryang Baek
670f28d694
Merge branch 'dev' into remove-ollama 2024-08-07 23:06:11 +02:00
Carter Roeser
d72d5d0e8e feat: Add OAuth Email Claim Variable
Add an `OAUTH_EMAIL_CLAIM` variable to override the default "email" claim value.
2024-08-07 11:39:51 -07:00
root
590fd129c8 SSRF Fix Updated 2024-08-07 10:59:22 -04:00
Timothy J. Baek
ad9a7cb1e2 refac 2024-08-07 15:52:03 +02:00
Timothy J. Baek
8187922ef1 fix: "metadata" issue 2024-08-07 15:49:48 +02:00
root
1f8d08eaa2 SSRF Fix 2024-08-07 03:30:21 -04:00
Michael Poluektov
ed205d82e8 fix: pop 2024-08-06 12:25:00 +01:00
Michael Poluektov
fc31267a54 refac: re-use utils.misc 2024-08-06 11:31:45 +01:00
Michael Poluektov
44c781f414 cleanup 2024-08-06 10:50:22 +01:00
Michael Poluektov
831fe9f509 cleanup 2024-08-06 10:15:29 +01:00
Timothy Jaeryang Baek
05bbca5b07
Merge pull request #4369 from open-webui/dependabot/pip/backend/dev/black-24.8.0
chore(deps): bump black from 24.4.2 to 24.8.0 in /backend
2024-08-05 11:07:15 +02:00
Timothy Jaeryang Baek
5afe0be5b4
Merge pull request #4368 from open-webui/dependabot/pip/backend/dev/validators-0.33.0
chore(deps): bump validators from 0.28.1 to 0.33.0 in /backend
2024-08-05 11:07:04 +02:00
Timothy Jaeryang Baek
d8aa2cc05f
Merge pull request #4367 from open-webui/dependabot/pip/backend/dev/python-pptx-1.0.0
chore(deps): bump python-pptx from 0.6.23 to 1.0.0 in /backend
2024-08-05 11:06:56 +02:00
Timothy Jaeryang Baek
7b071d403f
Merge pull request #4366 from open-webui/dependabot/pip/backend/dev/pypdf-4.3.1
chore(deps): bump pypdf from 4.2.0 to 4.3.1 in /backend
2024-08-05 11:06:44 +02:00
Jan-Timo Hesse
cec5fdd144 Added EXTRA_MODULES argument 2024-08-05 09:42:16 +02:00
dependabot[bot]
d8498aa2b0
chore(deps): bump black from 24.4.2 to 24.8.0 in /backend
Bumps [black](https://github.com/psf/black) from 24.4.2 to 24.8.0.
- [Release notes](https://github.com/psf/black/releases)
- [Changelog](https://github.com/psf/black/blob/main/CHANGES.md)
- [Commits](https://github.com/psf/black/compare/24.4.2...24.8.0)

---
updated-dependencies:
- dependency-name: black
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
2024-08-05 02:52:14 +00:00
dependabot[bot]
e593d3aee3
chore(deps): bump validators from 0.28.1 to 0.33.0 in /backend
Bumps [validators](https://github.com/python-validators/validators) from 0.28.1 to 0.33.0.
- [Release notes](https://github.com/python-validators/validators/releases)
- [Changelog](https://github.com/python-validators/validators/blob/master/CHANGES.md)
- [Commits](https://github.com/python-validators/validators/compare/0.28.1...0.33.0)

---
updated-dependencies:
- dependency-name: validators
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
2024-08-05 02:52:10 +00:00
dependabot[bot]
323cfaf2d7
chore(deps): bump python-pptx from 0.6.23 to 1.0.0 in /backend
Bumps [python-pptx](https://github.com/scanny/python-pptx) from 0.6.23 to 1.0.0.
- [Changelog](https://github.com/scanny/python-pptx/blob/master/HISTORY.rst)
- [Commits](https://github.com/scanny/python-pptx/compare/v0.6.23...v1.0.0)

---
updated-dependencies:
- dependency-name: python-pptx
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
2024-08-05 02:52:07 +00:00
dependabot[bot]
637f0c6fb2
chore(deps): bump pypdf from 4.2.0 to 4.3.1 in /backend
Bumps [pypdf](https://github.com/py-pdf/pypdf) from 4.2.0 to 4.3.1.
- [Release notes](https://github.com/py-pdf/pypdf/releases)
- [Changelog](https://github.com/py-pdf/pypdf/blob/main/CHANGELOG.md)
- [Commits](https://github.com/py-pdf/pypdf/compare/4.2.0...4.3.1)

---
updated-dependencies:
- dependency-name: pypdf
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
2024-08-05 02:52:06 +00:00
dependabot[bot]
2756403102
chore(deps): bump boto3 from 1.34.110 to 1.34.153 in /backend
Bumps [boto3](https://github.com/boto/boto3) from 1.34.110 to 1.34.153.
- [Release notes](https://github.com/boto/boto3/releases)
- [Commits](https://github.com/boto/boto3/compare/1.34.110...1.34.153)

---
updated-dependencies:
- dependency-name: boto3
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2024-08-05 02:52:03 +00:00
Timothy J. Baek
ace3552e15 chore: format 2024-08-04 17:42:16 +02:00
Timothy Jaeryang Baek
003ceff7e4
Merge pull request #4349 from open-webui/dev-scroll
feat: Sidebar infinite scroll (pagination)
2024-08-04 17:36:18 +02:00
Timothy J. Baek
209ccdf668 refac 2024-08-04 17:35:26 +02:00
Timothy J. Baek
49677e9c9d refac 2024-08-04 17:04:15 +02:00
Jun Siang Cheah
73954f4a63 fix: admins viewing shared chats with ENABLE_ADMIN_CHAT_ACCESS set to false 2024-08-04 16:00:52 +01:00
Timothy J. Baek
a084938d9c refac: chatlist skip, limit -> page 2024-08-04 16:58:08 +02:00
Timothy Jaeryang Baek
1bf042ac84
Merge pull request #4351 from cheahjs/feat/disable-admin-chat-view
feat: add ENABLE_ADMIN_CHAT_ACCESS to control admin access to user chats
2024-08-04 16:37:30 +02:00
Jun Siang Cheah
565f40c642 feat: add ENABLE_ADMIN_CHAT_ACCESS to control admin access to user chats 2024-08-04 15:16:14 +01:00
Timothy Jaeryang Baek
389d650ee3
Merge pull request #4266 from thearyadev/sidebar-pagination
feat: Sidebar infinite scroll (pagination)
2024-08-04 15:33:09 +02:00
Timothy Jaeryang Baek
91851114e4
Merge pull request #4295 from michaelpoluektov/refactor-tools
refactor: Refactor OpenAI API to use helper functions, silence LSP/linter warnings
2024-08-04 14:17:52 +02:00
Timothy Jaeryang Baek
05977bd1c7
Merge pull request #4342 from michaelpoluektov/fix-non-streaming-function-text
fix: function returning "str"
2024-08-04 14:09:12 +02:00
Michael Poluektov
f8ba0334e8 fix: non streaming functions 2024-08-04 12:10:02 +01:00
Michael Poluektov
3653126179 refac: undo raw split, remove gpt-4-vision-preview 2024-08-04 00:34:24 +01:00
John Karabudak
cdcf214455 made the COMFYUI_FLUX_FP8_CLIP environment variable bool instead of str
this should fix #4328
2024-08-03 16:58:03 -02:30
Aryan Kothari
6847c2fc8c Merge branch 'origin/dev' into sidebar-pagination [skip ci] 2024-08-03 09:57:54 -04:00
Michael Poluektov
12c21fac22 refac: apps/openai/main.py and utils 2024-08-03 14:24:26 +01:00
Timothy J. Baek
24a177a149 chore: requirements 2024-08-03 00:47:05 +02:00
Timothy J. Baek
8062866973 chore: format 2024-08-02 22:35:02 +02:00
Timothy Jaeryang Baek
99530358fd
Merge pull request #4300 from JohnTheNerd/flux-image-gen
feat: added support for the new Flux image gen model using ComfyUI
2024-08-02 22:32:22 +02:00
Timothy J. Baek
b559bc84a7 refac 2024-08-02 19:24:47 +02:00
Timothy Jaeryang Baek
3f53abb233
Merge pull request #4018 from justinh-rahb/elevenlabs-voice-names
feat: Fetch ElevenLabs voice ID by name
2024-08-02 18:44:48 +02:00
Timothy J. Baek
8fcb5cee66 enh: min_p 2024-08-02 18:11:20 +02:00
John Karabudak
ad6e8edcd3 added support for the new Flux image gen model using ComfyUI
this commit adds three environment variables:

- COMFYUI_FLUX: determines whether Flux is used, the workflow is completely different so this is necessary.
- COMFYUI_FLUX_WEIGHT_DTYPE: sets the weight precision for Flux. you will probably want to set this to "fp8_e4m3fn" as the fp16 weights take up about 24GB of VRAM. optional, defaults to "default".
- COMFYUI_FLUX_FP8_CLIP: Flux requires two CLIP models downloaded, one of which is available in fp8 and fp16. set to true if you are using the fp8 CLIP weights.
2024-08-02 13:23:20 -02:30
Timothy J. Baek
546d442626 refac 2024-08-02 17:45:30 +02:00
Timothy Jaeryang Baek
a9a6ed8b71
Merge pull request #4237 from michaelpoluektov/refactor-webui-main
refactor: Simplify functions
2024-08-02 01:47:06 +02:00
Timothy J. Baek
e6c64282fc refac 2024-08-02 01:45:50 +02:00
Aryan Kothari
519375b4c0 add: skip and limit use in query
- limit default changed to -1
2024-08-01 15:13:45 -04:00
Timothy Jaeryang Baek
6ecb7c80f1
Merge pull request #4262 from michaelpoluektov/fix-redirect-uri
fix: Fix custom redirect URI for OAuth behind reverse proxy
2024-08-01 20:57:27 +02:00
Michael Poluektov
0352e956b6 fix: redirect uri 2024-08-01 12:54:06 +01:00
Michael Poluektov
f999956997 Merge remote-tracking branch 'oauth/main' into dev 2024-08-01 12:53:36 +01:00
Aryan Kothari
b7ad47017d fix: static dir path resolution
when running in different environments, the static_path is different.
This path is now 'determined' at runtime
2024-07-31 23:56:47 -04:00
Michael Poluektov
c89b34fd75 flatten job() 2024-07-31 22:05:37 +01:00
Michael Poluektov
b9b1fdd1a1 refac: rename message_template 2024-07-31 22:01:22 +01:00
Michael Poluektov
2e0fa1c6a0 refac: rename stream_message_template 2024-07-31 22:00:00 +01:00
Michael Poluektov
f8726719ef refac: rename whole_message_template, silence lsp 2024-07-31 21:58:40 +01:00
Michael Poluektov
034411e47e fix: type not manifold 2024-07-31 17:24:00 +01:00
Michael Poluektov
baf58ef396 refac: use add_or_update_system_message 2024-07-31 17:16:07 +01:00