Commit Graph

986 Commits

Author SHA1 Message Date
Jan-Timo Hesse
367fa039a0 added install_frontmatter_requirements 2024-08-08 09:46:14 +02:00
John Karabudak
958fe9639a fix: ComfyUI generation no longer causes FastAPI to stall for all users
as the get_images() function involves a `while True` loop while waiting for a response from ComfyUI and is not async, when image generation is running the entire UI becomes unresponsive for all users.

furthermore, when image generation takes too long, the Docker health check starts failing.

this is certainly a bad fix as it does not convert everything to async, but rather just puts the blocking loop in a separate thread. however, it works and it at least fixes the problem for now.
2024-08-07 22:24:55 -02:30
Timothy Jaeryang Baek
670f28d694
Merge branch 'dev' into remove-ollama 2024-08-07 23:06:11 +02:00
Carter Roeser
d72d5d0e8e feat: Add OAuth Email Claim Variable
Add an `OAUTH_EMAIL_CLAIM` variable to override the default "email" claim value.
2024-08-07 11:39:51 -07:00
root
590fd129c8 SSRF Fix Updated 2024-08-07 10:59:22 -04:00
Timothy J. Baek
ad9a7cb1e2 refac 2024-08-07 15:52:03 +02:00
Timothy J. Baek
8187922ef1 fix: "metadata" issue 2024-08-07 15:49:48 +02:00
root
1f8d08eaa2 SSRF Fix 2024-08-07 03:30:21 -04:00
Michael Poluektov
ed205d82e8 fix: pop 2024-08-06 12:25:00 +01:00
Michael Poluektov
fc31267a54 refac: re-use utils.misc 2024-08-06 11:31:45 +01:00
Michael Poluektov
44c781f414 cleanup 2024-08-06 10:50:22 +01:00
Michael Poluektov
831fe9f509 cleanup 2024-08-06 10:15:29 +01:00
Timothy Jaeryang Baek
003ceff7e4
Merge pull request #4349 from open-webui/dev-scroll
feat: Sidebar infinite scroll (pagination)
2024-08-04 17:36:18 +02:00
Timothy J. Baek
209ccdf668 refac 2024-08-04 17:35:26 +02:00
Timothy J. Baek
49677e9c9d refac 2024-08-04 17:04:15 +02:00
Jun Siang Cheah
73954f4a63 fix: admins viewing shared chats with ENABLE_ADMIN_CHAT_ACCESS set to false 2024-08-04 16:00:52 +01:00
Timothy J. Baek
a084938d9c refac: chatlist skip, limit -> page 2024-08-04 16:58:08 +02:00
Timothy Jaeryang Baek
1bf042ac84
Merge pull request #4351 from cheahjs/feat/disable-admin-chat-view
feat: add ENABLE_ADMIN_CHAT_ACCESS to control admin access to user chats
2024-08-04 16:37:30 +02:00
Jun Siang Cheah
565f40c642 feat: add ENABLE_ADMIN_CHAT_ACCESS to control admin access to user chats 2024-08-04 15:16:14 +01:00
Timothy Jaeryang Baek
389d650ee3
Merge pull request #4266 from thearyadev/sidebar-pagination
feat: Sidebar infinite scroll (pagination)
2024-08-04 15:33:09 +02:00
Michael Poluektov
3653126179 refac: undo raw split, remove gpt-4-vision-preview 2024-08-04 00:34:24 +01:00
Aryan Kothari
6847c2fc8c Merge branch 'origin/dev' into sidebar-pagination [skip ci] 2024-08-03 09:57:54 -04:00
Michael Poluektov
12c21fac22 refac: apps/openai/main.py and utils 2024-08-03 14:24:26 +01:00
Timothy J. Baek
8062866973 chore: format 2024-08-02 22:35:02 +02:00
Timothy Jaeryang Baek
99530358fd
Merge pull request #4300 from JohnTheNerd/flux-image-gen
feat: added support for the new Flux image gen model using ComfyUI
2024-08-02 22:32:22 +02:00
Timothy J. Baek
b559bc84a7 refac 2024-08-02 19:24:47 +02:00
Timothy Jaeryang Baek
3f53abb233
Merge pull request #4018 from justinh-rahb/elevenlabs-voice-names
feat: Fetch ElevenLabs voice ID by name
2024-08-02 18:44:48 +02:00
Timothy J. Baek
8fcb5cee66 enh: min_p 2024-08-02 18:11:20 +02:00
John Karabudak
ad6e8edcd3 added support for the new Flux image gen model using ComfyUI
this commit adds three environment variables:

- COMFYUI_FLUX: determines whether Flux is used, the workflow is completely different so this is necessary.
- COMFYUI_FLUX_WEIGHT_DTYPE: sets the weight precision for Flux. you will probably want to set this to "fp8_e4m3fn" as the fp16 weights take up about 24GB of VRAM. optional, defaults to "default".
- COMFYUI_FLUX_FP8_CLIP: Flux requires two CLIP models downloaded, one of which is available in fp8 and fp16. set to true if you are using the fp8 CLIP weights.
2024-08-02 13:23:20 -02:30
Timothy Jaeryang Baek
a9a6ed8b71
Merge pull request #4237 from michaelpoluektov/refactor-webui-main
refactor: Simplify functions
2024-08-02 01:47:06 +02:00
Timothy J. Baek
e6c64282fc refac 2024-08-02 01:45:50 +02:00
Aryan Kothari
519375b4c0 add: skip and limit use in query
- limit default changed to -1
2024-08-01 15:13:45 -04:00
Aryan Kothari
b7ad47017d fix: static dir path resolution
when running in different environments, the static_path is different.
This path is now 'determined' at runtime
2024-07-31 23:56:47 -04:00
Michael Poluektov
c89b34fd75 flatten job() 2024-07-31 22:05:37 +01:00
Michael Poluektov
2e0fa1c6a0 refac: rename stream_message_template 2024-07-31 22:00:00 +01:00
Michael Poluektov
f8726719ef refac: rename whole_message_template, silence lsp 2024-07-31 21:58:40 +01:00
Michael Poluektov
034411e47e fix: type not manifold 2024-07-31 17:24:00 +01:00
Michael Poluektov
baf58ef396 refac: use add_or_update_system_message 2024-07-31 17:16:07 +01:00
Michael Poluektov
006fc3495e fix: stream_message_template 2024-07-31 16:45:47 +01:00
Michael Poluektov
29a3b82336 refac: reuse stream_message_template 2024-07-31 15:26:26 +01:00
Michael Poluektov
deec41d29a fix: function early returns 2024-07-31 13:51:25 +01:00
Michael Poluektov
3978efd710 refac: Refactor functions 2024-07-31 13:35:02 +01:00
Timothy Jaeryang Baek
2e4de209fe
Merge pull request #4149 from arsaboo/openrouter
chore: Add HTTP-Referer and X-Title headers for OpenRouter
2024-07-27 16:06:17 +02:00
Alok Saboo
287147687e Add HTTP-Referer and X-Title headers for OpenRouter 2024-07-27 09:43:03 -04:00
Timothy Jaeryang Baek
065d23d0b1
Merge pull request #4068 from Louden7/main
feat: Added environment variable to hide email and password sign in elements
2024-07-25 11:21:49 +02:00
Dillon
36b94ca5f5 updated environment variable to suggested ENABLE_LOGIN_FORM 2024-07-24 21:44:40 -04:00
Timothy J. Baek
23e69bcdb4 enh: AsyncGenerator support 2024-07-24 11:29:57 +01:00
Timothy J. Baek
edff071cd2 refac 2024-07-24 11:25:07 +01:00
Dillon
709b56bc40 imported and added new ENABLE_USERNAME_PASSWORD_LOGIN environment variable 2024-07-23 22:19:41 -04:00
Aryan Kothari
f531a51e91 chore: formatting 2024-07-22 14:45:47 -04:00
Aryan Kothari
a0667dfd1b change /chats/ and /chats/list to utilize new function 2024-07-22 14:09:22 -04:00
Aryan Kothari
2b78e613a4 add func to get chat list with more specific sql query 2024-07-22 14:08:15 -04:00
Justin Hayes
c6c298b412
Fetch didn't happen 2024-07-20 11:02:59 -04:00
Seth Rothschild
c3693c91b3 fix: allow temperature and seed to be 0 2024-07-20 06:53:52 -04:00
Justin Hayes
0216ee101c
enh: ElevenLabs voice name -> ID 2024-07-20 02:56:00 -04:00
Timothy J. Baek
e664a429a1 feat: elevenlabs tts support 2024-07-19 10:35:05 +02:00
José Luis Di Biase
23c9122458 chore RAG: adding languages known extension for erlang, elixir, haskell and jsx/tsx
Signed-off-by: José Luis Di Biase <josx@interorganic.com.ar>
2024-07-18 17:48:39 -03:00
Timothy J. Baek
3d0f457306 refac 2024-07-17 10:16:27 +02:00
Timothy J. Baek
40075f69f9 refac 2024-07-15 16:25:00 +02:00
Timothy J. Baek
dbc352f01b refac: documents file handling 2024-07-15 13:05:38 +02:00
Timothy J. Baek
69083b6485 revert 2024-07-15 11:09:05 +02:00
Jerry
f07172bfe6 fix the checking logic in get_model_path
fix the checking logic in function get_model_path()
2024-07-12 14:21:37 +08:00
Timothy J. Baek
eb10001eb7 feat: action function 2024-07-11 18:41:00 -07:00
Timothy J. Baek
9f9122b6d7 enh: ChatValves 2024-07-11 16:24:59 -07:00
Timothy J. Baek
8dcb3d78dc refac 2024-07-11 15:20:56 -07:00
Timothy J. Baek
4dd77b785a fix 2024-07-11 14:12:44 -07:00
Timothy J. Baek
f462744fc8 refac 2024-07-11 13:43:44 -07:00
Timothy J. Baek
b094153af2 fix 2024-07-11 10:41:13 -07:00
Timothy J. Baek
0ef27bfc5e refac 2024-07-11 10:40:10 -07:00
Timothy J. Baek
ebcc5be1bf fix: db 2024-07-10 13:35:52 -07:00
Timothy J. Baek
c9f5029a9d refac 2024-07-08 23:07:23 -07:00
Timothy J. Baek
d3ef3a7494 refac 2024-07-08 12:42:52 -07:00
Timothy J. Baek
68d775e1ab chore: rm print 2024-07-08 12:08:27 -07:00
Timothy J. Baek
3ddd88dad7 chore: rm print 2024-07-08 12:00:09 -07:00
Timothy J. Baek
42742d03d7 fix: model update 2024-07-08 11:58:36 -07:00
Timothy J. Baek
87f656b029 fix: tools update 2024-07-08 11:46:37 -07:00
Timothy J. Baek
3b27acc77e fix 2024-07-08 11:34:24 -07:00
Jonathan Rohde
3b112375ee feat(documents): commit document delete 2024-07-08 09:14:45 +02:00
Timothy J. Baek
c1d706dc5a fix: db issues 2024-07-07 23:01:15 -07:00
Peter De-Ath
1bb2724282 fix password update in AuthsTable model 2024-07-07 22:27:26 +01:00
Peter De-Ath
f971ba0c0b fix email update in AuthsTable model 2024-07-07 22:07:12 +01:00
Timothy J. Baek
d51e866505 fix: db 2024-07-07 09:09:09 -07:00
Timothy Jaeryang Baek
7e6c5193d6
Merge pull request #3688 from leobenkel/no-trace-when-success
fix: Remove the tracestack when the collection already exists
2024-07-07 09:00:23 -07:00
Leo Benkel
a73a9c7310 Remove the tracestack when the collection already exists 2024-07-06 23:20:41 +02:00
Timothy J. Baek
c9b85bd4a2 fix: delete 2024-07-06 08:10:58 -07:00
Timothy J. Baek
1436bb7c61 enh: handle peewee migration 2024-07-05 23:38:53 -07:00
Timothy Jaeryang Baek
d60f06608e
Merge pull request #3668 from open-webui/dev
dev
2024-07-05 22:29:13 -07:00
Timothy J. Baek
67c2ab006d fix: pipe custom model 2024-07-04 13:41:18 -07:00
Timothy J. Baek
9a6cbafdef fix: user valves 2024-07-04 00:37:05 -07:00
Timothy J. Baek
8b13755d56 Update auths.py 2024-07-04 00:25:45 -07:00
Timothy J. Baek
8fe2a7bb75 fix 2024-07-03 23:39:16 -07:00
Timothy J. Baek
37a5d2c06b Update db.py 2024-07-03 23:32:46 -07:00
Timothy J. Baek
864646094e refac 2024-07-03 23:32:39 -07:00
Timothy J. Baek
1b65df3acc revert 2024-07-03 21:28:51 -07:00
Timothy J. Baek
bfc53b49fd revert 2024-07-03 21:28:14 -07:00
Timothy J. Baek
15f6f7bd15 revert: peewee migrations 2024-07-03 21:12:16 -07:00
Timothy Jaeryang Baek
0d78b63805
Merge pull request #3621 from open-webui/dev
dev
2024-07-03 20:59:14 -07:00
Timothy Jaeryang Baek
08c024d752
Merge pull request #3569 from Semihal/custom-openid-claims
feat: Custom claims for OAuth
2024-07-03 15:56:37 -07:00
Timothy J. Baek
4d23957035 revert: model_validate 2024-07-02 21:56:32 -07:00
Timothy J. Baek
aa88022624 fix: functions 2024-07-02 21:50:53 -07:00
Timothy J. Baek
44a9b86eec fix: functions 2024-07-02 21:46:56 -07:00
Timothy Jaeryang Baek
d0e89a0318
Merge pull request #3327 from jonathan-rohde/feat/sqlalchemy-instead-of-peewee
BREAKING CHANGE/sqlalchemy instead of peewee
2024-07-02 16:40:13 -07:00
Timothy J. Baek
c7a9b5ccfa refac: chat completion middleware 2024-07-01 19:33:58 -07:00
Timothy J. Baek
a392865615 refac 2024-07-01 17:11:09 -07:00
Timothy Jaeryang Baek
3c1ea24374
Merge pull request #3582 from nickovs/tika-document-text
feat: Support Tika for document text extraction
2024-07-01 17:07:40 -07:00
Timothy J. Baek
bd45b7a04b fix 2024-07-01 16:11:44 -07:00
Timothy J. Baek
9c01297191 fix 2024-07-01 16:11:24 -07:00
Nicko van Someren
7aa35a3757 Added HTML and Typescript UI components to support configration of text extraction engine.
Updated RAG /config and /config/update endpoints to support UI updates.

Fixed .dockerignore to prevent Python venv from being copied into Docker image.
2024-07-01 12:10:59 -06:00
Jonathan Rohde
2aecd7d0b9 Merge branch 'refs/heads/dev' into feat/sqlalchemy-instead-of-peewee
# Conflicts:
#	backend/requirements.txt
2024-07-01 10:37:56 +02:00
Sergey Mihaylin
a94c7e5c09 fix lint 2024-07-01 10:36:21 +03:00
Sergey Mihaylin
6e934c2d17 Merge branch 'refs/heads/main' into custom-openid-claims
# Conflicts:
#	backend/main.py
2024-07-01 10:08:38 +03:00
Fish Lung
f89fa061e8 fix: use AIOHTTP_CLIENT_TIMEOUT timeout setting for openai streaming response 2024-07-01 14:29:26 +08:00
Timothy J. Baek
7955c9ba3b refac 2024-06-30 22:28:43 -07:00
Jun Siang Cheah
a48ac6a209 refac: lazily load sentence_transformers to reduce start up memory usage 2024-07-01 08:13:56 +08:00
Jun Siang Cheah
17c684369e refac: lazily load faster_whisper to reduce start up memory usage 2024-07-01 08:13:02 +08:00
Nicko van Someren
9cf622d981 Added support for using Apache Tika as a document loader.
Added persistent configuration options to configure use and location of Tika service.

Updated backend.apps.rag.main:get_loader() to make use of Tika document loader.
2024-06-30 15:49:15 -06:00
Timothy J. Baek
f6efda9e2f refac: ollama non stream response 2024-06-30 01:30:19 -07:00
Sergey Mihaylin
0c3f9a16e3 custom env for set custom claims for openid 2024-06-28 16:31:40 +03:00
Jonathan Rohde
df47c496d3 Merge branch 'refs/heads/dev' into feat/sqlalchemy-instead-of-peewee
# Conflicts:
#	backend/apps/webui/models/functions.py
#	backend/apps/webui/routers/chats.py
2024-06-28 09:19:56 +02:00
Timothy J. Baek
cd9170ed24 fix: trusted sign in 2024-06-27 21:44:35 -07:00
Timothy J. Baek
feba50f68c fix: WEBUI_AUTH 2024-06-27 21:43:19 -07:00
Timothy J. Baek
edbd07f893 feat: global filter 2024-06-27 13:04:12 -07:00
Timothy J. Baek
3f5f410453 refac 2024-06-27 11:29:59 -07:00
Jonathan Rohde
23e4d9daff feat(sqlalchemy): formatting 2024-06-27 07:48:26 +02:00
Jonathan Rohde
d4b6b7c4e8 feat(sqlalchemy): reverted not needed api change 2024-06-27 07:48:08 +02:00
Jonathan Rohde
642c352c69 feat(sqlalchemy): rebase 2024-06-27 07:48:08 +02:00
Jonathan Rohde
d88bd51e3c feat(sqlalchemy): format backend 2024-06-27 07:48:08 +02:00
Jonathan Rohde
8f939cf55b feat(sqlalchemy): some fixes 2024-06-27 07:48:08 +02:00
Jonathan Rohde
a9b148791d feat(sqlalchemy): fix wrong column types 2024-06-27 07:48:08 +02:00
Jonathan Rohde
da403f3e3c feat(sqlalchemy): use session factory instead of context manager 2024-06-27 07:48:08 +02:00
Jonathan Rohde
eb01e8d275 feat(sqlalchemy): use scoped session 2024-06-27 07:48:08 +02:00
Jonathan Rohde
c134eab27a feat(sqlalchemy): format backend 2024-06-27 07:48:08 +02:00
Jonathan Rohde
320e658595 feat(sqlalchemy): cleanup fixes 2024-06-27 07:48:08 +02:00
Jonathan Rohde
bee835cb65 feat(sqlalchemy): remove session reference from router 2024-06-27 07:48:08 +02:00
Jonathan Rohde
df09d0830a feat(sqlalchemy): Replace peewee with sqlalchemy 2024-06-27 07:48:08 +02:00
Timothy Jaeryang Baek
70c985feec
Merge pull request #3447 from ben-z/stt-model-configurable
fix: Make STT model configurable
2024-06-25 15:26:57 -07:00
Ben Zhang
044bd00386 Make STT model configurable 2024-06-25 21:46:12 +00:00
Timothy J. Baek
36e88d479b chore: format 2024-06-25 08:01:05 -07:00
Timothy Jaeryang Baek
16a8eebd8d
Merge pull request #3328 from FuturePrayer/AUTOMATIC1111_api_auth_support
feat: Supports making requests to the Automatic1111 backend when running with the --api-auth parameter
2024-06-24 19:40:55 -07:00
Timothy Jaeryang Baek
d17dc59246
Merge pull request #2574 from cheahjs/feat/oauth
feat: experimental SSO support for Google, Microsoft, and OIDC
2024-06-24 19:05:58 -07:00
Timothy J. Baek
d361404a60 refac 2024-06-24 13:33:03 -07:00
Timothy J. Baek
4c9fa6cf37 enh: pipe handling 2024-06-24 12:56:41 -07:00
Timothy J. Baek
1c4e7f0324 refac 2024-06-24 11:17:18 -07:00
Timothy J. Baek
6bad71adca fix 2024-06-24 10:37:57 -07:00
Jun Siang Cheah
ca8c098f62 refac: update migrations to match dev 2024-06-24 18:48:28 +08:00
Jun Siang Cheah
f26d80dcae Merge remote-tracking branch 'upstream/dev' into feat/oauth 2024-06-24 18:46:48 +08:00
Timothy J. Baek
5c0015cd66 fix: frontmatter 2024-06-23 20:37:41 -07:00
Timothy J. Baek
abf212c28f enh: tools & functions frontmatter 2024-06-23 20:31:40 -07:00
Timothy J. Baek
0250f69da0 fix: valves 2024-06-23 19:48:16 -07:00
Timothy J. Baek
2eb15ea1fc feat: SAFE_MODE 2024-06-23 19:28:33 -07:00