Commit Graph

311 Commits

Author SHA1 Message Date
Timothy J. Baek
a392865615 refac 2024-07-01 17:11:09 -07:00
Timothy Jaeryang Baek
3c1ea24374
Merge pull request #3582 from nickovs/tika-document-text
feat: Support Tika for document text extraction
2024-07-01 17:07:40 -07:00
Nicko van Someren
7aa35a3757 Added HTML and Typescript UI components to support configration of text extraction engine.
Updated RAG /config and /config/update endpoints to support UI updates.

Fixed .dockerignore to prevent Python venv from being copied into Docker image.
2024-07-01 12:10:59 -06:00
Sergey Mihaylin
6e934c2d17 Merge branch 'refs/heads/main' into custom-openid-claims
# Conflicts:
#	backend/main.py
2024-07-01 10:08:38 +03:00
Nicko van Someren
9cf622d981 Added support for using Apache Tika as a document loader.
Added persistent configuration options to configure use and location of Tika service.

Updated backend.apps.rag.main:get_loader() to make use of Tika document loader.
2024-06-30 15:49:15 -06:00
Timothy J. Baek
d9a229b1ec fix: default locale 2024-06-30 14:48:05 -07:00
Sergey Mihaylin
0c3f9a16e3 custom env for set custom claims for openid 2024-06-28 16:31:40 +03:00
Timothy J. Baek
8dac2a2140 refac 2024-06-26 10:22:31 -07:00
Timothy Jaeryang Baek
16a8eebd8d
Merge pull request #3328 from FuturePrayer/AUTOMATIC1111_api_auth_support
feat: Supports making requests to the Automatic1111 backend when running with the --api-auth parameter
2024-06-24 19:40:55 -07:00
Jun Siang Cheah
f26d80dcae Merge remote-tracking branch 'upstream/dev' into feat/oauth 2024-06-24 18:46:48 +08:00
Timothy J. Baek
2eb15ea1fc feat: SAFE_MODE 2024-06-23 19:28:33 -07:00
Jun Siang Cheah
4aab460905 Merge remote-tracking branch 'upstream/dev' into feat/oauth 2024-06-21 13:43:19 +01:00
Timothy J. Baek
f68aba687e feat: functions router 2024-06-20 00:37:02 -07:00
sihuangwlp
bec04279aa Add AUTOMATIC1111_API_AUTH support 2024-06-20 14:15:49 +08:00
Timothy J. Baek
b1d83fc42c chore: format 2024-06-17 14:32:23 -07:00
Que Nguyen
b3d136b3b3
Refactored config.py
Renamed RAG_WEB_SEARCH_WHITE_LIST_DOMAINS to RAG_WEB_SEARCH_DOMAIN_FILTER_LIST
2024-06-17 14:33:23 +07:00
Que Nguyen
75e51ecf6d
Merge branch 'open-webui:main' into searxng 2024-06-17 14:28:02 +07:00
Timothy J. Baek
1efa25eed5 chore: format 2024-06-16 21:55:08 -07:00
John Karabudak
c00a6fa02a added ability to set user name for federated auth
this commit adds an optional environment variable named `WEBUI_AUTH_TRUSTED_NAME_HEADER`, which sets the user's name to the contents of that header. this only happens if the user is just being created, just like how the trusted e-mail header works.

if the environment variable or header is not present, we fall back to the original behavior which is to re-use the user e-mail address.

Co-Authored-By: Nikita Borzykh <sample@fastmail.com>
2024-06-16 18:44:10 -02:30
Timothy J. Baek
8e62c36148 enh: AIOHTTP_CLIENT_TIMEOUT None support 2024-06-16 13:56:49 -07:00
John Karabudak
ea074fa9bf added Stable Diffusion 3 support alongside ComfyUI configuration
this commit adds four environment variables:

- COMFYUI_CFG_SCALE
- COMFYUI_SAMPLER
- COMFYUI_SCHEDULER
- COMFYUI_SD3 (merely setting this at all will enable SD3 mode)
2024-06-16 15:30:52 -02:30
Jun Siang Cheah
4ff17acc1b Merge remote-tracking branch 'upstream/dev' into feat/oauth 2024-06-16 08:31:05 +01:00
Que Nguyen
a02ba52de8
Merge branch 'dev' into searxng 2024-06-15 23:44:31 +07:00
Timothy J. Baek
dfa2cf9e6d refac: AIOHTTP_CLIENT_TIMEOUT default value should match 2024-06-15 04:25:21 -06:00
Timothy Jaeryang Baek
8db439a0d1
Merge pull request #3177 from Yash-1511/main
feat: add tavily web search in web search provider
2024-06-14 11:09:59 -07:00
Yash-1511
b9da72560a feat: add tavily web search in web search provider 2024-06-14 20:44:11 +05:30
Timothy J. Baek
454a386612 refac 2024-06-14 00:10:52 -07:00
Que Nguyen
7b5f434a07
Implement domain whitelisting for web search results 2024-06-13 07:14:48 +07:00
Mikael Turøy
e130ad74d1 Added timeout setting for ollama streaming response 2024-06-12 22:50:15 +02:00
Timothy J. Baek
eead69068c fix: type casting 2024-06-12 01:35:42 -07:00
Timothy J. Baek
a27175d672 feat: fc integration 2024-06-10 23:40:27 -07:00
Timothy Jaeryang Baek
fcf8f2a704
Merge pull request #2952 from arkohut/tolerant-readonly-filesystem
fix: tolerant readonly filesystem for copy favicon to static dir
2024-06-10 11:59:06 -07:00
arkohut
d20f6cb45b fix: use Exception to handle all errors 2024-06-10 21:27:35 +08:00
teampen
14d33f0fcc Merge branch 'add-serply' into dev 2024-06-09 21:40:50 -04:00
teampen
4dcec4855e adding Serply as an alternative web search 2024-06-09 21:39:46 -04:00
Timothy J. Baek
8debb71197 feat: search query threshold 2024-06-09 15:19:36 -07:00
Timothy J. Baek
591cd993c2 refac: search query task 2024-06-09 14:53:10 -07:00
Timothy J. Baek
5e7237b9cb refac: title generation 2024-06-09 14:25:31 -07:00
arkohut
8e9e429a91 fix: tolerant readonly filesystem for copy favicon to static dir 2024-06-09 23:23:28 +08:00
Timothy Jaeryang Baek
9b839e5c9f
Merge pull request #2927 from arkohut/tolerant-no-write-permission-for-static-dir
fix: tolerant no write permission for copy favicon to static dir
2024-06-08 13:03:08 -07:00
arkohut
d3558fdb33 fix: tolerant no write permission for copy favicon to static dir 2024-06-08 13:56:08 +08:00
Timothy J. Baek
55dc6c1b3b refac: audio 2024-06-07 20:18:48 -07:00
Jun Siang Cheah
bba4c4242f feat: add WEBUI_SESSION_COOKIE_SECURE 2024-06-07 09:13:42 +01:00
Jun Siang Cheah
ae376ec8fe Merge remote-tracking branch 'upstream/dev' into feat/oauth 2024-06-05 19:23:52 +01:00
Jun Siang Cheah
af4f8aa589 feat: add WEBUI_SESSION_COOKIE_SAME_SITE for when open webui is embedded 2024-06-05 19:21:42 +01:00
Timothy J. Baek
25336f85f3 feat: admin details in account pending overlay 2024-06-03 21:17:43 -07:00
Timothy Jaeryang Baek
92d9b38110
Merge branch 'dev' into feat/openai-embeddings-batch 2024-06-03 12:39:09 -07:00
Timothy J. Baek
814fbb73f3 feat: RESET_CONFIG_ON_START 2024-06-02 18:14:36 -07:00
Jun Siang Cheah
0cb8163321 feat: add RAG_EMBEDDING_OPENAI_BATCH_SIZE to batch multiple embeddings 2024-06-02 15:34:31 +01:00
Timothy J. Baek
912a704fdc refac: web search settings 2024-06-01 19:40:48 -07:00
Timothy J. Baek
ea6b8984ab refac: web search 2024-06-01 19:03:56 -07:00
Timothy J. Baek
f3527df644 refac: styling 2024-05-27 13:22:24 -07:00
Timothy J. Baek
4685f523b6 refac 2024-05-27 12:48:08 -07:00
Jun Siang Cheah
6a36039a59 Merge remote-tracking branch 'upstream/dev' into feat/oauth 2024-05-27 18:14:43 +01:00
Jun Siang Cheah
06dbf59742 feat: make oauth config persist into config.json 2024-05-27 17:21:24 +01:00
Jun Siang Cheah
4a4e323a44 refac: rename OPENID -> OAUTH 2024-05-27 17:17:34 +01:00
Timothy Jaeryang Baek
bced90734b
Merge branch 'websearch' into feat/backend-web-search 2024-05-26 23:40:05 -07:00
Timothy Jaeryang Baek
78dedb3389
Merge branch 'dev' into feat/disable-community-sharing 2024-05-26 10:00:51 -10:00
Timothy J. Baek
242d4f0c8d feat: banners
Co-Authored-By: Jun Siang Cheah <me@jscheah.me>
2024-05-26 12:18:43 -07:00
Jun Siang Cheah
1235714914 feat: add ENABLE_COMMUNITY_SHARING 2024-05-26 17:10:25 +01:00
Jun Siang Cheah
276b7b90b8 Merge remote-tracking branch 'upstream/dev' into feat/backend-web-search 2024-05-26 11:31:23 +01:00
Jun Siang Cheah
aba6308825 Merge remote-tracking branch 'upstream/dev' into feat/include-git-hash-everywhere 2024-05-26 11:27:02 +01:00
Jun Siang Cheah
0210a105bf feat: experimental SSO support for Google, Microsoft, and OIDC 2024-05-26 11:26:15 +01:00
Jun Siang Cheah
4fdb26fdc4 refac: rename build hash vars 2024-05-26 08:49:30 +01:00
Timothy J. Baek
c1526b0022 fix 2024-05-25 15:56:47 -07:00
Timothy J. Baek
5e4a1ff6fb fix 2024-05-25 15:54:00 -07:00
Timothy J. Baek
74ca4189e2 fix 2024-05-25 15:46:22 -07:00
Timothy J. Baek
79f440f302 refac: byebye litellm 2024-05-25 14:43:35 -07:00
Jun Siang Cheah
60433856a2 Merge remote-tracking branch 'upstream/dev' into feat/backend-web-search 2024-05-22 22:28:45 +01:00
Timothy J. Baek
21ca55dd30 feat: toggleable ollama 2024-05-21 23:58:42 -07:00
Jun Siang Cheah
eb509c460a Merge remote-tracking branch 'origin/dev' into feat/backend-web-search 2024-05-20 18:01:29 +01:00
Tang Ziya
a018df2734 infra: build 2024-05-20 16:34:37 +08:00
Tang Ziya
d5a4ab46f4 changed: packaging using rye and use file relative path instead of pwd relative. 2024-05-20 16:34:36 +08:00
Timothy J. Baek
cdbabdfa5a refac 2024-05-17 10:30:22 -07:00
Jun Siang Cheah
5e1c408937 Merge branch 'dev' into feat/backend-web-search 2024-05-14 14:03:23 +08:00
Timothy J. Baek
0c033b5b7b refac: rename 2024-05-13 11:32:21 -10:00
Jun Siang Cheah
d45804d7f4 feat: web search available is inferred from env vars 2024-05-12 15:19:52 +08:00
Jun Siang Cheah
5d64822c84 refac: rename WrappedConfig to PersistedConfig 2024-05-12 13:28:40 +08:00
Jun Siang Cheah
77928ae141 Merge branch 'dev' of https://github.com/open-webui/open-webui into feat/web-search-toggle 2024-05-11 23:51:37 +08:00
Jun Siang Cheah
2660a6e5b8 feat: prototype frontend web search integration 2024-05-11 23:44:34 +08:00
Jun Siang Cheah
fb8069123e feat: add WEB_SEARCH_RESULT_COUNT to control max number of results 2024-05-11 23:18:59 +08:00
Jun Siang Cheah
a0dceb06a5 fix: nested WrappedConfig breaks things 2024-05-10 15:20:22 +08:00
Jun Siang Cheah
298e6848b3 feat: switch to config proxy, remove config_get/set 2024-05-10 15:03:24 +08:00
Jun Siang Cheah
f712c90019 feat: raise an exception if a WrappedConfig is used as a response 2024-05-10 14:18:39 +08:00
Jun Siang Cheah
058eb76568 feat: save UI config changes to config.json 2024-05-10 13:51:50 +08:00
Timothy J. Baek
1c2aa10796 refac: disable enable_signup if webui_auth false 2024-05-08 16:33:34 -07:00
Timothy J. Baek
06cbe337de feat: youtube loader language env var 2024-05-08 10:51:29 -07:00
Timothy J. Baek
01472c071b feat: support webui_auth false
#929
2024-05-08 08:40:18 -07:00
Timothy Jaeryang Baek
675328c881
Merge pull request #2002 from Yanyutin753/addAudio
🤩 Added custom openai tts models and role variables
2024-05-08 08:03:20 -07:00
Timothy J. Baek
f58eb0d266 feat: browser search engine support 2024-05-06 17:29:16 -07:00
Yanyutin753
5d6517c537 update the name 2024-05-07 08:28:34 +08:00
Timothy Jaeryang Baek
635951b55c
Merge branch 'dev' into feat/backend-web-search 2024-05-06 16:26:44 -07:00
Timothy J. Baek
c84e0aa2a3 fix: .env load 2024-05-06 16:16:26 -07:00
Timothy J. Baek
cecb87b8c2 feat: web_loader_ssl_verification setting 2024-05-06 14:50:55 -07:00
Timothy J. Baek
95f579cabe feat: rag ssl verification env var
Co-Authored-By: Tobias Steidle <tobias.steidle@softwaredev.de>
2024-05-06 13:12:08 -07:00
Yanyutin753
761c66a8d8 🤩 Added custom openai tts models and role variables 2024-05-06 15:23:27 +08:00
Jun Siang Cheah
501ff7a98b feat: backend implementation of various search APIs 2024-05-06 12:28:41 +08:00
Timothy J. Baek
714bdca3f3 refac: styling 2024-05-02 00:23:32 -07:00
Jun Siang Cheah
1c4e63f71e feat: add ENABLE_LOCAL_WEB_FETCH to protect against SSRF attacks 2024-04-29 20:55:17 +01:00
Jun Siang Cheah
6a1d60b1b3 feat: warn but not exit if frontend build does not exist 2024-04-28 16:03:30 +01:00