Timothy Jaeryang Baek
3c1ea24374
Merge pull request #3582 from nickovs/tika-document-text
...
feat: Support Tika for document text extraction
2024-07-01 17:07:40 -07:00
Timothy J. Baek
bd45b7a04b
fix
2024-07-01 16:11:44 -07:00
Timothy J. Baek
9c01297191
fix
2024-07-01 16:11:24 -07:00
Nicko van Someren
7aa35a3757
Added HTML and Typescript UI components to support configration of text extraction engine.
...
Updated RAG /config and /config/update endpoints to support UI updates.
Fixed .dockerignore to prevent Python venv from being copied into Docker image.
2024-07-01 12:10:59 -06:00
Jonathan Rohde
2aecd7d0b9
Merge branch 'refs/heads/dev' into feat/sqlalchemy-instead-of-peewee
...
# Conflicts:
# backend/requirements.txt
2024-07-01 10:37:56 +02:00
Sergey Mihaylin
a94c7e5c09
fix lint
2024-07-01 10:36:21 +03:00
Sergey Mihaylin
6e934c2d17
Merge branch 'refs/heads/main' into custom-openid-claims
...
# Conflicts:
# backend/main.py
2024-07-01 10:08:38 +03:00
Fish Lung
f89fa061e8
fix: use AIOHTTP_CLIENT_TIMEOUT timeout setting for openai streaming response
2024-07-01 14:29:26 +08:00
Timothy J. Baek
7955c9ba3b
refac
2024-06-30 22:28:43 -07:00
Jun Siang Cheah
a48ac6a209
refac: lazily load sentence_transformers to reduce start up memory usage
2024-07-01 08:13:56 +08:00
Jun Siang Cheah
17c684369e
refac: lazily load faster_whisper to reduce start up memory usage
2024-07-01 08:13:02 +08:00
Nicko van Someren
9cf622d981
Added support for using Apache Tika as a document loader.
...
Added persistent configuration options to configure use and location of Tika service.
Updated backend.apps.rag.main:get_loader() to make use of Tika document loader.
2024-06-30 15:49:15 -06:00
Timothy J. Baek
f6efda9e2f
refac: ollama non stream response
2024-06-30 01:30:19 -07:00
Sergey Mihaylin
0c3f9a16e3
custom env for set custom claims for openid
2024-06-28 16:31:40 +03:00
Jonathan Rohde
df47c496d3
Merge branch 'refs/heads/dev' into feat/sqlalchemy-instead-of-peewee
...
# Conflicts:
# backend/apps/webui/models/functions.py
# backend/apps/webui/routers/chats.py
2024-06-28 09:19:56 +02:00
Timothy J. Baek
cd9170ed24
fix: trusted sign in
2024-06-27 21:44:35 -07:00
Timothy J. Baek
feba50f68c
fix: WEBUI_AUTH
2024-06-27 21:43:19 -07:00
Timothy J. Baek
edbd07f893
feat: global filter
2024-06-27 13:04:12 -07:00
Timothy J. Baek
3f5f410453
refac
2024-06-27 11:29:59 -07:00
Jonathan Rohde
23e4d9daff
feat(sqlalchemy): formatting
2024-06-27 07:48:26 +02:00
Jonathan Rohde
d4b6b7c4e8
feat(sqlalchemy): reverted not needed api change
2024-06-27 07:48:08 +02:00
Jonathan Rohde
642c352c69
feat(sqlalchemy): rebase
2024-06-27 07:48:08 +02:00
Jonathan Rohde
d88bd51e3c
feat(sqlalchemy): format backend
2024-06-27 07:48:08 +02:00
Jonathan Rohde
8f939cf55b
feat(sqlalchemy): some fixes
2024-06-27 07:48:08 +02:00
Jonathan Rohde
a9b148791d
feat(sqlalchemy): fix wrong column types
2024-06-27 07:48:08 +02:00
Jonathan Rohde
da403f3e3c
feat(sqlalchemy): use session factory instead of context manager
2024-06-27 07:48:08 +02:00
Jonathan Rohde
eb01e8d275
feat(sqlalchemy): use scoped session
2024-06-27 07:48:08 +02:00
Jonathan Rohde
c134eab27a
feat(sqlalchemy): format backend
2024-06-27 07:48:08 +02:00
Jonathan Rohde
320e658595
feat(sqlalchemy): cleanup fixes
2024-06-27 07:48:08 +02:00
Jonathan Rohde
bee835cb65
feat(sqlalchemy): remove session reference from router
2024-06-27 07:48:08 +02:00
Jonathan Rohde
df09d0830a
feat(sqlalchemy): Replace peewee with sqlalchemy
2024-06-27 07:48:08 +02:00
Timothy Jaeryang Baek
70c985feec
Merge pull request #3447 from ben-z/stt-model-configurable
...
fix: Make STT model configurable
2024-06-25 15:26:57 -07:00
Ben Zhang
044bd00386
Make STT model configurable
2024-06-25 21:46:12 +00:00
Timothy J. Baek
36e88d479b
chore: format
2024-06-25 08:01:05 -07:00
Timothy Jaeryang Baek
16a8eebd8d
Merge pull request #3328 from FuturePrayer/AUTOMATIC1111_api_auth_support
...
feat: Supports making requests to the Automatic1111 backend when running with the --api-auth parameter
2024-06-24 19:40:55 -07:00
Timothy Jaeryang Baek
d17dc59246
Merge pull request #2574 from cheahjs/feat/oauth
...
feat: experimental SSO support for Google, Microsoft, and OIDC
2024-06-24 19:05:58 -07:00
Timothy J. Baek
d361404a60
refac
2024-06-24 13:33:03 -07:00
Timothy J. Baek
4c9fa6cf37
enh: pipe handling
2024-06-24 12:56:41 -07:00
Timothy J. Baek
1c4e7f0324
refac
2024-06-24 11:17:18 -07:00
Timothy J. Baek
6bad71adca
fix
2024-06-24 10:37:57 -07:00
Jun Siang Cheah
ca8c098f62
refac: update migrations to match dev
2024-06-24 18:48:28 +08:00
Jun Siang Cheah
f26d80dcae
Merge remote-tracking branch 'upstream/dev' into feat/oauth
2024-06-24 18:46:48 +08:00
Timothy J. Baek
5c0015cd66
fix: frontmatter
2024-06-23 20:37:41 -07:00
Timothy J. Baek
abf212c28f
enh: tools & functions frontmatter
2024-06-23 20:31:40 -07:00
Timothy J. Baek
0250f69da0
fix: valves
2024-06-23 19:48:16 -07:00
Timothy J. Baek
2eb15ea1fc
feat: SAFE_MODE
2024-06-23 19:28:33 -07:00
Timothy J. Baek
0cf936f9e8
refac
2024-06-23 19:18:13 -07:00
Timothy J. Baek
26e735618e
fix: tools valves
2024-06-23 19:10:52 -07:00
Timothy J. Baek
dc25f44d31
fix: handle default
2024-06-23 19:05:56 -07:00
Timothy J. Baek
627705a347
feat: valves
2024-06-23 19:02:27 -07:00
Timothy J. Baek
d8c112d8b0
feat: function toggle support
2024-06-23 18:34:42 -07:00
Timothy J. Baek
120b1857b2
enh: valves
2024-06-23 18:05:33 -07:00
Timothy J. Baek
6ee94c5e97
chore: format
2024-06-22 16:15:19 -07:00
Timothy Jaeryang Baek
fd96c9c68d
Merge pull request #3380 from Yash-1511/main
...
feat: add jina_search as new websearch provider
2024-06-22 15:19:38 -07:00
Timothy J. Baek
60e5adc70e
enh: files api allow filename
2024-06-22 14:49:00 -07:00
Timothy J. Baek
d362fd027e
feat: user valves integration
2024-06-22 12:08:32 -07:00
Timothy J. Baek
15fc23df87
feat: user valves endpoints
2024-06-22 11:26:33 -07:00
Yash-1511
7c9fb9199e
feat: add jina_search as new websearch provider
2024-06-22 20:06:15 +05:30
Timothy J. Baek
ae567796ee
refac
2024-06-22 01:39:53 -07:00
Jun Siang Cheah
981f384154
refac: modify oauth login logic for unique email addresses
2024-06-21 18:25:19 +01:00
Jun Siang Cheah
416e8d1ef9
fix: db migration sync with dev
2024-06-21 14:35:57 +01:00
Jun Siang Cheah
922dfae51c
fix: broken tuple expansion
2024-06-21 13:44:10 +01:00
Jun Siang Cheah
4aab460905
Merge remote-tracking branch 'upstream/dev' into feat/oauth
2024-06-21 13:43:19 +01:00
Timothy J. Baek
58ae91369e
refac
2024-06-20 13:49:04 -07:00
Timothy J. Baek
f1de635988
refac: cookie
2024-06-20 13:14:58 -07:00
Timothy J. Baek
5a2c2770a4
chore: format
2024-06-20 04:53:23 -07:00
Timothy J. Baek
59fa2f8f26
refac: pipe function support
2024-06-20 04:47:40 -07:00
Timothy J. Baek
d6e4aef607
feat: pipe function
2024-06-20 04:38:59 -07:00
Timothy J. Baek
c689356b31
refac
2024-06-20 03:57:36 -07:00
Timothy J. Baek
015772ef9a
refac
2024-06-20 03:45:13 -07:00
Timothy J. Baek
bf5775e07a
refac
2024-06-20 01:16:31 -07:00
Timothy J. Baek
43e08c6afa
refac
2024-06-20 00:54:58 -07:00
Timothy J. Baek
27f8afebab
feat: function db migration
2024-06-20 00:49:11 -07:00
Timothy J. Baek
f68aba687e
feat: functions router
2024-06-20 00:37:02 -07:00
sihuangwlp
e16ae92edc
complate missing field AUTOMATIC1111_API_AUTH
2024-06-20 14:53:38 +08:00
sihuangwlp
bec04279aa
Add AUTOMATIC1111_API_AUTH support
2024-06-20 14:15:49 +08:00
Timothy Jaeryang Baek
1e0453221d
Merge pull request #3221 from perfectra1n/feature-external-db-reconnect
...
feat: external db reconnect
2024-06-19 14:40:03 -07:00
Timothy J. Baek
b36c525ebc
enh: cookie auth
2024-06-19 14:38:09 -07:00
Que Nguyen
9e87012489
Fix: Rename 'whitelist' to 'filter_list' in function
2024-06-19 18:22:29 +07:00
Timothy J. Baek
6f9a31eba5
feat: tool cache dir
2024-06-18 18:07:51 -07:00
Timothy J. Baek
d5a1030000
refac: uploads delete
2024-06-18 15:20:04 -07:00
Timothy J. Baek
20e4f6cc16
refac
2024-06-18 14:55:18 -07:00
Timothy J. Baek
b4bdea6d85
fix: files
2024-06-18 14:33:44 -07:00
Timothy J. Baek
83986620ee
refac
2024-06-18 14:15:08 -07:00
Timothy J. Baek
9e7b7a895e
refac: file upload
2024-06-18 13:50:18 -07:00
perfectra1n
7e061d19ca
Merge branch 'open-webui:main' into feature-external-db-reconnect
2024-06-18 12:11:28 -07:00
Timothy J. Baek
7c2a198370
feat: file db migration
2024-06-18 11:38:50 -07:00
Timothy J. Baek
146e550239
feat: files endpoint
2024-06-18 11:36:55 -07:00
Timothy J. Baek
ba7091c25b
refac
2024-06-18 10:36:06 -07:00
Timothy J. Baek
453f9be16c
refac
2024-06-18 10:26:53 -07:00
perf3ct
81b2416923
format
2024-06-17 16:47:09 -07:00
perf3ct
59c6ff727a
borrow some of the previous PRs reconnection code
2024-06-17 16:44:20 -07:00
Timothy J. Baek
b1d83fc42c
chore: format
2024-06-17 14:32:23 -07:00
Timothy Jaeryang Baek
20f052eb37
Merge pull request #3112 from que-nguyen/searxng
...
Domain whitelisting for web search results
2024-06-17 14:30:17 -07:00
Timothy J. Baek
686c5081e6
fix: model system prompt variable support
2024-06-17 13:47:48 -07:00
perf3ct
48e1356ed9
add logging for user upon db connection
2024-06-17 10:34:19 -07:00
perf3ct
5c655f298b
stop even using pooled DBs in peewee
2024-06-17 09:56:31 -07:00
perf3ct
981866eb93
use autoconnect and stop using the mixin
2024-06-17 07:50:47 -07:00
Que Nguyen
c487385980
Set filter_list as optional param in serpstack.py
2024-06-17 14:38:11 +07:00
Que Nguyen
bcb84235b1
Set filter_list as optional param in serply.py
2024-06-17 14:37:52 +07:00
Que Nguyen
6b8290fa6d
Set filter_list as optional param in serper.py
2024-06-17 14:37:26 +07:00
Que Nguyen
9c446d9fb4
Set filter_list as optional param in searxng.py
2024-06-17 14:36:56 +07:00
Que Nguyen
3cc0e3ecb6
Refactor rag/main.py
...
Renamed function get_filtered_results
2024-06-17 14:36:26 +07:00
Que Nguyen
d8beed13b4
Set filter_list as optional param in google_pse.py
2024-06-17 14:35:27 +07:00
Que Nguyen
7d2ad8c4bf
Set filter_list as optional param in duckduckgo.py
2024-06-17 14:34:59 +07:00
Que Nguyen
a02139ba9d
Set filter_list as optional param in brave.py
2024-06-17 14:34:17 +07:00
Que Nguyen
a3ac9ee774
Refactor main.py
...
Rename RAG_WEB_SEARCH_WHITE_LIST_DOMAINS to RAG_WEB_SEARCH_DOMAIN_FILTER_LIST
2024-06-17 14:31:44 +07:00
Que Nguyen
75e51ecf6d
Merge branch 'open-webui:main' into searxng
2024-06-17 14:28:02 +07:00
Timothy J. Baek
a28ad06bf0
fix
2024-06-16 23:36:21 -07:00
Timothy J. Baek
1efa25eed5
chore: format
2024-06-16 21:55:08 -07:00
Timothy Jaeryang Baek
f3bd81073d
Merge pull request #3202 from JohnTheNerd/main
...
feat: added ability to set user name for federated auth
2024-06-16 17:56:29 -07:00
Timothy J. Baek
e183b0e5ff
chore: format
2024-06-16 15:34:15 -07:00
Timothy J. Baek
4b6b33b08b
feat: user_location
2024-06-16 15:32:26 -07:00
perf3ct
10fa887eab
fix peewee and playhouse connections to retry
2024-06-16 15:25:48 -07:00
John Karabudak
c00a6fa02a
added ability to set user name for federated auth
...
this commit adds an optional environment variable named `WEBUI_AUTH_TRUSTED_NAME_HEADER`, which sets the user's name to the contents of that header. this only happens if the user is just being created, just like how the trusted e-mail header works.
if the environment variable or header is not present, we fall back to the original behavior which is to re-use the user e-mail address.
Co-Authored-By: Nikita Borzykh <sample@fastmail.com>
2024-06-16 18:44:10 -02:30
John Karabudak
ea074fa9bf
added Stable Diffusion 3 support alongside ComfyUI configuration
...
this commit adds four environment variables:
- COMFYUI_CFG_SCALE
- COMFYUI_SAMPLER
- COMFYUI_SCHEDULER
- COMFYUI_SD3 (merely setting this at all will enable SD3 mode)
2024-06-16 15:30:52 -02:30
Timothy Jaeryang Baek
c8418da8c1
Merge pull request #3217 from theasp/better-body-logging
...
chore: Log API request bodies at debug level
2024-06-16 09:07:22 -07:00
perf3ct
75d713057c
Merge remote-tracking branch 'upstream/main' into feature-external-db-reconnect
2024-06-16 09:03:57 -07:00
Andrew Phillips
c0c875eae2
Use log.debug() for logging request bodies for the backend API
2024-06-16 12:40:16 -03:00
Andrew Phillips
3eba963d03
Remove redundant logging
2024-06-16 12:38:20 -03:00
Jun Siang Cheah
4ff17acc1b
Merge remote-tracking branch 'upstream/dev' into feat/oauth
2024-06-16 08:31:05 +01:00
Que Nguyen
a02ba52de8
Merge branch 'dev' into searxng
2024-06-15 23:44:31 +07:00
Timothy J. Baek
2f501aee14
chore: format
2024-06-15 03:36:17 -06:00
Timothy J. Baek
3c599e24e5
refac
2024-06-15 03:35:44 -06:00
Timothy Jaeryang Baek
a6ee7415d8
Merge pull request #3116 from Peter-De-Ath/memories-edit
...
feat: add abilty to edit memories
2024-06-15 01:58:57 -07:00
Peter De-Ath
bec00e7e64
fix: change update_memory to correct naming convention
...
fix: update update_memory to POST
2024-06-14 21:23:34 +01:00
Timothy Jaeryang Baek
8db439a0d1
Merge pull request #3177 from Yash-1511/main
...
feat: add tavily web search in web search provider
2024-06-14 11:09:59 -07:00
Yash-1511
b9da72560a
feat: add tavily web search in web search provider
2024-06-14 20:44:11 +05:30
Timothy Jaeryang Baek
26505079b8
Merge pull request #3107 from TheTerrasque/defect/ollama-long-response-timeout
...
Fix: ollama long response timeout
2024-06-14 02:45:55 -07:00
Timothy J. Baek
454a386612
refac
2024-06-14 00:10:52 -07:00
Sam McLeod
3f5e36271f
feat: add num_keep, num_batch
2024-06-14 16:21:20 +10:00
Peter De-Ath
493e3068d8
enh: ability to edit memories
2024-06-13 02:42:07 +01:00
Que Nguyen
7b5f434a07
Implement domain whitelisting for web search results
2024-06-13 07:14:48 +07:00
Mikael Turøy
e130ad74d1
Added timeout setting for ollama streaming response
2024-06-12 22:50:15 +02:00
Timothy J. Baek
bdd2ac0015
fix/refac: docs
2024-06-12 13:45:13 -07:00
Timothy J. Baek
c794d59fd5
revert: do not change the default
2024-06-12 11:47:19 -07:00
Timothy Jaeryang Baek
90dadf0bec
Merge pull request #3073 from que-nguyen/searxng
...
Set searxng language to auto and enable safesearch (moderate).
2024-06-12 11:26:10 -07:00
Timothy J. Baek
1163745a03
revert
2024-06-12 11:08:05 -07:00
Que Nguyen
305ec59d76
Set searxng language as 'auto' and enable safesearch (moderate).
...
Configure searxng with language param set to auto and add "safesearch": 1 (moderate) for safer web results.
2024-06-12 21:33:33 +07:00
Timothy J. Baek
c0ca447041
chore: format
2024-06-12 01:37:53 -07:00
Timothy Jaeryang Baek
5d3db15eca
Merge pull request #3049 from que-nguyen/dev
...
Refactor URL validation function
2024-06-12 01:36:34 -07:00
Timothy J. Baek
e8fc522eba
chore: format
2024-06-12 00:18:22 -07:00
Que Nguyen
eb7bba81fe
Refactor URL validation function
...
- The check for private IP addresses often did not yield the expected results, especially with errors like: `[Errno -2] Name or service not known`.
- Removed the check for private IP addresses in the URL validation process.
- Simplified the `validate_url` function to focus on validating the URL format and checking the existence of the URL using a HEAD request.
2024-06-12 08:15:04 +07:00
Timothy J. Baek
9bd054490f
refac
2024-06-11 14:32:01 -07:00
Timothy J. Baek
2be14d57bf
fix
2024-06-11 14:30:18 -07:00
Timothy J. Baek
0bb26ae504
refac: tools
2024-06-11 11:31:14 -07:00
Timothy Jaeryang Baek
d709038b5b
Merge pull request #3029 from Yash-1511/main
...
feat: add DuckDuckGo search functionality using duckduckgo_search library
2024-06-11 09:53:26 -07:00
Que Nguyen
3bec60b80c
Fixed the issue where a single URL error disrupts the data loading process in Web Search mode
...
To address the unresolved issue in the LangChain library where a single URL error disrupts the data loading process, the lazy_load method in the WebBaseLoader class has been modified. The enhanced method now handles exceptions appropriately, logging errors and continuing with the remaining URLs.
2024-06-11 22:06:14 +07:00
Yash-1511
83f9475584
feat: add DuckDuckGo search functionality using duckduckgo_search library
2024-06-11 19:49:08 +05:30
Timothy J. Baek
1e1b372d07
fix
2024-06-11 01:18:05 -07:00
