Commit Graph

1267 Commits

Author SHA1 Message Date
Timothy J. Baek
a392865615 refac 2024-07-01 17:11:09 -07:00
Timothy Jaeryang Baek
3c1ea24374
Merge pull request #3582 from nickovs/tika-document-text
feat: Support Tika for document text extraction
2024-07-01 17:07:40 -07:00
Timothy J. Baek
bd45b7a04b fix 2024-07-01 16:11:44 -07:00
Timothy J. Baek
9c01297191 fix 2024-07-01 16:11:24 -07:00
Timothy J. Baek
9cc46629c2 refac 2024-07-01 15:43:19 -07:00
Nicko van Someren
7aa35a3757 Added HTML and Typescript UI components to support configration of text extraction engine.
Updated RAG /config and /config/update endpoints to support UI updates.

Fixed .dockerignore to prevent Python venv from being copied into Docker image.
2024-07-01 12:10:59 -06:00
Jonathan Rohde
2aecd7d0b9 Merge branch 'refs/heads/dev' into feat/sqlalchemy-instead-of-peewee
# Conflicts:
#	backend/requirements.txt
2024-07-01 10:37:56 +02:00
Sergey Mihaylin
a94c7e5c09 fix lint 2024-07-01 10:36:21 +03:00
Sergey Mihaylin
e475f025b7 fix: merge request fail (remove picture_claim) 2024-07-01 10:25:25 +03:00
Sergey Mihaylin
6e934c2d17 Merge branch 'refs/heads/main' into custom-openid-claims
# Conflicts:
#	backend/main.py
2024-07-01 10:08:38 +03:00
Fish Lung
f89fa061e8 fix: use AIOHTTP_CLIENT_TIMEOUT timeout setting for openai streaming response 2024-07-01 14:29:26 +08:00
Timothy J. Baek
4547afe0b9 chore: bump 2024-06-30 22:29:03 -07:00
Timothy J. Baek
7955c9ba3b refac 2024-06-30 22:28:43 -07:00
Timothy Jaeryang Baek
c52e16a844
Merge pull request #3562 from open-webui/dependabot/pip/backend/dev/sentence-transformers-3.0.1
chore(deps): bump sentence-transformers from 2.7.0 to 3.0.1 in /backend
2024-06-30 19:58:38 -07:00
Timothy Jaeryang Baek
c676a78cd7
Merge pull request #3543 from open-webui/dependabot/pip/backend/dev/openpyxl-3.1.5
chore(deps): bump openpyxl from 3.1.2 to 3.1.5 in /backend
2024-06-30 19:57:20 -07:00
Timothy Jaeryang Baek
61b2bcae47
Merge pull request #3563 from open-webui/dependabot/pip/backend/dev/langchain-community-0.2.6
chore(deps): bump langchain-community from 0.2.0 to 0.2.6 in /backend
2024-06-30 19:57:10 -07:00
Timothy Jaeryang Baek
ee59cbc634
Merge pull request #3561 from open-webui/dependabot/pip/backend/dev/requests-2.32.3
chore(deps): bump requests from 2.32.2 to 2.32.3 in /backend
2024-06-30 19:56:53 -07:00
dependabot[bot]
8c7fb0312c
chore(deps): bump langchain-community from 0.2.0 to 0.2.6 in /backend
Bumps [langchain-community](https://github.com/langchain-ai/langchain) from 0.2.0 to 0.2.6.
- [Release notes](https://github.com/langchain-ai/langchain/releases)
- [Commits](https://github.com/langchain-ai/langchain/compare/langchain-community==0.2.0...langchain-community==0.2.6)

---
updated-dependencies:
- dependency-name: langchain-community
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2024-07-01 02:30:30 +00:00
dependabot[bot]
0ee984b444
chore(deps): bump sentence-transformers from 2.7.0 to 3.0.1 in /backend
Bumps [sentence-transformers](https://github.com/UKPLab/sentence-transformers) from 2.7.0 to 3.0.1.
- [Release notes](https://github.com/UKPLab/sentence-transformers/releases)
- [Commits](https://github.com/UKPLab/sentence-transformers/compare/v2.7.0...v3.0.1)

---
updated-dependencies:
- dependency-name: sentence-transformers
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
2024-07-01 02:30:25 +00:00
dependabot[bot]
2fadc0c68f
chore(deps): bump requests from 2.32.2 to 2.32.3 in /backend
Bumps [requests](https://github.com/psf/requests) from 2.32.2 to 2.32.3.
- [Release notes](https://github.com/psf/requests/releases)
- [Changelog](https://github.com/psf/requests/blob/main/HISTORY.md)
- [Commits](https://github.com/psf/requests/compare/v2.32.2...v2.32.3)

---
updated-dependencies:
- dependency-name: requests
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2024-07-01 02:30:22 +00:00
dependabot[bot]
3f31bb0975
chore(deps): bump langfuse from 2.33.0 to 2.36.2 in /backend
Bumps [langfuse](https://github.com/langfuse/langfuse) from 2.33.0 to 2.36.2.
- [Release notes](https://github.com/langfuse/langfuse/releases)
- [Commits](https://github.com/langfuse/langfuse/commits)

---
updated-dependencies:
- dependency-name: langfuse
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
2024-07-01 02:30:20 +00:00
Jun Siang Cheah
a48ac6a209 refac: lazily load sentence_transformers to reduce start up memory usage 2024-07-01 08:13:56 +08:00
Jun Siang Cheah
17c684369e refac: lazily load faster_whisper to reduce start up memory usage 2024-07-01 08:13:02 +08:00
Timothy J. Baek
f77073410e refac 2024-06-30 14:52:18 -07:00
Nicko van Someren
9cf622d981 Added support for using Apache Tika as a document loader.
Added persistent configuration options to configure use and location of Tika service.

Updated backend.apps.rag.main:get_loader() to make use of Tika document loader.
2024-06-30 15:49:15 -06:00
Timothy J. Baek
d9a229b1ec fix: default locale 2024-06-30 14:48:05 -07:00
Timothy J. Baek
f6efda9e2f refac: ollama non stream response 2024-06-30 01:30:19 -07:00
Timothy Jaeryang Baek
bb53282cb0
Merge pull request #3542 from open-webui/dependabot/pip/backend/dev/duckduckgo-search-approx-eq-6.1.7
chore(deps): update duckduckgo-search requirement from ~=6.1.5 to ~=6.1.7 in /backend
2024-06-29 20:44:19 -07:00
Timothy Jaeryang Baek
c933865172
Merge pull request #3541 from open-webui/dependabot/pip/backend/dev/langchain-chroma-0.1.2
chore(deps): bump langchain-chroma from 0.1.1 to 0.1.2 in /backend
2024-06-29 20:43:56 -07:00
Timothy Jaeryang Baek
ce990d3859
Merge pull request #3539 from open-webui/dependabot/pip/backend/dev/chromadb-0.5.3
chore(deps): bump chromadb from 0.5.0 to 0.5.3 in /backend
2024-06-29 20:43:46 -07:00
dependabot[bot]
5dacd41278
chore(deps): bump openpyxl from 3.1.2 to 3.1.5 in /backend
Bumps [openpyxl](https://openpyxl.readthedocs.io) from 3.1.2 to 3.1.5.

---
updated-dependencies:
- dependency-name: openpyxl
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2024-06-30 03:27:46 +00:00
dependabot[bot]
052c582930
chore(deps): update duckduckgo-search requirement in /backend
Updates the requirements on [duckduckgo-search](https://github.com/deedy5/duckduckgo_search) to permit the latest version.
- [Release notes](https://github.com/deedy5/duckduckgo_search/releases)
- [Commits](https://github.com/deedy5/duckduckgo_search/compare/v6.1.5...v6.1.7)

---
updated-dependencies:
- dependency-name: duckduckgo-search
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
2024-06-30 03:27:43 +00:00
dependabot[bot]
3c0ce5d1b0
chore(deps): bump langchain-chroma from 0.1.1 to 0.1.2 in /backend
Bumps [langchain-chroma](https://github.com/langchain-ai/langchain) from 0.1.1 to 0.1.2.
- [Release notes](https://github.com/langchain-ai/langchain/releases)
- [Commits](https://github.com/langchain-ai/langchain/compare/langchain-chroma==0.1.1...langchain-chroma==0.1.2)

---
updated-dependencies:
- dependency-name: langchain-chroma
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2024-06-30 03:27:39 +00:00
dependabot[bot]
9d1aa4aebe
chore(deps): bump python-socketio from 5.11.2 to 5.11.3 in /backend
Bumps [python-socketio](https://github.com/miguelgrinberg/python-socketio) from 5.11.2 to 5.11.3.
- [Release notes](https://github.com/miguelgrinberg/python-socketio/releases)
- [Changelog](https://github.com/miguelgrinberg/python-socketio/blob/main/CHANGES.md)
- [Commits](https://github.com/miguelgrinberg/python-socketio/compare/v5.11.2...v5.11.3)

---
updated-dependencies:
- dependency-name: python-socketio
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2024-06-30 03:27:34 +00:00
dependabot[bot]
e540f8a4e4
chore(deps): bump chromadb from 0.5.0 to 0.5.3 in /backend
Bumps [chromadb](https://github.com/chroma-core/chroma) from 0.5.0 to 0.5.3.
- [Release notes](https://github.com/chroma-core/chroma/releases)
- [Changelog](https://github.com/chroma-core/chroma/blob/main/RELEASE_PROCESS.md)
- [Commits](https://github.com/chroma-core/chroma/compare/0.5.0...0.5.3)

---
updated-dependencies:
- dependency-name: chromadb
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2024-06-30 03:27:27 +00:00
Timothy Jaeryang Baek
56137acd94
Merge pull request #3507 from open-webui/dependabot/pip/authlib-1.3.1
chore(deps): bump authlib from 1.3.0 to 1.3.1
2024-06-29 19:52:43 -07:00
Timothy Jaeryang Baek
73135b6e51
Merge pull request #3511 from Peter-De-Ath/ollama-chat-no-stream
fix: isInstance of streamingResponse but content-type is application/json
2024-06-29 13:16:32 -07:00
Peter De-Ath
269db0748a fix: isInstance of streamingResponse but content-type is application/json 2024-06-28 20:32:07 +01:00
dependabot[bot]
4d3e1ffbe6
chore(deps): bump authlib from 1.3.0 to 1.3.1
Bumps [authlib](https://github.com/lepture/authlib) from 1.3.0 to 1.3.1.
- [Release notes](https://github.com/lepture/authlib/releases)
- [Changelog](https://github.com/lepture/authlib/blob/master/docs/changelog.rst)
- [Commits](https://github.com/lepture/authlib/compare/v1.3.0...v1.3.1)

---
updated-dependencies:
- dependency-name: authlib
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
2024-06-28 16:53:45 +00:00
Sergey Mihaylin
9f32e9ef60 fix username claim 2024-06-28 17:08:32 +03:00
Sergey Mihaylin
0c3f9a16e3 custom env for set custom claims for openid 2024-06-28 16:31:40 +03:00
Sergey Mihaylin
7d10dacad6 Fix: set jwt_token to cookie (instead of token from OIDC) 2024-06-28 16:20:57 +03:00
Sergey Mihaylin
57c330576d Fix: admin role for OIDC signup for first user 2024-06-28 16:20:34 +03:00
Jonathan Rohde
5391f4c1f7 feat(sqlalchemy): add new column 2024-06-28 09:21:07 +02:00
Jonathan Rohde
df47c496d3 Merge branch 'refs/heads/dev' into feat/sqlalchemy-instead-of-peewee
# Conflicts:
#	backend/apps/webui/models/functions.py
#	backend/apps/webui/routers/chats.py
2024-06-28 09:19:56 +02:00
Timothy J. Baek
cd9170ed24 fix: trusted sign in 2024-06-27 21:44:35 -07:00
Timothy J. Baek
feba50f68c fix: WEBUI_AUTH 2024-06-27 21:43:19 -07:00
Timothy J. Baek
edbd07f893 feat: global filter 2024-06-27 13:04:12 -07:00
Timothy J. Baek
c8c85ba7fc refac 2024-06-27 12:16:55 -07:00
Timothy J. Baek
3f5f410453 refac 2024-06-27 11:29:59 -07:00
Jonathan Rohde
23e4d9daff feat(sqlalchemy): formatting 2024-06-27 07:48:26 +02:00
Jonathan Rohde
d4b6b7c4e8 feat(sqlalchemy): reverted not needed api change 2024-06-27 07:48:08 +02:00
Jonathan Rohde
642c352c69 feat(sqlalchemy): rebase 2024-06-27 07:48:08 +02:00
Jonathan Rohde
d88bd51e3c feat(sqlalchemy): format backend 2024-06-27 07:48:08 +02:00
Jonathan Rohde
2fb27adbf6 feat(sqlalchemy): add missing file 2024-06-27 07:48:08 +02:00
Jonathan Rohde
8f939cf55b feat(sqlalchemy): some fixes 2024-06-27 07:48:08 +02:00
Jonathan Rohde
a9b148791d feat(sqlalchemy): fix wrong column types 2024-06-27 07:48:08 +02:00
Jonathan Rohde
da403f3e3c feat(sqlalchemy): use session factory instead of context manager 2024-06-27 07:48:08 +02:00
Jonathan Rohde
eb01e8d275 feat(sqlalchemy): use scoped session 2024-06-27 07:48:08 +02:00
Jonathan Rohde
c134eab27a feat(sqlalchemy): format backend 2024-06-27 07:48:08 +02:00
Jonathan Rohde
320e658595 feat(sqlalchemy): cleanup fixes 2024-06-27 07:48:08 +02:00
Jonathan Rohde
070d9083d5 feat(sqlalchemy): use subprocess to do migrations 2024-06-27 07:48:08 +02:00
Jonathan Rohde
bee835cb65 feat(sqlalchemy): remove session reference from router 2024-06-27 07:48:08 +02:00
Jonathan Rohde
df09d0830a feat(sqlalchemy): Replace peewee with sqlalchemy 2024-06-27 07:48:08 +02:00
Timothy J. Baek
8dac2a2140 refac 2024-06-26 10:22:31 -07:00
Timothy Jaeryang Baek
70c985feec
Merge pull request #3447 from ben-z/stt-model-configurable
fix: Make STT model configurable
2024-06-25 15:26:57 -07:00
Ben Zhang
044bd00386 Make STT model configurable 2024-06-25 21:46:12 +00:00
Timothy J. Baek
36e88d479b chore: format 2024-06-25 08:01:05 -07:00
Timothy J. Baek
c147147001 chore: format 2024-06-25 08:00:32 -07:00
Timothy Jaeryang Baek
16a8eebd8d
Merge pull request #3328 from FuturePrayer/AUTOMATIC1111_api_auth_support
feat: Supports making requests to the Automatic1111 backend when running with the --api-auth parameter
2024-06-24 19:40:55 -07:00
Timothy Jaeryang Baek
d17dc59246
Merge pull request #2574 from cheahjs/feat/oauth
feat: experimental SSO support for Google, Microsoft, and OIDC
2024-06-24 19:05:58 -07:00
Timothy J. Baek
a40d0ec3cb chore: requirements 2024-06-24 17:53:07 -07:00
Timothy J. Baek
d361404a60 refac 2024-06-24 13:33:03 -07:00
Timothy J. Baek
4c9fa6cf37 enh: pipe handling 2024-06-24 12:56:41 -07:00
Timothy J. Baek
1c4e7f0324 refac 2024-06-24 11:17:18 -07:00
Timothy J. Baek
6bad71adca fix 2024-06-24 10:37:57 -07:00
Jun Siang Cheah
ca8c098f62 refac: update migrations to match dev 2024-06-24 18:48:28 +08:00
Jun Siang Cheah
f26d80dcae Merge remote-tracking branch 'upstream/dev' into feat/oauth 2024-06-24 18:46:48 +08:00
Timothy J. Baek
5c0015cd66 fix: frontmatter 2024-06-23 20:37:41 -07:00
Timothy J. Baek
abf212c28f enh: tools & functions frontmatter 2024-06-23 20:31:40 -07:00
Timothy J. Baek
8b99870189 enh: filter function priority valve support 2024-06-23 20:11:08 -07:00
Timothy J. Baek
0250f69da0 fix: valves 2024-06-23 19:48:16 -07:00
Jun Siang Cheah
99e7b328a4 refac: add better logging for oauth errors 2024-06-24 10:43:53 +08:00
Timothy J. Baek
5f2d37dce5 fix: valves 2024-06-23 19:37:35 -07:00
Timothy J. Baek
2eb15ea1fc feat: SAFE_MODE 2024-06-23 19:28:33 -07:00
Timothy J. Baek
0cf936f9e8 refac 2024-06-23 19:18:13 -07:00
Timothy J. Baek
26e735618e fix: tools valves 2024-06-23 19:10:52 -07:00
Timothy J. Baek
dc25f44d31 fix: handle default 2024-06-23 19:05:56 -07:00
Timothy J. Baek
627705a347 feat: valves 2024-06-23 19:02:27 -07:00
Timothy J. Baek
3a629ffe00 feat: global filter 2024-06-23 18:39:27 -07:00
Timothy J. Baek
d8c112d8b0 feat: function toggle support 2024-06-23 18:34:42 -07:00
Timothy J. Baek
120b1857b2 enh: valves 2024-06-23 18:05:33 -07:00
Timothy J. Baek
7cd4a3cd1a chore: requirements 2024-06-23 17:22:11 -07:00
Timothy J. Baek
6ee94c5e97 chore: format 2024-06-22 16:15:19 -07:00
Timothy Jaeryang Baek
fd96c9c68d
Merge pull request #3380 from Yash-1511/main
feat: add jina_search as new websearch provider
2024-06-22 15:19:38 -07:00
Timothy J. Baek
60e5adc70e enh: files api allow filename 2024-06-22 14:49:00 -07:00
Timothy J. Baek
de367e488d fix 2024-06-22 14:08:23 -07:00
Timothy J. Baek
df71d7c63b fix 2024-06-22 14:07:11 -07:00
Timothy J. Baek
5b64c28f33 refac 2024-06-22 14:06:19 -07:00
Timothy J. Baek
03bb4bcda6 refac: tool specs 2024-06-22 13:47:57 -07:00
Timothy J. Baek
cf6447eb2a feat: function exception handler 2024-06-22 12:43:30 -07:00
Timothy J. Baek
9205b90af6 fix 2024-06-22 12:26:03 -07:00
Timothy J. Baek
6ce91de7e0 fix 2024-06-22 12:25:02 -07:00
Timothy J. Baek
f524238910 fix 2024-06-22 12:24:46 -07:00
Timothy J. Baek
646832ba8c refac 2024-06-22 12:23:37 -07:00
Timothy J. Baek
6ccb5e8f67 feat: user valves support 2024-06-22 12:14:12 -07:00
Timothy J. Baek
d362fd027e feat: user valves integration 2024-06-22 12:08:32 -07:00
Timothy J. Baek
15fc23df87 feat: user valves endpoints 2024-06-22 11:26:33 -07:00
Yash-1511
7c9fb9199e feat: add jina_search as new websearch provider 2024-06-22 20:06:15 +05:30
Timothy J. Baek
e4af3852f7 refac: allow class in tools 2024-06-22 02:29:22 -07:00
Timothy J. Baek
a8a451344c refac 2024-06-22 01:42:28 -07:00
Timothy J. Baek
ae567796ee refac 2024-06-22 01:39:53 -07:00
Timothy J. Baek
14fd3a8aca refac 2024-06-21 11:05:55 -07:00
Jun Siang Cheah
981f384154 refac: modify oauth login logic for unique email addresses 2024-06-21 18:25:19 +01:00
Jun Siang Cheah
e011e7b695 fix: set auth cookie during oauth login 2024-06-21 14:35:57 +01:00
Jun Siang Cheah
416e8d1ef9 fix: db migration sync with dev 2024-06-21 14:35:57 +01:00
Jun Siang Cheah
983112d17c feat: fetch and store oauth profile pictures as data URLs 2024-06-21 14:35:54 +01:00
Jun Siang Cheah
922dfae51c fix: broken tuple expansion 2024-06-21 13:44:10 +01:00
Jun Siang Cheah
4aab460905 Merge remote-tracking branch 'upstream/dev' into feat/oauth 2024-06-21 13:43:19 +01:00
Timothy J. Baek
a2ea6b1b5b enh: tool async support 2024-06-20 20:40:03 -07:00
Timothy J. Baek
4370f233a1 feat: pipe async support 2024-06-20 20:37:04 -07:00
Timothy J. Baek
5621025c12 feat: async filter support 2024-06-20 20:26:28 -07:00
Timothy J. Baek
6bb2f41812 feat: tool citation 2024-06-20 14:14:12 -07:00
Timothy J. Baek
58ae91369e refac 2024-06-20 13:49:04 -07:00
Timothy J. Baek
f1de635988 refac: cookie 2024-06-20 13:14:58 -07:00
Timothy J. Baek
5a2c2770a4 chore: format 2024-06-20 04:53:23 -07:00
Timothy J. Baek
59fa2f8f26 refac: pipe function support 2024-06-20 04:47:40 -07:00
Timothy J. Baek
d6e4aef607 feat: pipe function 2024-06-20 04:38:59 -07:00
Timothy J. Baek
de26a78a16 refac 2024-06-20 04:21:55 -07:00
Timothy J. Baek
c689356b31 refac 2024-06-20 03:57:36 -07:00
Timothy J. Baek
015772ef9a refac 2024-06-20 03:45:13 -07:00
Timothy J. Baek
afd270523c feat: filter func outlet 2024-06-20 03:23:50 -07:00
Timothy J. Baek
96d7c3e99f fix: raise error 2024-06-20 02:37:36 -07:00
Timothy J. Baek
c4bd60114e feat: filter inlet support 2024-06-20 02:30:00 -07:00
Timothy J. Baek
6b8a7b9939 refac: chat completion middleware 2024-06-20 02:06:10 -07:00
Timothy J. Baek
448ca9d836 refac 2024-06-20 01:51:39 -07:00
Timothy J. Baek
bf5775e07a refac 2024-06-20 01:16:31 -07:00
Timothy J. Baek
43e08c6afa refac 2024-06-20 00:54:58 -07:00
Timothy J. Baek
27f8afebab feat: function db migration 2024-06-20 00:49:11 -07:00
Timothy J. Baek
f68aba687e feat: functions router 2024-06-20 00:37:02 -07:00
sihuangwlp
e16ae92edc complate missing field AUTOMATIC1111_API_AUTH 2024-06-20 14:53:38 +08:00
sihuangwlp
bec04279aa Add AUTOMATIC1111_API_AUTH support 2024-06-20 14:15:49 +08:00
Timothy J. Baek
f9283bc311 enh: pipeline user email support 2024-06-19 17:19:35 -07:00
Timothy J. Baek
ab270c1682 fix 2024-06-19 14:49:35 -07:00
Timothy Jaeryang Baek
1e0453221d
Merge pull request #3221 from perfectra1n/feature-external-db-reconnect
feat: external db reconnect
2024-06-19 14:40:03 -07:00
Timothy J. Baek
b36c525ebc enh: cookie auth 2024-06-19 14:38:09 -07:00
Que Nguyen
9e87012489
Fix: Rename 'whitelist' to 'filter_list' in function 2024-06-19 18:22:29 +07:00
Timothy J. Baek
dad7af6de1 enh: tool __model__ param support 2024-06-18 18:50:36 -07:00
Timothy J. Baek
dcac1a3cb7 enh: tool __id__ param support for cache dir 2024-06-18 18:14:18 -07:00
Timothy J. Baek
6f9a31eba5 feat: tool cache dir 2024-06-18 18:07:51 -07:00