Commit Graph

1030 Commits

Author SHA1 Message Date
Que Nguyen
305ec59d76
Set searxng language as 'auto' and enable safesearch (moderate).
Configure searxng with language param set to auto and add "safesearch": 1 (moderate) for safer web results.
2024-06-12 21:33:33 +07:00
Timothy J. Baek
c0ca447041 chore: format 2024-06-12 01:37:53 -07:00
Timothy Jaeryang Baek
5d3db15eca
Merge pull request #3049 from que-nguyen/dev
Refactor URL validation function
2024-06-12 01:36:34 -07:00
Timothy J. Baek
eead69068c fix: type casting 2024-06-12 01:35:42 -07:00
Timothy J. Baek
e8fc522eba chore: format 2024-06-12 00:18:22 -07:00
Que Nguyen
eb7bba81fe
Refactor URL validation function
- The check for private IP addresses often did not yield the expected results, especially with errors like: `[Errno -2] Name or service not known`.
- Removed the check for private IP addresses in the URL validation process.
- Simplified the `validate_url` function to focus on validating the URL format and checking the existence of the URL using a HEAD request.
2024-06-12 08:15:04 +07:00
Timothy J. Baek
9bd054490f refac 2024-06-11 14:32:01 -07:00
Timothy J. Baek
2be14d57bf fix 2024-06-11 14:30:18 -07:00
Timothy J. Baek
0bb26ae504 refac: tools 2024-06-11 11:31:14 -07:00
Timothy J. Baek
9d16dd997a refac 2024-06-11 11:15:43 -07:00
Timothy J. Baek
e4fe1fff97 feat: tool __user__ email 2024-06-11 10:54:11 -07:00
Timothy J. Baek
67cd9b76ae refac: __user__ param 2024-06-11 10:35:13 -07:00
Timothy J. Baek
8a86f32700 feat: user hook 2024-06-11 10:19:59 -07:00
Timothy Jaeryang Baek
d709038b5b
Merge pull request #3029 from Yash-1511/main
feat: add DuckDuckGo search functionality using duckduckgo_search library
2024-06-11 09:53:26 -07:00
Timothy Jaeryang Baek
a2631ed38e
Merge pull request #3041 from cocktailpeanut/main
feat: custom HOST env variable on windows
2024-06-11 09:52:45 -07:00
cocktailpeanut
884eb9f7ee update 2024-06-11 12:32:29 -04:00
Que Nguyen
3bec60b80c
Fixed the issue where a single URL error disrupts the data loading process in Web Search mode
To address the unresolved issue in the LangChain library where a single URL error disrupts the data loading process, the lazy_load method in the WebBaseLoader class has been modified. The enhanced method now handles exceptions appropriately, logging errors and continuing with the remaining URLs.
2024-06-11 22:06:14 +07:00
Yash-1511
07b08ef67e add: duckduckgo-search dependencies added in requirements.txt 2024-06-11 19:53:57 +05:30
Yash-1511
83f9475584 feat: add DuckDuckGo search functionality using duckduckgo_search library 2024-06-11 19:49:08 +05:30
Timothy J. Baek
bf1936de34 refac 2024-06-11 02:12:24 -07:00
Timothy J. Baek
1e1b372d07 fix 2024-06-11 01:18:05 -07:00
Timothy J. Baek
bd5a8567ef refac: tools & rag 2024-06-11 01:10:24 -07:00
Timothy J. Baek
91bc65c7da fix 2024-06-11 00:50:30 -07:00
Timothy J. Baek
049b3136e8 refac 2024-06-11 00:24:25 -07:00
Timothy J. Baek
3d6f5f418d feat: tools full integration 2024-06-11 00:18:45 -07:00
Timothy J. Baek
a27175d672 feat: fc integration 2024-06-10 23:40:27 -07:00
Timothy J. Baek
ff1cd306d8 refac 2024-06-10 22:38:48 -07:00
Timothy J. Baek
8464b30485 refac 2024-06-10 22:10:53 -07:00
Timothy J. Baek
c961964647 enh: tool id validation 2024-06-10 21:59:06 -07:00
Timothy J. Baek
4601a0246f fix: tool edit 2024-06-10 21:53:51 -07:00
Timothy J. Baek
1611a3aa70 feat: export tools 2024-06-10 21:36:13 -07:00
Timothy J. Baek
b434ebf3ad feat: tools integration 2024-06-10 21:33:46 -07:00
Timothy J. Baek
3a96e1f109 feat: tools backend 2024-06-10 20:39:55 -07:00
Timothy J. Baek
8b1e2ce279 feat: code format 2024-06-10 17:12:48 -07:00
Timothy J. Baek
644f0fe6c3 chore: version bump 2024-06-10 13:52:35 -07:00
Timothy Jaeryang Baek
fcf8f2a704
Merge pull request #2952 from arkohut/tolerant-readonly-filesystem
fix: tolerant readonly filesystem for copy favicon to static dir
2024-06-10 11:59:06 -07:00
arkohut
d20f6cb45b fix: use Exception to handle all errors 2024-06-10 21:27:35 +08:00
teampen
14d33f0fcc Merge branch 'add-serply' into dev 2024-06-09 21:40:50 -04:00
teampen
4dcec4855e adding Serply as an alternative web search 2024-06-09 21:39:46 -04:00
teampen
efb4a710c8 adding Serply as an alternative web search 2024-06-09 20:44:34 -04:00
Timothy J. Baek
2755ef62d9 feat: threshold setting 2024-06-09 15:29:55 -07:00
Timothy J. Baek
8debb71197 feat: search query threshold 2024-06-09 15:19:36 -07:00
Timothy J. Baek
a93645aee8 refac 2024-06-09 15:08:23 -07:00
Timothy J. Baek
28ca6fb678 refac 2024-06-09 15:04:33 -07:00
Timothy J. Baek
591cd993c2 refac: search query task 2024-06-09 14:53:10 -07:00
Timothy J. Baek
aa1bb4fb6d refac 2024-06-09 14:26:49 -07:00
Timothy J. Baek
5e7237b9cb refac: title generation 2024-06-09 14:25:31 -07:00
Timothy J. Baek
84defafc14 feat: unified chat completions endpoint 2024-06-09 13:17:44 -07:00
Timothy Jaeryang Baek
9b38788aa2
Merge pull request #2937 from mindspawn/cuda-fix
Enable case independent environment variable testing in start.sh
2024-06-09 13:01:17 -07:00
Timothy J. Baek
c44fc82ecd refac: openai 2024-06-09 12:43:54 -07:00
arkohut
8e9e429a91 fix: tolerant readonly filesystem for copy favicon to static dir 2024-06-09 23:23:28 +08:00
Timothy J. Baek
f2b9a5f5bf refac: rag 2024-06-09 03:01:25 -07:00
Timothy Jaeryang Baek
8c95a8be3a
Merge pull request #2943 from choltha/fix/temperature-params
fix: model settings temperature not passed correctly from model settings to ollama/openai api
2024-06-09 01:56:18 -07:00
Christoph Holthaus
97b39115a1 fix: temperature not passed correctly 2024-06-09 09:49:24 +02:00
Timothy J. Baek
d1da3dde65 refac: migration 2024-06-08 13:45:33 -07:00
Timothy J. Baek
3499ec3f79 fix: tts 2024-06-08 13:18:42 -07:00
Timothy Jaeryang Baek
9b839e5c9f
Merge pull request #2927 from arkohut/tolerant-no-write-permission-for-static-dir
fix: tolerant no write permission for copy favicon to static dir
2024-06-08 13:03:08 -07:00
mindspawn
575f23cde9
Update start.sh to be case-independent when testing env vars 2024-06-08 10:59:59 -07:00
Timothy J. Baek
5cbb79fa6e fix: safari audio issue 2024-06-08 02:07:19 -07:00
Timothy J. Baek
277e7aead7 refac 2024-06-08 00:52:19 -07:00
arkohut
d3558fdb33 fix: tolerant no write permission for copy favicon to static dir 2024-06-08 13:56:08 +08:00
Timothy Jaeryang Baek
dbde628141
Merge pull request #2923 from mindspawn/outlook-msg
Support Outlook Message File Format
2024-06-07 21:50:03 -07:00
mindspawn
6f9148ac4c
Update main.py 2024-06-07 21:41:30 -07:00
Timothy J. Baek
d7d8896e43 fix: active users 2024-06-07 21:38:09 -07:00
mindspawn
f69bc57fed
Update requirements.txt 2024-06-07 21:18:35 -07:00
mindspawn
4ecc1c06d3
Update main.py 2024-06-07 21:18:04 -07:00
Timothy J. Baek
e516374d54 feat: external stt 2024-06-07 20:31:52 -07:00
Timothy J. Baek
55dc6c1b3b refac: audio 2024-06-07 20:18:48 -07:00
Timothy J. Baek
da47c2dfa3 refac: active users 2024-06-07 17:35:01 -07:00
Timothy J. Baek
4a73a01c24 refac 2024-06-06 20:44:42 -07:00
Timothy Jaeryang Baek
b512501d9d
Merge pull request #2870 from mindspawn/proxy-fix2
Fix proxy not being used for /api/version/updates
2024-06-06 04:06:36 -07:00
mindspawn
3069fa8074
Update main.py to enable http_proxy use for checking for new versions 2024-06-05 17:24:59 -07:00
Timothy J. Baek
e52568e7cb feat: upload pipeline 2024-06-05 13:57:48 -07:00
Timothy J. Baek
d077b3dcdb fix: ollama version request when ollama api is disabled 2024-06-05 09:08:52 -07:00
Timothy J. Baek
92d056c982 fix: running models 2024-06-04 11:38:31 -07:00
Timothy J. Baek
2be9c25ba7 feat: show current running models 2024-06-04 11:13:43 -07:00
Timothy J. Baek
7cf80289c3 fix: active users 2024-06-04 09:52:27 -07:00
Timothy J. Baek
bbfa54a6b9 feat: active user count 2024-06-04 01:10:31 -07:00
Timothy J. Baek
4925a6530b fix: banner z index 2024-06-04 00:45:56 -07:00
Timothy J. Baek
85484392b2 feat: websocket 2024-06-03 23:39:52 -07:00
Timothy J. Baek
0495f01acb feat: reset upload dir 2024-06-03 21:45:36 -07:00
Timothy Jaeryang Baek
8c3a6eb262
Merge pull request #2799 from mindspawn/proxy-fix
Enable use of http_proxy environment variable in openai and ollama calls
2024-06-03 21:19:53 -07:00
Timothy J. Baek
25336f85f3 feat: admin details in account pending overlay 2024-06-03 21:17:43 -07:00
mindspawn
74ed74f1a4
Enable http_proxy use for ollama calls. 2024-06-03 20:43:25 -07:00
mindspawn
94ebf02719
Enable http_proxy use for openai calls. 2024-06-03 20:41:59 -07:00
Timothy J. Baek
61867c1545 Update searxng.py 2024-06-03 17:02:50 -07:00
Timothy J. Baek
4068a421bf fix 2024-06-03 17:00:35 -07:00
Timothy Jaeryang Baek
768941bded
Merge pull request #2785 from cheahjs/feat/openai-embeddings-batch
feat: add RAG_EMBEDDING_OPENAI_BATCH_SIZE to batch multiple embeddings
2024-06-03 13:50:14 -07:00
Jun Siang Cheah
7fefbb316d fix: add backwards compat with older searxng urls 2024-06-03 21:13:10 +01:00
Timothy J. Baek
82f7b6c315 refac: modelfiles migration 2024-06-03 12:48:17 -07:00
Timothy Jaeryang Baek
92d9b38110
Merge branch 'dev' into feat/openai-embeddings-batch 2024-06-03 12:39:09 -07:00
Lyuboslav Petrov
08443b3c55
Revert log level to debug 2024-06-03 12:48:40 +03:00
Lyuboslav Petrov
7e761a69a7
FIX searxng URL construction using params for arg passing
Accept additional parameters such as language, time_range, and categories to tailor the search results.
Raise an exception if a request error occurs during the search process.
Use params argument to construct the query string
Sort by relevance
Expand docstring
2024-06-03 12:44:46 +03:00
Timothy J. Baek
fddf693dad feat: single chat export 2024-06-02 21:39:09 -07:00
Timothy J. Baek
814fbb73f3 feat: RESET_CONFIG_ON_START 2024-06-02 18:14:36 -07:00
Timothy J. Baek
3d74c04f50 feat: mermaid rendering support 2024-06-02 18:03:30 -07:00
Timothy J. Baek
a9e5003c4f fix: filter outlet 2024-06-02 17:49:44 -07:00
Timothy J. Baek
32a61ea15d fix: pipelines 2024-06-02 16:46:33 -07:00
Timothy Jaeryang Baek
c5ff4c24e1
Merge branch 'dev' into fix/ollama-cancellation 2024-06-02 16:27:01 -07:00
Timothy J. Baek
27ff3ab112 fix: validate lengths for openai urls and keys 2024-06-02 16:20:22 -07:00
Timothy J. Baek
e0ba585204 feat: include num_thread in advanced params 2024-06-02 13:20:38 -07:00
Jun Siang Cheah
b5b2b70f4a fix: bad payload refactor 2024-06-02 19:40:18 +01:00
Jun Siang Cheah
7f74426a22 fix: openai streaming cancellation using aiohttp 2024-06-02 18:48:45 +01:00
Jun Siang Cheah
4dd51badfe fix: ollama streaming cancellation using aiohttp 2024-06-02 18:06:12 +01:00
Jun Siang Cheah
24c35c308d fix: stream defaults to true, return request ID 2024-06-02 17:09:15 +01:00
Jun Siang Cheah
0cb8163321 feat: add RAG_EMBEDDING_OPENAI_BATCH_SIZE to batch multiple embeddings 2024-06-02 15:34:31 +01:00
Timothy J. Baek
a53796270f refac: web search config 2024-06-01 20:08:08 -07:00
Timothy J. Baek
fbdfb7e4fa refac: web search 2024-06-01 19:57:00 -07:00
Timothy J. Baek
999d2bc21b refac: web search 2024-06-01 19:52:12 -07:00
Timothy J. Baek
912a704fdc refac: web search settings 2024-06-01 19:40:48 -07:00
Timothy J. Baek
ea6b8984ab refac: web search 2024-06-01 19:03:56 -07:00
Timothy J. Baek
c6a57b1f6f feat: export litellm config.yaml 2024-06-01 16:31:39 -07:00
Timothy J. Baek
cb8c45d864 fix: pipelines 2024-05-31 13:30:12 -07:00
Timothy J. Baek
7674229e3a feat: chat clone 2024-05-31 10:30:42 -07:00
Беклемишев Петр Алексеевич
ad32a2ef3c Drop mysql restarts 2024-05-31 13:26:23 +07:00
Timothy J. Baek
995f7bc51b fix: chat completed 2024-05-30 21:43:10 -07:00
Беклемишев Петр Алексеевич
e59e1f5049 Fix rebase artifacts 2024-05-30 20:44:13 +07:00
Беклемишев Петр Алексеевич
dfbc125947 Reconnect to postgresql & mysql external databases when getting disconnected 2024-05-30 20:41:06 +07:00
Timothy J. Baek
ef8d84296e feat: pipelines filter outlet 2024-05-30 02:04:29 -07:00
Timothy J. Baek
c76330710f refac: pipeline filters 2024-05-29 23:29:45 -07:00
Timothy J. Baek
4715160b53 fix: pipelines 2024-05-29 22:41:51 -07:00
Timothy J. Baek
340b399fc2 refac: pipelines 2024-05-29 22:18:27 -07:00
Timothy J. Baek
12e60d8ebf feat: add/delete pipelines 2024-05-29 22:03:22 -07:00
Timothy J. Baek
c1cabf1415 feat: multiple pipelines server support 2024-05-29 21:26:57 -07:00
Timothy J. Baek
e427ef767b fix: openai proxy 2024-05-29 11:28:42 -07:00
Timothy J. Baek
7f8be4a709 refac 2024-05-29 01:42:42 -07:00
Timothy J. Baek
5cf44ac7da feat: display pipelines server in api settings 2024-05-29 01:36:13 -07:00
Timothy J. Baek
e8d4e03c0d refac: openai allow empty key 2024-05-29 01:12:25 -07:00
Timothy J. Baek
943baad689 feat: allow valve pipelines edit 2024-05-28 18:24:39 -07:00
Timothy J. Baek
2d596d7307 feat: valves full integration 2024-05-28 13:05:31 -07:00
Timothy J. Baek
130d15a2fb feat: pipeline valves 2024-05-28 12:32:49 -07:00
Timothy J. Baek
0bef1b44c0 feat: pipeline valves 2024-05-28 12:04:19 -07:00
Timothy J. Baek
0383efa207 refac: pipelines 2024-05-28 11:43:48 -07:00
Timothy J. Baek
e231333bcd refac 2024-05-28 09:50:17 -07:00
Timothy J. Baek
ec36493d61 feat: pipeline filter wildcard support 2024-05-27 20:26:24 -07:00
Timothy J. Baek
966f10e715 refac: pipeline valves -> filters 2024-05-27 19:34:05 -07:00
Timothy J. Baek
4fac99c5b3 feat: pipeline valves user field 2024-05-27 19:16:07 -07:00
Timothy J. Baek
cc6d9bb8c0 feat: pipeline valve support 2024-05-27 19:03:26 -07:00
Timothy J. Baek
74a8deb19f refac 2024-05-27 14:25:36 -07:00
Timothy J. Baek
f3527df644 refac: styling 2024-05-27 13:22:24 -07:00
Timothy J. Baek
4685f523b6 refac 2024-05-27 12:48:08 -07:00
Timothy J. Baek
73178cf519 refac 2024-05-27 11:08:01 -07:00
Timothy Jaeryang Baek
bced90734b
Merge branch 'websearch' into feat/backend-web-search 2024-05-26 23:40:05 -07:00
Timothy J. Baek
ccbafca74c feat: save user settings to db 2024-05-26 22:47:42 -07:00
Timothy J. Baek
0c04b18f36 refac 2024-05-26 13:02:40 -07:00
Timothy Jaeryang Baek
78dedb3389
Merge branch 'dev' into feat/disable-community-sharing 2024-05-26 10:00:51 -10:00
Timothy J. Baek
242d4f0c8d feat: banners
Co-Authored-By: Jun Siang Cheah <me@jscheah.me>
2024-05-26 12:18:43 -07:00
Jun Siang Cheah
e06417f0aa feat: add admin ui for toggling community sharing 2024-05-26 17:23:24 +01:00
Jun Siang Cheah
1235714914 feat: add ENABLE_COMMUNITY_SHARING 2024-05-26 17:10:25 +01:00
Jun Siang Cheah
6c5f5fe368 refac: move ui flags into feature flags 2024-05-26 17:05:26 +01:00