Commit Graph

983 Commits

Author SHA1 Message Date
Seth Rothschild
c3693c91b3 fix: allow temperature and seed to be 0 2024-07-20 06:53:52 -04:00
Justin Hayes
0216ee101c
enh: ElevenLabs voice name -> ID 2024-07-20 02:56:00 -04:00
Timothy J. Baek
e664a429a1 feat: elevenlabs tts support 2024-07-19 10:35:05 +02:00
José Luis Di Biase
23c9122458 chore RAG: adding languages known extension for erlang, elixir, haskell and jsx/tsx
Signed-off-by: José Luis Di Biase <josx@interorganic.com.ar>
2024-07-18 17:48:39 -03:00
Timothy J. Baek
3d0f457306 refac 2024-07-17 10:16:27 +02:00
Timothy J. Baek
40075f69f9 refac 2024-07-15 16:25:00 +02:00
Timothy J. Baek
dbc352f01b refac: documents file handling 2024-07-15 13:05:38 +02:00
Timothy J. Baek
69083b6485 revert 2024-07-15 11:09:05 +02:00
Jerry
f07172bfe6 fix the checking logic in get_model_path
fix the checking logic in function get_model_path()
2024-07-12 14:21:37 +08:00
Timothy J. Baek
eb10001eb7 feat: action function 2024-07-11 18:41:00 -07:00
Timothy J. Baek
9f9122b6d7 enh: ChatValves 2024-07-11 16:24:59 -07:00
Timothy J. Baek
8dcb3d78dc refac 2024-07-11 15:20:56 -07:00
Timothy J. Baek
4dd77b785a fix 2024-07-11 14:12:44 -07:00
Timothy J. Baek
f462744fc8 refac 2024-07-11 13:43:44 -07:00
Timothy J. Baek
b094153af2 fix 2024-07-11 10:41:13 -07:00
Timothy J. Baek
0ef27bfc5e refac 2024-07-11 10:40:10 -07:00
Timothy J. Baek
ebcc5be1bf fix: db 2024-07-10 13:35:52 -07:00
Timothy J. Baek
c9f5029a9d refac 2024-07-08 23:07:23 -07:00
Timothy J. Baek
d3ef3a7494 refac 2024-07-08 12:42:52 -07:00
Timothy J. Baek
68d775e1ab chore: rm print 2024-07-08 12:08:27 -07:00
Timothy J. Baek
3ddd88dad7 chore: rm print 2024-07-08 12:00:09 -07:00
Timothy J. Baek
42742d03d7 fix: model update 2024-07-08 11:58:36 -07:00
Timothy J. Baek
87f656b029 fix: tools update 2024-07-08 11:46:37 -07:00
Timothy J. Baek
3b27acc77e fix 2024-07-08 11:34:24 -07:00
Jonathan Rohde
3b112375ee feat(documents): commit document delete 2024-07-08 09:14:45 +02:00
Timothy J. Baek
c1d706dc5a fix: db issues 2024-07-07 23:01:15 -07:00
Peter De-Ath
1bb2724282 fix password update in AuthsTable model 2024-07-07 22:27:26 +01:00
Peter De-Ath
f971ba0c0b fix email update in AuthsTable model 2024-07-07 22:07:12 +01:00
Timothy J. Baek
d51e866505 fix: db 2024-07-07 09:09:09 -07:00
Timothy Jaeryang Baek
7e6c5193d6
Merge pull request #3688 from leobenkel/no-trace-when-success
fix: Remove the tracestack when the collection already exists
2024-07-07 09:00:23 -07:00
Leo Benkel
a73a9c7310 Remove the tracestack when the collection already exists 2024-07-06 23:20:41 +02:00
Timothy J. Baek
c9b85bd4a2 fix: delete 2024-07-06 08:10:58 -07:00
Timothy J. Baek
1436bb7c61 enh: handle peewee migration 2024-07-05 23:38:53 -07:00
Timothy Jaeryang Baek
d60f06608e
Merge pull request #3668 from open-webui/dev
dev
2024-07-05 22:29:13 -07:00
Timothy J. Baek
67c2ab006d fix: pipe custom model 2024-07-04 13:41:18 -07:00
Timothy J. Baek
9a6cbafdef fix: user valves 2024-07-04 00:37:05 -07:00
Timothy J. Baek
8b13755d56 Update auths.py 2024-07-04 00:25:45 -07:00
Timothy J. Baek
8fe2a7bb75 fix 2024-07-03 23:39:16 -07:00
Timothy J. Baek
37a5d2c06b Update db.py 2024-07-03 23:32:46 -07:00
Timothy J. Baek
864646094e refac 2024-07-03 23:32:39 -07:00
Timothy J. Baek
1b65df3acc revert 2024-07-03 21:28:51 -07:00
Timothy J. Baek
bfc53b49fd revert 2024-07-03 21:28:14 -07:00
Timothy J. Baek
15f6f7bd15 revert: peewee migrations 2024-07-03 21:12:16 -07:00
Timothy Jaeryang Baek
0d78b63805
Merge pull request #3621 from open-webui/dev
dev
2024-07-03 20:59:14 -07:00
Timothy Jaeryang Baek
08c024d752
Merge pull request #3569 from Semihal/custom-openid-claims
feat: Custom claims for OAuth
2024-07-03 15:56:37 -07:00
Timothy J. Baek
4d23957035 revert: model_validate 2024-07-02 21:56:32 -07:00
Timothy J. Baek
aa88022624 fix: functions 2024-07-02 21:50:53 -07:00
Timothy J. Baek
44a9b86eec fix: functions 2024-07-02 21:46:56 -07:00
Timothy Jaeryang Baek
d0e89a0318
Merge pull request #3327 from jonathan-rohde/feat/sqlalchemy-instead-of-peewee
BREAKING CHANGE/sqlalchemy instead of peewee
2024-07-02 16:40:13 -07:00
Timothy J. Baek
c7a9b5ccfa refac: chat completion middleware 2024-07-01 19:33:58 -07:00
Timothy J. Baek
a392865615 refac 2024-07-01 17:11:09 -07:00
Timothy Jaeryang Baek
3c1ea24374
Merge pull request #3582 from nickovs/tika-document-text
feat: Support Tika for document text extraction
2024-07-01 17:07:40 -07:00
Timothy J. Baek
bd45b7a04b fix 2024-07-01 16:11:44 -07:00
Timothy J. Baek
9c01297191 fix 2024-07-01 16:11:24 -07:00
Nicko van Someren
7aa35a3757 Added HTML and Typescript UI components to support configration of text extraction engine.
Updated RAG /config and /config/update endpoints to support UI updates.

Fixed .dockerignore to prevent Python venv from being copied into Docker image.
2024-07-01 12:10:59 -06:00
Jonathan Rohde
2aecd7d0b9 Merge branch 'refs/heads/dev' into feat/sqlalchemy-instead-of-peewee
# Conflicts:
#	backend/requirements.txt
2024-07-01 10:37:56 +02:00
Sergey Mihaylin
a94c7e5c09 fix lint 2024-07-01 10:36:21 +03:00
Sergey Mihaylin
6e934c2d17 Merge branch 'refs/heads/main' into custom-openid-claims
# Conflicts:
#	backend/main.py
2024-07-01 10:08:38 +03:00
Fish Lung
f89fa061e8 fix: use AIOHTTP_CLIENT_TIMEOUT timeout setting for openai streaming response 2024-07-01 14:29:26 +08:00
Timothy J. Baek
7955c9ba3b refac 2024-06-30 22:28:43 -07:00
Jun Siang Cheah
a48ac6a209 refac: lazily load sentence_transformers to reduce start up memory usage 2024-07-01 08:13:56 +08:00
Jun Siang Cheah
17c684369e refac: lazily load faster_whisper to reduce start up memory usage 2024-07-01 08:13:02 +08:00
Nicko van Someren
9cf622d981 Added support for using Apache Tika as a document loader.
Added persistent configuration options to configure use and location of Tika service.

Updated backend.apps.rag.main:get_loader() to make use of Tika document loader.
2024-06-30 15:49:15 -06:00
Timothy J. Baek
f6efda9e2f refac: ollama non stream response 2024-06-30 01:30:19 -07:00
Sergey Mihaylin
0c3f9a16e3 custom env for set custom claims for openid 2024-06-28 16:31:40 +03:00
Jonathan Rohde
df47c496d3 Merge branch 'refs/heads/dev' into feat/sqlalchemy-instead-of-peewee
# Conflicts:
#	backend/apps/webui/models/functions.py
#	backend/apps/webui/routers/chats.py
2024-06-28 09:19:56 +02:00
Timothy J. Baek
cd9170ed24 fix: trusted sign in 2024-06-27 21:44:35 -07:00
Timothy J. Baek
feba50f68c fix: WEBUI_AUTH 2024-06-27 21:43:19 -07:00
Timothy J. Baek
edbd07f893 feat: global filter 2024-06-27 13:04:12 -07:00
Timothy J. Baek
3f5f410453 refac 2024-06-27 11:29:59 -07:00
Jonathan Rohde
23e4d9daff feat(sqlalchemy): formatting 2024-06-27 07:48:26 +02:00
Jonathan Rohde
d4b6b7c4e8 feat(sqlalchemy): reverted not needed api change 2024-06-27 07:48:08 +02:00
Jonathan Rohde
642c352c69 feat(sqlalchemy): rebase 2024-06-27 07:48:08 +02:00
Jonathan Rohde
d88bd51e3c feat(sqlalchemy): format backend 2024-06-27 07:48:08 +02:00
Jonathan Rohde
8f939cf55b feat(sqlalchemy): some fixes 2024-06-27 07:48:08 +02:00
Jonathan Rohde
a9b148791d feat(sqlalchemy): fix wrong column types 2024-06-27 07:48:08 +02:00
Jonathan Rohde
da403f3e3c feat(sqlalchemy): use session factory instead of context manager 2024-06-27 07:48:08 +02:00
Jonathan Rohde
eb01e8d275 feat(sqlalchemy): use scoped session 2024-06-27 07:48:08 +02:00
Jonathan Rohde
c134eab27a feat(sqlalchemy): format backend 2024-06-27 07:48:08 +02:00
Jonathan Rohde
320e658595 feat(sqlalchemy): cleanup fixes 2024-06-27 07:48:08 +02:00
Jonathan Rohde
bee835cb65 feat(sqlalchemy): remove session reference from router 2024-06-27 07:48:08 +02:00
Jonathan Rohde
df09d0830a feat(sqlalchemy): Replace peewee with sqlalchemy 2024-06-27 07:48:08 +02:00
Timothy Jaeryang Baek
70c985feec
Merge pull request #3447 from ben-z/stt-model-configurable
fix: Make STT model configurable
2024-06-25 15:26:57 -07:00
Ben Zhang
044bd00386 Make STT model configurable 2024-06-25 21:46:12 +00:00
Timothy J. Baek
36e88d479b chore: format 2024-06-25 08:01:05 -07:00
Timothy Jaeryang Baek
16a8eebd8d
Merge pull request #3328 from FuturePrayer/AUTOMATIC1111_api_auth_support
feat: Supports making requests to the Automatic1111 backend when running with the --api-auth parameter
2024-06-24 19:40:55 -07:00
Timothy Jaeryang Baek
d17dc59246
Merge pull request #2574 from cheahjs/feat/oauth
feat: experimental SSO support for Google, Microsoft, and OIDC
2024-06-24 19:05:58 -07:00
Timothy J. Baek
d361404a60 refac 2024-06-24 13:33:03 -07:00
Timothy J. Baek
4c9fa6cf37 enh: pipe handling 2024-06-24 12:56:41 -07:00
Timothy J. Baek
1c4e7f0324 refac 2024-06-24 11:17:18 -07:00
Timothy J. Baek
6bad71adca fix 2024-06-24 10:37:57 -07:00
Jun Siang Cheah
ca8c098f62 refac: update migrations to match dev 2024-06-24 18:48:28 +08:00
Jun Siang Cheah
f26d80dcae Merge remote-tracking branch 'upstream/dev' into feat/oauth 2024-06-24 18:46:48 +08:00
Timothy J. Baek
5c0015cd66 fix: frontmatter 2024-06-23 20:37:41 -07:00
Timothy J. Baek
abf212c28f enh: tools & functions frontmatter 2024-06-23 20:31:40 -07:00
Timothy J. Baek
0250f69da0 fix: valves 2024-06-23 19:48:16 -07:00
Timothy J. Baek
2eb15ea1fc feat: SAFE_MODE 2024-06-23 19:28:33 -07:00
Timothy J. Baek
0cf936f9e8 refac 2024-06-23 19:18:13 -07:00
Timothy J. Baek
26e735618e fix: tools valves 2024-06-23 19:10:52 -07:00
Timothy J. Baek
dc25f44d31 fix: handle default 2024-06-23 19:05:56 -07:00
Timothy J. Baek
627705a347 feat: valves 2024-06-23 19:02:27 -07:00
Timothy J. Baek
d8c112d8b0 feat: function toggle support 2024-06-23 18:34:42 -07:00
Timothy J. Baek
120b1857b2 enh: valves 2024-06-23 18:05:33 -07:00
Timothy J. Baek
6ee94c5e97 chore: format 2024-06-22 16:15:19 -07:00
Timothy Jaeryang Baek
fd96c9c68d
Merge pull request #3380 from Yash-1511/main
feat: add jina_search as new websearch provider
2024-06-22 15:19:38 -07:00
Timothy J. Baek
60e5adc70e enh: files api allow filename 2024-06-22 14:49:00 -07:00
Timothy J. Baek
d362fd027e feat: user valves integration 2024-06-22 12:08:32 -07:00
Timothy J. Baek
15fc23df87 feat: user valves endpoints 2024-06-22 11:26:33 -07:00
Yash-1511
7c9fb9199e feat: add jina_search as new websearch provider 2024-06-22 20:06:15 +05:30
Timothy J. Baek
ae567796ee refac 2024-06-22 01:39:53 -07:00
Jun Siang Cheah
981f384154 refac: modify oauth login logic for unique email addresses 2024-06-21 18:25:19 +01:00
Jun Siang Cheah
416e8d1ef9 fix: db migration sync with dev 2024-06-21 14:35:57 +01:00
Jun Siang Cheah
922dfae51c fix: broken tuple expansion 2024-06-21 13:44:10 +01:00
Jun Siang Cheah
4aab460905 Merge remote-tracking branch 'upstream/dev' into feat/oauth 2024-06-21 13:43:19 +01:00
Timothy J. Baek
58ae91369e refac 2024-06-20 13:49:04 -07:00
Timothy J. Baek
f1de635988 refac: cookie 2024-06-20 13:14:58 -07:00
Timothy J. Baek
5a2c2770a4 chore: format 2024-06-20 04:53:23 -07:00
Timothy J. Baek
59fa2f8f26 refac: pipe function support 2024-06-20 04:47:40 -07:00
Timothy J. Baek
d6e4aef607 feat: pipe function 2024-06-20 04:38:59 -07:00
Timothy J. Baek
c689356b31 refac 2024-06-20 03:57:36 -07:00
Timothy J. Baek
015772ef9a refac 2024-06-20 03:45:13 -07:00
Timothy J. Baek
bf5775e07a refac 2024-06-20 01:16:31 -07:00
Timothy J. Baek
43e08c6afa refac 2024-06-20 00:54:58 -07:00
Timothy J. Baek
27f8afebab feat: function db migration 2024-06-20 00:49:11 -07:00
Timothy J. Baek
f68aba687e feat: functions router 2024-06-20 00:37:02 -07:00
sihuangwlp
e16ae92edc complate missing field AUTOMATIC1111_API_AUTH 2024-06-20 14:53:38 +08:00
sihuangwlp
bec04279aa Add AUTOMATIC1111_API_AUTH support 2024-06-20 14:15:49 +08:00
Timothy Jaeryang Baek
1e0453221d
Merge pull request #3221 from perfectra1n/feature-external-db-reconnect
feat: external db reconnect
2024-06-19 14:40:03 -07:00
Timothy J. Baek
b36c525ebc enh: cookie auth 2024-06-19 14:38:09 -07:00
Que Nguyen
9e87012489
Fix: Rename 'whitelist' to 'filter_list' in function 2024-06-19 18:22:29 +07:00
Timothy J. Baek
6f9a31eba5 feat: tool cache dir 2024-06-18 18:07:51 -07:00
Timothy J. Baek
d5a1030000 refac: uploads delete 2024-06-18 15:20:04 -07:00
Timothy J. Baek
20e4f6cc16 refac 2024-06-18 14:55:18 -07:00
Timothy J. Baek
b4bdea6d85 fix: files 2024-06-18 14:33:44 -07:00
Timothy J. Baek
83986620ee refac 2024-06-18 14:15:08 -07:00
Timothy J. Baek
9e7b7a895e refac: file upload 2024-06-18 13:50:18 -07:00
perfectra1n
7e061d19ca
Merge branch 'open-webui:main' into feature-external-db-reconnect 2024-06-18 12:11:28 -07:00
Timothy J. Baek
7c2a198370 feat: file db migration 2024-06-18 11:38:50 -07:00
Timothy J. Baek
146e550239 feat: files endpoint 2024-06-18 11:36:55 -07:00
Timothy J. Baek
ba7091c25b refac 2024-06-18 10:36:06 -07:00
Timothy J. Baek
453f9be16c refac 2024-06-18 10:26:53 -07:00
perf3ct
81b2416923
format 2024-06-17 16:47:09 -07:00
perf3ct
59c6ff727a
borrow some of the previous PRs reconnection code 2024-06-17 16:44:20 -07:00
Timothy J. Baek
b1d83fc42c chore: format 2024-06-17 14:32:23 -07:00
Timothy Jaeryang Baek
20f052eb37
Merge pull request #3112 from que-nguyen/searxng
Domain whitelisting for web search results
2024-06-17 14:30:17 -07:00
Timothy J. Baek
686c5081e6 fix: model system prompt variable support 2024-06-17 13:47:48 -07:00
perf3ct
48e1356ed9
add logging for user upon db connection 2024-06-17 10:34:19 -07:00
perf3ct
5c655f298b
stop even using pooled DBs in peewee 2024-06-17 09:56:31 -07:00
perf3ct
981866eb93
use autoconnect and stop using the mixin 2024-06-17 07:50:47 -07:00
Que Nguyen
c487385980
Set filter_list as optional param in serpstack.py 2024-06-17 14:38:11 +07:00
Que Nguyen
bcb84235b1
Set filter_list as optional param in serply.py 2024-06-17 14:37:52 +07:00
Que Nguyen
6b8290fa6d
Set filter_list as optional param in serper.py 2024-06-17 14:37:26 +07:00
Que Nguyen
9c446d9fb4
Set filter_list as optional param in searxng.py 2024-06-17 14:36:56 +07:00
Que Nguyen
3cc0e3ecb6
Refactor rag/main.py
Renamed function get_filtered_results
2024-06-17 14:36:26 +07:00
Que Nguyen
d8beed13b4
Set filter_list as optional param in google_pse.py 2024-06-17 14:35:27 +07:00
Que Nguyen
7d2ad8c4bf
Set filter_list as optional param in duckduckgo.py 2024-06-17 14:34:59 +07:00
Que Nguyen
a02139ba9d
Set filter_list as optional param in brave.py 2024-06-17 14:34:17 +07:00
Que Nguyen
a3ac9ee774
Refactor main.py
Rename RAG_WEB_SEARCH_WHITE_LIST_DOMAINS to RAG_WEB_SEARCH_DOMAIN_FILTER_LIST
2024-06-17 14:31:44 +07:00
Que Nguyen
75e51ecf6d
Merge branch 'open-webui:main' into searxng 2024-06-17 14:28:02 +07:00
Timothy J. Baek
a28ad06bf0 fix 2024-06-16 23:36:21 -07:00
Timothy J. Baek
1efa25eed5 chore: format 2024-06-16 21:55:08 -07:00
Timothy Jaeryang Baek
f3bd81073d
Merge pull request #3202 from JohnTheNerd/main
feat: added ability to set user name for federated auth
2024-06-16 17:56:29 -07:00
Timothy J. Baek
e183b0e5ff chore: format 2024-06-16 15:34:15 -07:00
Timothy J. Baek
4b6b33b08b feat: user_location 2024-06-16 15:32:26 -07:00
perf3ct
10fa887eab
fix peewee and playhouse connections to retry 2024-06-16 15:25:48 -07:00
John Karabudak
c00a6fa02a added ability to set user name for federated auth
this commit adds an optional environment variable named `WEBUI_AUTH_TRUSTED_NAME_HEADER`, which sets the user's name to the contents of that header. this only happens if the user is just being created, just like how the trusted e-mail header works.

if the environment variable or header is not present, we fall back to the original behavior which is to re-use the user e-mail address.

Co-Authored-By: Nikita Borzykh <sample@fastmail.com>
2024-06-16 18:44:10 -02:30
John Karabudak
ea074fa9bf added Stable Diffusion 3 support alongside ComfyUI configuration
this commit adds four environment variables:

- COMFYUI_CFG_SCALE
- COMFYUI_SAMPLER
- COMFYUI_SCHEDULER
- COMFYUI_SD3 (merely setting this at all will enable SD3 mode)
2024-06-16 15:30:52 -02:30
Timothy Jaeryang Baek
c8418da8c1
Merge pull request #3217 from theasp/better-body-logging
chore: Log API request bodies at debug level
2024-06-16 09:07:22 -07:00
perf3ct
75d713057c
Merge remote-tracking branch 'upstream/main' into feature-external-db-reconnect 2024-06-16 09:03:57 -07:00
Andrew Phillips
c0c875eae2 Use log.debug() for logging request bodies for the backend API 2024-06-16 12:40:16 -03:00
Andrew Phillips
3eba963d03 Remove redundant logging 2024-06-16 12:38:20 -03:00
Jun Siang Cheah
4ff17acc1b Merge remote-tracking branch 'upstream/dev' into feat/oauth 2024-06-16 08:31:05 +01:00
Que Nguyen
a02ba52de8
Merge branch 'dev' into searxng 2024-06-15 23:44:31 +07:00
Timothy J. Baek
2f501aee14 chore: format 2024-06-15 03:36:17 -06:00
Timothy J. Baek
3c599e24e5 refac 2024-06-15 03:35:44 -06:00
Timothy Jaeryang Baek
a6ee7415d8
Merge pull request #3116 from Peter-De-Ath/memories-edit
feat: add abilty to edit memories
2024-06-15 01:58:57 -07:00
Peter De-Ath
bec00e7e64 fix: change update_memory to correct naming convention
fix: update update_memory to POST
2024-06-14 21:23:34 +01:00
Timothy Jaeryang Baek
8db439a0d1
Merge pull request #3177 from Yash-1511/main
feat: add tavily web search in web search provider
2024-06-14 11:09:59 -07:00
Yash-1511
b9da72560a feat: add tavily web search in web search provider 2024-06-14 20:44:11 +05:30
Timothy Jaeryang Baek
26505079b8
Merge pull request #3107 from TheTerrasque/defect/ollama-long-response-timeout
Fix: ollama long response timeout
2024-06-14 02:45:55 -07:00
Timothy J. Baek
454a386612 refac 2024-06-14 00:10:52 -07:00
Sam McLeod
3f5e36271f feat: add num_keep, num_batch 2024-06-14 16:21:20 +10:00
Peter De-Ath
493e3068d8 enh: ability to edit memories 2024-06-13 02:42:07 +01:00
Que Nguyen
7b5f434a07
Implement domain whitelisting for web search results 2024-06-13 07:14:48 +07:00
Mikael Turøy
e130ad74d1 Added timeout setting for ollama streaming response 2024-06-12 22:50:15 +02:00
Timothy J. Baek
bdd2ac0015 fix/refac: docs 2024-06-12 13:45:13 -07:00
Timothy J. Baek
c794d59fd5 revert: do not change the default 2024-06-12 11:47:19 -07:00
Timothy Jaeryang Baek
90dadf0bec
Merge pull request #3073 from que-nguyen/searxng
Set searxng language to auto and enable safesearch (moderate).
2024-06-12 11:26:10 -07:00
Timothy J. Baek
1163745a03 revert 2024-06-12 11:08:05 -07:00
Que Nguyen
305ec59d76
Set searxng language as 'auto' and enable safesearch (moderate).
Configure searxng with language param set to auto and add "safesearch": 1 (moderate) for safer web results.
2024-06-12 21:33:33 +07:00
Timothy J. Baek
c0ca447041 chore: format 2024-06-12 01:37:53 -07:00
Timothy Jaeryang Baek
5d3db15eca
Merge pull request #3049 from que-nguyen/dev
Refactor URL validation function
2024-06-12 01:36:34 -07:00
Timothy J. Baek
e8fc522eba chore: format 2024-06-12 00:18:22 -07:00
Que Nguyen
eb7bba81fe
Refactor URL validation function
- The check for private IP addresses often did not yield the expected results, especially with errors like: `[Errno -2] Name or service not known`.
- Removed the check for private IP addresses in the URL validation process.
- Simplified the `validate_url` function to focus on validating the URL format and checking the existence of the URL using a HEAD request.
2024-06-12 08:15:04 +07:00
Timothy J. Baek
9bd054490f refac 2024-06-11 14:32:01 -07:00
Timothy J. Baek
2be14d57bf fix 2024-06-11 14:30:18 -07:00
Timothy J. Baek
0bb26ae504 refac: tools 2024-06-11 11:31:14 -07:00
Timothy Jaeryang Baek
d709038b5b
Merge pull request #3029 from Yash-1511/main
feat: add DuckDuckGo search functionality using duckduckgo_search library
2024-06-11 09:53:26 -07:00
Que Nguyen
3bec60b80c
Fixed the issue where a single URL error disrupts the data loading process in Web Search mode
To address the unresolved issue in the LangChain library where a single URL error disrupts the data loading process, the lazy_load method in the WebBaseLoader class has been modified. The enhanced method now handles exceptions appropriately, logging errors and continuing with the remaining URLs.
2024-06-11 22:06:14 +07:00
Yash-1511
83f9475584 feat: add DuckDuckGo search functionality using duckduckgo_search library 2024-06-11 19:49:08 +05:30