Commit Graph

63 Commits

Author SHA1 Message Date
Timothy Jaeryang Baek
8aa2d09cee chore: format 2024-11-19 12:22:58 -08:00
yeounhak
8c161c797b Enable RAG_WEB_SEARCH_CONCURRENT_REQUESTS with asynchronous optimization for improved performance 2024-11-19 01:14:26 +00:00
Timothy Jaeryang Baek
20321e5271 refac: ollama setting for rag 2024-11-18 14:19:56 -08:00
Timothy Jaeryang Baek
c338f2cae1 chore: format 2024-11-16 23:46:12 -08:00
Timothy Jaeryang Baek
61f29a6531
Merge branch 'main' into dev 2024-11-11 13:45:13 -08:00
Timothy Jaeryang Baek
96c865404d refac: disable openapi.json
Some checks failed
Release / release (push) Has been cancelled
Deploy to HuggingFace Spaces / check-secret (push) Has been cancelled
Create and publish Docker images with specific build args / build-main-image (linux/amd64) (push) Has been cancelled
Create and publish Docker images with specific build args / build-main-image (linux/arm64) (push) Has been cancelled
Create and publish Docker images with specific build args / build-cuda-image (linux/amd64) (push) Has been cancelled
Create and publish Docker images with specific build args / build-cuda-image (linux/arm64) (push) Has been cancelled
Create and publish Docker images with specific build args / build-ollama-image (linux/amd64) (push) Has been cancelled
Create and publish Docker images with specific build args / build-ollama-image (linux/arm64) (push) Has been cancelled
Python CI / Format Backend (3.11) (push) Has been cancelled
Frontend Build / Format & Build Frontend (push) Has been cancelled
Frontend Build / Frontend Unit Tests (push) Has been cancelled
Integration Test / Run Cypress Integration Tests (push) Has been cancelled
Integration Test / Run Migration Tests (push) Has been cancelled
Release to PyPI / release (push) Has been cancelled
Deploy to HuggingFace Spaces / deploy (push) Has been cancelled
Create and publish Docker images with specific build args / merge-main-images (push) Has been cancelled
Create and publish Docker images with specific build args / merge-cuda-images (push) Has been cancelled
Create and publish Docker images with specific build args / merge-ollama-images (push) Has been cancelled
2024-11-09 18:01:23 -08:00
Davi Sclifo Zucon
a70e5a0f30 When UI "Bypass SSL verification for Websites"=True then ENABLE_RAG_WEB_LOADER_SSL_VERIFICATION=False 2024-11-04 16:29:29 -03:00
Davi Sclifo Zucon
35a9140567 Added parameter to: app.state.config.ENABLE_RAG_WEB_LOADER_SSL_VERIFICATION to get_web_loader(verify_ssl).
Invert variable value to send to UI , not ENABLE_RAG_WEB_LOADER_SSL_VERIFICATION.
2024-11-04 16:21:26 -03:00
Davi Sclifo Zucon
5306b49be0 Small Fix variable ssl_verification -> web_loader_ssl_verification (following python entity)
When changed via the web interface in Admin's WebSearch, the bypass option is not being persisted.
This change adjusts it to the same name as the one related in the python entity.
2024-11-04 15:40:16 -03:00
Timothy J. Baek
5c60081c1f refac: web search 2024-11-03 17:07:24 -08:00
Timothy J. Baek
f1065115aa fix: youtube loader issue 2024-11-03 03:18:17 -08:00
Timothy J. Baek
380e080f6d fix: do not crash on invalid embedding model 2024-11-03 01:08:04 -08:00
Timothy Jaeryang Baek
adfce28732
Merge pull request #6543 from execgit/main
Some checks are pending
Deploy to HuggingFace Spaces / check-secret (push) Waiting to run
Deploy to HuggingFace Spaces / deploy (push) Blocked by required conditions
Create and publish Docker images with specific build args / build-main-image (linux/amd64) (push) Waiting to run
Create and publish Docker images with specific build args / build-main-image (linux/arm64) (push) Waiting to run
Create and publish Docker images with specific build args / build-cuda-image (linux/amd64) (push) Waiting to run
Create and publish Docker images with specific build args / build-cuda-image (linux/arm64) (push) Waiting to run
Create and publish Docker images with specific build args / build-ollama-image (linux/amd64) (push) Waiting to run
Create and publish Docker images with specific build args / build-ollama-image (linux/arm64) (push) Waiting to run
Create and publish Docker images with specific build args / merge-main-images (push) Blocked by required conditions
Create and publish Docker images with specific build args / merge-cuda-images (push) Blocked by required conditions
Create and publish Docker images with specific build args / merge-ollama-images (push) Blocked by required conditions
Python CI / Format Backend (3.11) (push) Waiting to run
Frontend Build / Format & Build Frontend (push) Waiting to run
Frontend Build / Frontend Unit Tests (push) Waiting to run
Integration Test / Run Cypress Integration Tests (push) Waiting to run
Integration Test / Run Migration Tests (push) Waiting to run
fix: omit document contents in logging document embedding
2024-10-29 19:17:53 -07:00
execgit
bc7622c0fe Avoid logging file contents at level INFO
I had problems with document handling in rootless containers. Long documents caused the container to hang. Reducing the verbosity of logging from retrieval.main seemed to fix the issues I was experiencing.
2024-10-29 14:31:47 +02:00
Jeetesh Chellani
f7d8a6ccba feat: enable bing support 2024-10-28 16:51:31 +02:00
Timothy J. Baek
f2c78ac0fb refac 2024-10-25 22:23:21 -07:00
Timothy J. Baek
47e4250f58 refac 2024-10-25 22:12:46 -07:00
Timothy J. Baek
076c54c486 refac 2024-10-25 21:47:47 -07:00
Timothy J. Baek
780591e991 refac 2024-10-25 21:46:14 -07:00
Timothy J. Baek
50dcad0f73 fix: tiktoken encoding model issue 2024-10-25 21:38:28 -07:00
Timothy J. Baek
e43e91edd3 refac 2024-10-20 23:45:15 -07:00
Timothy J. Baek
4d46bfe03b refac: file table migration 2024-10-20 17:45:37 -07:00
Timothy J. Baek
6336d34b59 fix: web attachment issue 2024-10-17 13:08:10 -07:00
Timothy J. Baek
586e005f0f enh: token text splitter support 2024-10-13 04:24:13 -07:00
Timothy J. Baek
797afd0b72 fix: embedding metadata issue 2024-10-13 03:25:11 -07:00
Timothy J. Baek
5ffd216fca refac 2024-10-13 03:02:02 -07:00
Timothy J. Baek
dff3732fcd enh: tiktoken/token splitter support 2024-10-13 02:07:50 -07:00
Timothy J. Baek
5273dc4535 refac 2024-10-13 00:21:06 -07:00
Timothy J. Baek
333317a7ce refac: add embedding metadata 2024-10-12 18:30:21 -07:00
Peter De-Ath
885b9f1ece refactor: Update GenerateEmbeddingsForm to support batch processing
refactor: Update embedding batch size handling in RAG configuration

refactor: add query_doc query caching

refactor: update logging statements in generate_chat_completion function

change embedding_batch_size to Optional
2024-10-08 00:04:35 +01:00
Timothy J. Baek
48e7f47558 refac 2024-10-07 14:03:42 -07:00
Timothy J. Baek
ee22ba9676 fix: web, youtube attachment issue 2024-10-06 19:44:02 -07:00
Timothy J. Baek
378223aedb refac: comments 2024-10-05 10:08:48 -07:00
Timothy J. Baek
61b147441c refac 2024-10-05 10:05:12 -07:00
Timothy J. Baek
1f9b5b6456 refac: retain metadata for collection 2024-10-05 09:58:46 -07:00
Timothy J. Baek
0bd88090bb refac: DOCS_DIR deprecated 2024-10-05 01:45:22 -07:00
Timothy J. Baek
a6c797d4c2 refac: process docs dir 2024-10-04 17:22:00 -07:00
Timothy Jaeryang Baek
ebc7da6f82
Merge pull request #5861 from open-webui/projects
feat: knowledge/projects
2024-10-04 10:00:47 +02:00
Timothy J. Baek
8013c152d0 feat: edit file content support 2024-10-04 00:46:32 -07:00
Timothy J. Baek
630a78cead fix 2024-10-04 00:24:51 -07:00
Timothy J. Baek
17c772831d refac 2024-10-04 00:23:14 -07:00
Timothy J. Baek
05970157f6 refac 2024-10-03 23:06:47 -07:00
Timothy J. Baek
b291271df3 refac 2024-10-03 22:22:22 -07:00
Timothy J. Baek
b862dff185 refac 2024-10-03 21:10:33 -07:00
Timothy J. Baek
6747478f67 refac 2024-10-03 21:05:55 -07:00
Timothy J. Baek
2fc07fd6a2 enh: vector db hash collision check 2024-10-03 06:53:21 -07:00
Timothy J. Baek
d394f8b7be enh: add to vector db support 2024-10-03 06:44:17 -07:00
Timothy J. Baek
351b1dbf31 refac 2024-10-02 21:14:58 -07:00
Jun Siang Cheah
318f61161e refac: lazy load big dependencies to reduce min memory usage 2024-10-02 22:18:42 +01:00
Timothy J. Baek
a0fb4a9b84 refac 2024-10-01 13:13:39 -07:00