Commit Graph

111 Commits

Author SHA1 Message Date
Timothy Jaeryang Baek
dbb67a12ca enh: retrieval query generation 2024-11-19 02:24:32 -08:00
yeounhak
8c161c797b Enable RAG_WEB_SEARCH_CONCURRENT_REQUESTS with asynchronous optimization for improved performance 2024-11-19 01:14:26 +00:00
Timothy Jaeryang Baek
20321e5271 refac: ollama setting for rag 2024-11-18 14:19:56 -08:00
Timothy Jaeryang Baek
c338f2cae1 chore: format 2024-11-16 23:46:12 -08:00
Timothy Jaeryang Baek
24e98bb9d7
Merge pull request #6954 from matthewhand/feature/qdrant-auth
feat: add API key support for Qdrant Cloud authentication
2024-11-16 23:42:16 -08:00
Timothy Jaeryang Baek
932de8f1e2 refac 2024-11-16 04:41:07 -08:00
Matthew Hand
ca63ae649c Enable Qdrant authentication support 2024-11-15 07:06:46 +11:00
Timothy Jaeryang Baek
61f29a6531
Merge branch 'main' into dev 2024-11-11 13:45:13 -08:00
Timothy Jaeryang Baek
96c865404d refac: disable openapi.json
Some checks failed
Release / release (push) Has been cancelled
Deploy to HuggingFace Spaces / check-secret (push) Has been cancelled
Create and publish Docker images with specific build args / build-main-image (linux/amd64) (push) Has been cancelled
Create and publish Docker images with specific build args / build-main-image (linux/arm64) (push) Has been cancelled
Create and publish Docker images with specific build args / build-cuda-image (linux/amd64) (push) Has been cancelled
Create and publish Docker images with specific build args / build-cuda-image (linux/arm64) (push) Has been cancelled
Create and publish Docker images with specific build args / build-ollama-image (linux/amd64) (push) Has been cancelled
Create and publish Docker images with specific build args / build-ollama-image (linux/arm64) (push) Has been cancelled
Python CI / Format Backend (3.11) (push) Has been cancelled
Frontend Build / Format & Build Frontend (push) Has been cancelled
Frontend Build / Frontend Unit Tests (push) Has been cancelled
Integration Test / Run Cypress Integration Tests (push) Has been cancelled
Integration Test / Run Migration Tests (push) Has been cancelled
Release to PyPI / release (push) Has been cancelled
Deploy to HuggingFace Spaces / deploy (push) Has been cancelled
Create and publish Docker images with specific build args / merge-main-images (push) Has been cancelled
Create and publish Docker images with specific build args / merge-cuda-images (push) Has been cancelled
Create and publish Docker images with specific build args / merge-ollama-images (push) Has been cancelled
2024-11-09 18:01:23 -08:00
Timothy J. Baek
a4abd32e4a fix 2024-11-06 23:01:10 -08:00
Timothy J. Baek
f8c2bedf53 fix: hybrid search 2024-11-06 22:51:36 -08:00
Jason Kidd
319ea8cb7f
feat: Add ability to set URI for pgvector 2024-11-04 14:27:33 -08:00
Jason Kidd
701f40aedd
feat: Initial support for pgvector 2024-11-04 14:26:41 -08:00
Timothy Jaeryang Baek
6c1d0a8e39
Merge pull request #6598 from dtaivpp/main
feat: OpenSearch vector db support
2024-11-04 14:04:55 -08:00
David Tippett
705e3129b6 Updating config format. 2024-11-04 15:14:53 -05:00
David Tippett
afca48028f Moving new config to under retreval 2024-11-04 15:10:14 -05:00
Davi Sclifo Zucon
a70e5a0f30 When UI "Bypass SSL verification for Websites"=True then ENABLE_RAG_WEB_LOADER_SSL_VERIFICATION=False 2024-11-04 16:29:29 -03:00
Davi Sclifo Zucon
35a9140567 Added parameter to: app.state.config.ENABLE_RAG_WEB_LOADER_SSL_VERIFICATION to get_web_loader(verify_ssl).
Invert variable value to send to UI , not ENABLE_RAG_WEB_LOADER_SSL_VERIFICATION.
2024-11-04 16:21:26 -03:00
Davi Sclifo Zucon
5306b49be0 Small Fix variable ssl_verification -> web_loader_ssl_verification (following python entity)
When changed via the web interface in Admin's WebSearch, the bypass option is not being persisted.
This change adjusts it to the same name as the one related in the python entity.
2024-11-04 15:40:16 -03:00
Timothy J. Baek
5c60081c1f refac: web search 2024-11-03 17:07:24 -08:00
Timothy J. Baek
f1065115aa fix: youtube loader issue 2024-11-03 03:18:17 -08:00
Timothy J. Baek
380e080f6d fix: do not crash on invalid embedding model 2024-11-03 01:08:04 -08:00
David Tippett
fb30b667e2 First pass at an OpenSearch connector 2024-10-30 15:51:56 -04:00
Timothy Jaeryang Baek
adfce28732
Merge pull request #6543 from execgit/main
Some checks are pending
Deploy to HuggingFace Spaces / check-secret (push) Waiting to run
Deploy to HuggingFace Spaces / deploy (push) Blocked by required conditions
Create and publish Docker images with specific build args / build-main-image (linux/amd64) (push) Waiting to run
Create and publish Docker images with specific build args / build-main-image (linux/arm64) (push) Waiting to run
Create and publish Docker images with specific build args / build-cuda-image (linux/amd64) (push) Waiting to run
Create and publish Docker images with specific build args / build-cuda-image (linux/arm64) (push) Waiting to run
Create and publish Docker images with specific build args / build-ollama-image (linux/amd64) (push) Waiting to run
Create and publish Docker images with specific build args / build-ollama-image (linux/arm64) (push) Waiting to run
Create and publish Docker images with specific build args / merge-main-images (push) Blocked by required conditions
Create and publish Docker images with specific build args / merge-cuda-images (push) Blocked by required conditions
Create and publish Docker images with specific build args / merge-ollama-images (push) Blocked by required conditions
Python CI / Format Backend (3.11) (push) Waiting to run
Frontend Build / Format & Build Frontend (push) Waiting to run
Frontend Build / Frontend Unit Tests (push) Waiting to run
Integration Test / Run Cypress Integration Tests (push) Waiting to run
Integration Test / Run Migration Tests (push) Waiting to run
fix: omit document contents in logging document embedding
2024-10-29 19:17:53 -07:00
execgit
03e9add96d retrieval.utils: omit logging file contents at level INFO 2024-10-29 14:33:37 +02:00
execgit
bc7622c0fe Avoid logging file contents at level INFO
I had problems with document handling in rootless containers. Long documents caused the container to hang. Reducing the verbosity of logging from retrieval.main seemed to fix the issues I was experiencing.
2024-10-29 14:31:47 +02:00
Timothy Jaeryang Baek
b32fbf7c58
Merge pull request #6504 from jeeteshchel/fork/dev
feat: enable bing support
2024-10-28 12:30:11 -07:00
Jeetesh Chellani
f7d8a6ccba feat: enable bing support 2024-10-28 16:51:31 +02:00
Timothy J. Baek
491cff8c63 refac: parse md files with TextLoader 2024-10-28 05:50:56 -07:00
Diwakar Singh Maurya
3d0c32f366 feature to support authentication in chromadb 2024-10-27 14:01:00 +07:00
Timothy J. Baek
f2c78ac0fb refac 2024-10-25 22:23:21 -07:00
Timothy J. Baek
47e4250f58 refac 2024-10-25 22:12:46 -07:00
Timothy J. Baek
076c54c486 refac 2024-10-25 21:47:47 -07:00
Timothy J. Baek
780591e991 refac 2024-10-25 21:46:14 -07:00
Timothy J. Baek
50dcad0f73 fix: tiktoken encoding model issue 2024-10-25 21:38:28 -07:00
Timothy J. Baek
e43e91edd3 refac 2024-10-20 23:45:15 -07:00
Timothy J. Baek
9936583477 chore: format 2024-10-20 18:38:06 -07:00
Timothy J. Baek
4d46bfe03b refac: file table migration 2024-10-20 17:45:37 -07:00
Timothy Jaeryang Baek
c9c79852a5
Merge branch 'dev' into dev 2024-10-17 13:25:39 -07:00
Timothy J. Baek
6336d34b59 fix: web attachment issue 2024-10-17 13:08:10 -07:00
Timothy J. Baek
8eb45acf10 refac 2024-10-14 18:47:41 -07:00
Jannik Streidl
f0f4de59eb Merge branch 'upstream-dev' into dev 2024-10-14 09:50:40 +02:00
Timothy J. Baek
586e005f0f enh: token text splitter support 2024-10-13 04:24:13 -07:00
Timothy J. Baek
8a0da6d376 enh: include file name to context 2024-10-13 03:58:51 -07:00
Timothy J. Baek
797afd0b72 fix: embedding metadata issue 2024-10-13 03:25:11 -07:00
Timothy J. Baek
92605fd59f refac 2024-10-13 03:16:18 -07:00
Timothy J. Baek
5ffd216fca refac 2024-10-13 03:02:02 -07:00
Timothy J. Baek
dff3732fcd enh: tiktoken/token splitter support 2024-10-13 02:07:50 -07:00
Timothy J. Baek
5273dc4535 refac 2024-10-13 00:21:06 -07:00
Timothy J. Baek
333317a7ce refac: add embedding metadata 2024-10-12 18:30:21 -07:00