Commit Graph

135 Commits

Author SHA1 Message Date
Gabriel Ecegi
440894f8d3 Fix process/files/batch 2024-12-14 10:45:27 +01:00
Gabriel Ecegi
f2e2b59c18 Add batching 2024-12-13 15:29:43 +01:00
Timothy Jaeryang Baek
2db837cab4 fix: query_embedding param 2024-12-09 23:33:43 -08:00
Timothy Jaeryang Baek
d4d6d1e7db
Merge pull request #7694 from erics118/main
feat: add kagi search engine
2024-12-09 16:12:32 -08:00
Timothy Jaeryang Baek
33099bf9e4 refac 2024-12-08 16:01:56 -08:00
erics118
b825947745 feat: add kagi 2024-12-08 00:21:10 -05:00
Timothy Jaeryang Baek
1c078bdb55 fix: api query collection 2024-12-01 13:36:36 -08:00
Timothy Jaeryang Baek
2fac9b45cd chore: format 2024-11-30 23:36:30 -08:00
Timothy Jaeryang Baek
ba0b3a984d refac 2024-11-30 22:29:53 -08:00
Thomas Rehn
53296c1005 [feat] Allow use of proxy for downloading Youtube transscripts 2024-11-27 15:20:48 +01:00
Timothy Jaeryang Baek
44efd4d372 refac 2024-11-26 10:17:17 -08:00
Timothy Jaeryang Baek
bd28e1ed7d refac: rag prompt template 2024-11-24 18:49:56 -08:00
Timothy Jaeryang Baek
2e7af7bdbf fix 2024-11-21 22:03:51 -08:00
Timothy Jaeryang Baek
12c8257c92 refac 2024-11-21 21:32:19 -08:00
Timothy Jaeryang Baek
81386e9b04 refac: citations -> sources 2024-11-21 19:46:09 -08:00
Michael Poluektov
e1a85c99ab format 2024-11-21 17:52:19 +00:00
Igor Brai
d16b09bee5
Merge branch 'open-webui:main' into main 2024-11-21 15:25:41 +02:00
Timothy Jaeryang Baek
4156b62811 refac 2024-11-20 10:02:07 -08:00
Timothy Jaeryang Baek
c0055afdb3 refac: youtube loader 2024-11-20 10:01:58 -08:00
Timothy Jaeryang Baek
d68aa5c708 chore: requirements
Some checks failed
Deploy to HuggingFace Spaces / check-secret (push) Successful in 14s
Create and publish Docker images with specific build args / build-main-image (linux/amd64) (push) Failing after 1m56s
Create and publish Docker images with specific build args / build-main-image (linux/arm64) (push) Failing after 2m9s
Create and publish Docker images with specific build args / merge-main-images (push) Has been skipped
Create and publish Docker images with specific build args / build-cuda-image (linux/amd64) (push) Failing after 2m4s
Create and publish Docker images with specific build args / build-cuda-image (linux/arm64) (push) Failing after 2m1s
Create and publish Docker images with specific build args / merge-cuda-images (push) Has been skipped
Create and publish Docker images with specific build args / build-ollama-image (linux/amd64) (push) Failing after 2m4s
Create and publish Docker images with specific build args / build-ollama-image (linux/arm64) (push) Failing after 1m59s
Create and publish Docker images with specific build args / merge-ollama-images (push) Has been skipped
Python CI / Format Backend (3.11) (push) Failing after 1m12s
Frontend Build / Format & Build Frontend (push) Failing after 1m2s
Frontend Build / Frontend Unit Tests (push) Failing after 56s
Integration Test / Run Cypress Integration Tests (push) Failing after 1m58s
Integration Test / Run Migration Tests (push) Failing after 1m23s
Deploy to HuggingFace Spaces / deploy (push) Has been skipped
2024-11-20 06:53:11 -08:00
Timothy Jaeryang Baek
2450953080 refac 2024-11-20 06:34:52 -08:00
Timothy Jaeryang Baek
0dd1d6de2a fix: import 2024-11-20 06:09:48 -08:00
Timothy Jaeryang Baek
8aa2d09cee chore: format 2024-11-19 12:22:58 -08:00
Timothy Jaeryang Baek
dbb67a12ca enh: retrieval query generation 2024-11-19 02:24:32 -08:00
yeounhak
8c161c797b Enable RAG_WEB_SEARCH_CONCURRENT_REQUESTS with asynchronous optimization for improved performance 2024-11-19 01:14:26 +00:00
Timothy Jaeryang Baek
20321e5271 refac: ollama setting for rag 2024-11-18 14:19:56 -08:00
Timothy Jaeryang Baek
c338f2cae1 chore: format 2024-11-16 23:46:12 -08:00
Timothy Jaeryang Baek
24e98bb9d7
Merge pull request #6954 from matthewhand/feature/qdrant-auth
feat: add API key support for Qdrant Cloud authentication
2024-11-16 23:42:16 -08:00
Timothy Jaeryang Baek
932de8f1e2 refac 2024-11-16 04:41:07 -08:00
Matthew Hand
ca63ae649c Enable Qdrant authentication support 2024-11-15 07:06:46 +11:00
Timothy Jaeryang Baek
61f29a6531
Merge branch 'main' into dev 2024-11-11 13:45:13 -08:00
Timothy Jaeryang Baek
96c865404d refac: disable openapi.json
Some checks failed
Release / release (push) Has been cancelled
Deploy to HuggingFace Spaces / check-secret (push) Has been cancelled
Create and publish Docker images with specific build args / build-main-image (linux/amd64) (push) Has been cancelled
Create and publish Docker images with specific build args / build-main-image (linux/arm64) (push) Has been cancelled
Create and publish Docker images with specific build args / build-cuda-image (linux/amd64) (push) Has been cancelled
Create and publish Docker images with specific build args / build-cuda-image (linux/arm64) (push) Has been cancelled
Create and publish Docker images with specific build args / build-ollama-image (linux/amd64) (push) Has been cancelled
Create and publish Docker images with specific build args / build-ollama-image (linux/arm64) (push) Has been cancelled
Python CI / Format Backend (3.11) (push) Has been cancelled
Frontend Build / Format & Build Frontend (push) Has been cancelled
Frontend Build / Frontend Unit Tests (push) Has been cancelled
Integration Test / Run Cypress Integration Tests (push) Has been cancelled
Integration Test / Run Migration Tests (push) Has been cancelled
Release to PyPI / release (push) Has been cancelled
Deploy to HuggingFace Spaces / deploy (push) Has been cancelled
Create and publish Docker images with specific build args / merge-main-images (push) Has been cancelled
Create and publish Docker images with specific build args / merge-cuda-images (push) Has been cancelled
Create and publish Docker images with specific build args / merge-ollama-images (push) Has been cancelled
2024-11-09 18:01:23 -08:00
Timothy J. Baek
a4abd32e4a fix 2024-11-06 23:01:10 -08:00
Timothy J. Baek
f8c2bedf53 fix: hybrid search 2024-11-06 22:51:36 -08:00
Jason Kidd
319ea8cb7f
feat: Add ability to set URI for pgvector 2024-11-04 14:27:33 -08:00
Jason Kidd
701f40aedd
feat: Initial support for pgvector 2024-11-04 14:26:41 -08:00
Timothy Jaeryang Baek
6c1d0a8e39
Merge pull request #6598 from dtaivpp/main
feat: OpenSearch vector db support
2024-11-04 14:04:55 -08:00
David Tippett
705e3129b6 Updating config format. 2024-11-04 15:14:53 -05:00
David Tippett
afca48028f Moving new config to under retreval 2024-11-04 15:10:14 -05:00
Davi Sclifo Zucon
a70e5a0f30 When UI "Bypass SSL verification for Websites"=True then ENABLE_RAG_WEB_LOADER_SSL_VERIFICATION=False 2024-11-04 16:29:29 -03:00
Davi Sclifo Zucon
35a9140567 Added parameter to: app.state.config.ENABLE_RAG_WEB_LOADER_SSL_VERIFICATION to get_web_loader(verify_ssl).
Invert variable value to send to UI , not ENABLE_RAG_WEB_LOADER_SSL_VERIFICATION.
2024-11-04 16:21:26 -03:00
Davi Sclifo Zucon
5306b49be0 Small Fix variable ssl_verification -> web_loader_ssl_verification (following python entity)
When changed via the web interface in Admin's WebSearch, the bypass option is not being persisted.
This change adjusts it to the same name as the one related in the python entity.
2024-11-04 15:40:16 -03:00
Timothy J. Baek
5c60081c1f refac: web search 2024-11-03 17:07:24 -08:00
Timothy J. Baek
f1065115aa fix: youtube loader issue 2024-11-03 03:18:17 -08:00
Timothy J. Baek
380e080f6d fix: do not crash on invalid embedding model 2024-11-03 01:08:04 -08:00
David Tippett
fb30b667e2 First pass at an OpenSearch connector 2024-10-30 15:51:56 -04:00
Timothy Jaeryang Baek
adfce28732
Merge pull request #6543 from execgit/main
Some checks are pending
Deploy to HuggingFace Spaces / check-secret (push) Waiting to run
Deploy to HuggingFace Spaces / deploy (push) Blocked by required conditions
Create and publish Docker images with specific build args / build-main-image (linux/amd64) (push) Waiting to run
Create and publish Docker images with specific build args / build-main-image (linux/arm64) (push) Waiting to run
Create and publish Docker images with specific build args / build-cuda-image (linux/amd64) (push) Waiting to run
Create and publish Docker images with specific build args / build-cuda-image (linux/arm64) (push) Waiting to run
Create and publish Docker images with specific build args / build-ollama-image (linux/amd64) (push) Waiting to run
Create and publish Docker images with specific build args / build-ollama-image (linux/arm64) (push) Waiting to run
Create and publish Docker images with specific build args / merge-main-images (push) Blocked by required conditions
Create and publish Docker images with specific build args / merge-cuda-images (push) Blocked by required conditions
Create and publish Docker images with specific build args / merge-ollama-images (push) Blocked by required conditions
Python CI / Format Backend (3.11) (push) Waiting to run
Frontend Build / Format & Build Frontend (push) Waiting to run
Frontend Build / Frontend Unit Tests (push) Waiting to run
Integration Test / Run Cypress Integration Tests (push) Waiting to run
Integration Test / Run Migration Tests (push) Waiting to run
fix: omit document contents in logging document embedding
2024-10-29 19:17:53 -07:00
Igor Brai
b7d730e244 add mojeek as websearch option 2024-10-29 16:45:38 +02:00
execgit
03e9add96d retrieval.utils: omit logging file contents at level INFO 2024-10-29 14:33:37 +02:00
execgit
bc7622c0fe Avoid logging file contents at level INFO
I had problems with document handling in rootless containers. Long documents caused the container to hang. Reducing the verbosity of logging from retrieval.main seemed to fix the issues I was experiencing.
2024-10-29 14:31:47 +02:00