Commit Graph

602 Commits

Author SHA1 Message Date
Timothy Jaeryang Baek
f5df0625e3 enh: file upload user permission 2024-11-16 21:41:34 -08:00
Timothy Jaeryang Baek
cf2dcf1dc3 feat: user permissions 2024-11-16 21:31:57 -08:00
Timothy Jaeryang Baek
07e0712b87 refac: get permissions 2024-11-16 21:16:42 -08:00
Timothy Jaeryang Baek
c0371f6525 enh: user permissions 2024-11-16 21:07:56 -08:00
Timothy Jaeryang Baek
b81cd15ced refac: prompts 2024-11-16 20:52:57 -08:00
Timothy Jaeryang Baek
41bad9abcb refac: access control 2024-11-16 20:47:45 -08:00
Timothy Jaeryang Baek
b562067e91 refac: tools 2024-11-16 18:31:13 -08:00
Timothy Jaeryang Baek
c35f8c9673 refac: knowledge access control 2024-11-16 18:00:57 -08:00
Timothy Jaeryang Baek
6ebf027613 refac: prompts access control 2024-11-16 18:00:49 -08:00
Timothy Jaeryang Baek
90d283c85e refac: tools access control 2024-11-16 17:57:19 -08:00
Timothy Jaeryang Baek
0a8f69285c refac: toolkit -> tools 2024-11-16 17:54:38 -08:00
Timothy Jaeryang Baek
a1ce8422fd refac 2024-11-16 17:49:13 -08:00
Timothy Jaeryang Baek
060a2791ba refac: rm print statement 2024-11-16 17:18:18 -08:00
Timothy Jaeryang Baek
c3aa09b95c refac 2024-11-16 17:17:18 -08:00
Timothy Jaeryang Baek
73fe77c2da enh: access control 2024-11-16 17:09:15 -08:00
Timothy Jaeryang Baek
227cca35e8 enh: knowledge access control 2024-11-16 16:51:55 -08:00
Timothy Jaeryang Baek
c8a3c42ea8 refac: filter out arena models from base models 2024-11-16 15:13:33 -08:00
Timothy Jaeryang Baek
345c9d12a9 refac: migration 2024-11-16 14:56:00 -08:00
Timothy Jaeryang Baek
243e187f0b refac 2024-11-16 14:52:07 -08:00
Timothy Jaeryang Baek
932de8f1e2 refac 2024-11-16 04:41:07 -08:00
Timothy Jaeryang Baek
646d926f70 enh: chat file upload permission 2024-11-16 02:31:04 -08:00
Timothy Jaeryang Baek
240c91e79d wip: access control 2024-11-16 01:24:34 -08:00
Timothy Jaeryang Baek
d5f84d6234 refac: model preset handling behaviour 2024-11-15 22:04:33 -08:00
Timothy Jaeryang Baek
19c98b74fa refac: base models endpoint 2024-11-15 19:14:24 -08:00
Timothy Jaeryang Baek
7f8c70b04a wip: admin models setting 2024-11-15 18:53:50 -08:00
Timothy Jaeryang Baek
9dae7d0572 refac: models 2024-11-15 18:21:41 -08:00
Timothy Jaeryang Baek
147bd0717d refac 2024-11-15 03:02:08 -08:00
Timothy Jaeryang Baek
a0f1164af7 refac 2024-11-15 03:00:18 -08:00
Timothy Jaeryang Baek
2ab5b2fd71 wip: access control backend 2024-11-15 01:29:07 -08:00
Timothy Jaeryang Baek
b80ec76435 refac 2024-11-14 20:51:49 -08:00
Timothy Jaeryang Baek
dff85c733d refac 2024-11-14 20:13:43 -08:00
Timothy Jaeryang Baek
150d0adea2 refac: access_control field 2024-11-14 18:57:25 -08:00
Timothy Jaeryang Baek
2f893fd373 refac 2024-11-14 18:37:29 -08:00
Timothy Jaeryang Baek
659f3dac44 feat: groups backend 2024-11-14 18:35:14 -08:00
Timothy Jaeryang Baek
716520275b feat: groups db migration 2024-11-14 18:33:16 -08:00
Timothy Jaeryang Baek
0cf1969adc refac: rm unused file 2024-11-14 18:31:29 -08:00
Matthew Hand
ca63ae649c Enable Qdrant authentication support 2024-11-15 07:06:46 +11:00
Timothy Jaeryang Baek
baea26d9ca wip: user groups frontend 2024-11-13 03:09:46 -08:00
Timothy Jaeryang Baek
81f497c6e3 refac: env var defaults 2024-11-12 20:44:14 -08:00
Timothy Jaeryang Baek
760652c4cc refac 2024-11-12 20:26:33 -08:00
Timothy Jaeryang Baek
0f704f1809 refac 2024-11-12 13:57:25 -08:00
Timothy Jaeryang Baek
08b5e7ef5b refac: ollama connections 2024-11-11 22:46:47 -08:00
Timothy Jaeryang Baek
99446c4b76 feat: ollama auth support 2024-11-11 22:33:18 -08:00
Timothy Jaeryang Baek
607a8b2109 refac: ollama connections 2024-11-11 22:25:08 -08:00
Timothy Jaeryang Baek
f8f36f298a refac 2024-11-11 22:03:57 -08:00
Timothy Jaeryang Baek
3ba7b6f0e5 fix 2024-11-11 21:52:39 -08:00
Timothy Jaeryang Baek
0809eb79b8 refac: openai connections 2024-11-11 21:18:51 -08:00
Timothy Jaeryang Baek
b82e25cac8 refac: openai /models
Some checks are pending
Deploy to HuggingFace Spaces / check-secret (push) Waiting to run
Deploy to HuggingFace Spaces / deploy (push) Blocked by required conditions
Create and publish Docker images with specific build args / build-main-image (linux/amd64) (push) Waiting to run
Create and publish Docker images with specific build args / build-main-image (linux/arm64) (push) Waiting to run
Create and publish Docker images with specific build args / build-cuda-image (linux/amd64) (push) Waiting to run
Create and publish Docker images with specific build args / build-cuda-image (linux/arm64) (push) Waiting to run
Create and publish Docker images with specific build args / build-ollama-image (linux/amd64) (push) Waiting to run
Create and publish Docker images with specific build args / build-ollama-image (linux/arm64) (push) Waiting to run
Create and publish Docker images with specific build args / merge-main-images (push) Blocked by required conditions
Create and publish Docker images with specific build args / merge-cuda-images (push) Blocked by required conditions
Create and publish Docker images with specific build args / merge-ollama-images (push) Blocked by required conditions
Python CI / Format Backend (3.11) (push) Waiting to run
Frontend Build / Format & Build Frontend (push) Waiting to run
Frontend Build / Frontend Unit Tests (push) Waiting to run
Integration Test / Run Cypress Integration Tests (push) Waiting to run
Integration Test / Run Migration Tests (push) Waiting to run
2024-11-11 14:11:20 -08:00
Timothy Jaeryang Baek
61f29a6531
Merge branch 'main' into dev 2024-11-11 13:45:13 -08:00
Samuel
f0c2f315b9 Merge branch 'dev' into dev-apitools 2024-11-10 09:55:25 +00:00
Samuel
1ffde395f8 formatting: endlines 2024-11-10 09:54:51 +00:00
Samuel
e825ebbcb9 feat: the tools are handled using a prompt or the native API mechanism depending on the native_tool_call parameter
The older code path is in fact unneeded (once you remove the tools, the new one ) but it's simpler an more tested so I leave it how it was.
2024-11-10 07:32:33 +00:00
Timothy Jaeryang Baek
96c865404d refac: disable openapi.json
Some checks failed
Release / release (push) Has been cancelled
Deploy to HuggingFace Spaces / check-secret (push) Has been cancelled
Create and publish Docker images with specific build args / build-main-image (linux/amd64) (push) Has been cancelled
Create and publish Docker images with specific build args / build-main-image (linux/arm64) (push) Has been cancelled
Create and publish Docker images with specific build args / build-cuda-image (linux/amd64) (push) Has been cancelled
Create and publish Docker images with specific build args / build-cuda-image (linux/arm64) (push) Has been cancelled
Create and publish Docker images with specific build args / build-ollama-image (linux/amd64) (push) Has been cancelled
Create and publish Docker images with specific build args / build-ollama-image (linux/arm64) (push) Has been cancelled
Python CI / Format Backend (3.11) (push) Has been cancelled
Frontend Build / Format & Build Frontend (push) Has been cancelled
Frontend Build / Frontend Unit Tests (push) Has been cancelled
Integration Test / Run Cypress Integration Tests (push) Has been cancelled
Integration Test / Run Migration Tests (push) Has been cancelled
Release to PyPI / release (push) Has been cancelled
Deploy to HuggingFace Spaces / deploy (push) Has been cancelled
Create and publish Docker images with specific build args / merge-main-images (push) Has been cancelled
Create and publish Docker images with specific build args / merge-cuda-images (push) Has been cancelled
Create and publish Docker images with specific build args / merge-ollama-images (push) Has been cancelled
2024-11-09 18:01:23 -08:00
Timothy Jaeryang Baek
2fdbab6640
Merge pull request #6761 from diegmonti/feat/permissions-policy
Some checks are pending
Deploy to HuggingFace Spaces / check-secret (push) Waiting to run
Deploy to HuggingFace Spaces / deploy (push) Blocked by required conditions
Create and publish Docker images with specific build args / build-main-image (linux/amd64) (push) Waiting to run
Create and publish Docker images with specific build args / build-main-image (linux/arm64) (push) Waiting to run
Create and publish Docker images with specific build args / build-cuda-image (linux/amd64) (push) Waiting to run
Create and publish Docker images with specific build args / build-cuda-image (linux/arm64) (push) Waiting to run
Create and publish Docker images with specific build args / build-ollama-image (linux/amd64) (push) Waiting to run
Create and publish Docker images with specific build args / build-ollama-image (linux/arm64) (push) Waiting to run
Create and publish Docker images with specific build args / merge-main-images (push) Blocked by required conditions
Create and publish Docker images with specific build args / merge-cuda-images (push) Blocked by required conditions
Create and publish Docker images with specific build args / merge-ollama-images (push) Blocked by required conditions
Python CI / Format Backend (3.11) (push) Waiting to run
Frontend Build / Format & Build Frontend (push) Waiting to run
Frontend Build / Frontend Unit Tests (push) Waiting to run
Integration Test / Run Cypress Integration Tests (push) Waiting to run
Integration Test / Run Migration Tests (push) Waiting to run
feat: Add permissions-policy to security headers
2024-11-09 00:30:48 -08:00
Timothy J. Baek
a4abd32e4a fix 2024-11-06 23:01:10 -08:00
Timothy J. Baek
f8c2bedf53 fix: hybrid search 2024-11-06 22:51:36 -08:00
Samuel
dc5771d6f0 fix conflicts 2024-11-06 20:22:40 +00:00
Samuel
91315b42c0 fix for openai.com requests 2024-11-06 19:58:18 +00:00
Diego Monti
b1805380dc feat: Add permissions-policy to security headers 2024-11-06 18:16:22 +01:00
Timothy J. Baek
4616b508b1 refac: token handling 2024-11-05 21:14:02 -08:00
Timothy Jaeryang Baek
69311fec71
Merge pull request #6750 from Sebastriani/main
feat: Possibility to globaly disable Tags generation.
2024-11-05 20:53:10 -08:00
Timothy J. Baek
547682c674 refac 2024-11-05 20:47:23 -08:00
Timothy J. Baek
75b169e11d refac: ldap auth page 2024-11-05 20:32:09 -08:00
Timothy J. Baek
2910cbe9a9 refac: disable ldap by default 2024-11-05 19:58:54 -08:00
Sebastián D. Gauna
e1114bfa4c feat: Possibility to globaly disable Tags generation. 2024-11-05 23:32:08 -03:00
Timothy J. Baek
28b541a692 refac
Some checks are pending
Deploy to HuggingFace Spaces / check-secret (push) Waiting to run
Deploy to HuggingFace Spaces / deploy (push) Blocked by required conditions
Create and publish Docker images with specific build args / build-main-image (linux/amd64) (push) Waiting to run
Create and publish Docker images with specific build args / build-main-image (linux/arm64) (push) Waiting to run
Create and publish Docker images with specific build args / build-cuda-image (linux/amd64) (push) Waiting to run
Create and publish Docker images with specific build args / build-cuda-image (linux/arm64) (push) Waiting to run
Create and publish Docker images with specific build args / build-ollama-image (linux/amd64) (push) Waiting to run
Create and publish Docker images with specific build args / build-ollama-image (linux/arm64) (push) Waiting to run
Create and publish Docker images with specific build args / merge-main-images (push) Blocked by required conditions
Create and publish Docker images with specific build args / merge-cuda-images (push) Blocked by required conditions
Create and publish Docker images with specific build args / merge-ollama-images (push) Blocked by required conditions
Python CI / Format Backend (3.11) (push) Waiting to run
Frontend Build / Format & Build Frontend (push) Waiting to run
Frontend Build / Frontend Unit Tests (push) Waiting to run
Integration Test / Run Cypress Integration Tests (push) Waiting to run
Integration Test / Run Migration Tests (push) Waiting to run
2024-11-05 15:15:32 -08:00
Timothy Jaeryang Baek
1ee7730fac
Merge pull request #6645 from jk-f5/feat/pgvector
feat: Intial support for pgvector as backing vector database
2024-11-05 15:14:55 -08:00
Timothy Jaeryang Baek
1f36cad9ef
Fix code scanning alert no. 129: LDAP query built from user-controlled sources
Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>
2024-11-05 18:10:16 -05:00
morgan55555
5d934d7d15 feat: LDAP User management
LDAP will be used as default if no other auth form is enabled.
LDAP now will work with ENABLE_LOGIN_FORM = false.
Fixed exception "User does not match the record."
Now LDAP login is case insensitive.
Integrated with onboarding feature.
2024-11-06 03:30:23 +05:00
Jason Kidd
319ea8cb7f
feat: Add ability to set URI for pgvector 2024-11-04 14:27:33 -08:00
Jason Kidd
701f40aedd
feat: Initial support for pgvector 2024-11-04 14:26:41 -08:00
Timothy Jaeryang Baek
6c1d0a8e39
Merge pull request #6598 from dtaivpp/main
feat: OpenSearch vector db support
2024-11-04 14:04:55 -08:00
David Tippett
705e3129b6 Updating config format. 2024-11-04 15:14:53 -05:00
David Tippett
afca48028f Moving new config to under retreval 2024-11-04 15:10:14 -05:00
Davi Sclifo Zucon
a70e5a0f30 When UI "Bypass SSL verification for Websites"=True then ENABLE_RAG_WEB_LOADER_SSL_VERIFICATION=False 2024-11-04 16:29:29 -03:00
Davi Sclifo Zucon
35a9140567 Added parameter to: app.state.config.ENABLE_RAG_WEB_LOADER_SSL_VERIFICATION to get_web_loader(verify_ssl).
Invert variable value to send to UI , not ENABLE_RAG_WEB_LOADER_SSL_VERIFICATION.
2024-11-04 16:21:26 -03:00
Davi Sclifo Zucon
5306b49be0 Small Fix variable ssl_verification -> web_loader_ssl_verification (following python entity)
When changed via the web interface in Admin's WebSearch, the bypass option is not being persisted.
This change adjusts it to the same name as the one related in the python entity.
2024-11-04 15:40:16 -03:00
Timothy J. Baek
1fd67d7e5d feat: native speecht5 support 2024-11-04 01:16:51 -08:00
Timothy J. Baek
5c60081c1f refac: web search 2024-11-03 17:07:24 -08:00
Timothy J. Baek
f1065115aa fix: youtube loader issue 2024-11-03 03:18:17 -08:00
Timothy J. Baek
194b924a96 feat: onboarding screen 2024-11-03 03:00:28 -08:00
Timothy J. Baek
dbf14afa32 refac: styling 2024-11-03 02:00:31 -08:00
Timothy J. Baek
4e7951d5fc fix: allow openai list message format 2024-11-03 01:34:45 -08:00
Timothy J. Baek
98cea8aaa4 refac: automatically disable new sign ups after first user 2024-11-03 01:25:41 -08:00
Timothy J. Baek
380e080f6d fix: do not crash on invalid embedding model 2024-11-03 01:08:04 -08:00
Timothy J. Baek
6027c13227 fix: s3 file path 2024-11-03 01:07:43 -08:00
Timothy J. Baek
0c6453078e refac: orientation 2024-11-03 01:59:53 -07:00
Timothy J. Baek
230e2f8f82 fix: remove tags gen print 2024-11-03 01:54:23 -07:00
Samuel
3724e888c6 fixes for cohere models 2024-11-03 08:50:33 +00:00
Samuel
850a70ce45 fix for qwen models 2024-11-03 06:37:34 +00:00
Timothy Jaeryang Baek
dead5cdd4e
Merge pull request #6589 from DucNgn/dn_forward_user_info_in_headers
feat: Add option to forward user info as headers to OpenAI API
2024-11-02 17:24:04 -07:00
Samuel
0de6419a29 fixhandle arguments in ollama 2024-11-02 13:50:14 +00:00
Duc Nguyen
06f44dc067 Minor comment 2024-11-01 11:24:10 -04:00
Duc Nguyen
a34d202ae8 move the config to env.py 2024-11-01 11:23:18 -04:00
Samuel
b4f1ea6013 fix ollama logic 2024-11-01 06:09:41 +00:00
David Tippett
fb30b667e2 First pass at an OpenSearch connector 2024-10-30 15:51:56 -04:00
Duc Nguyen
3f0b3ea90e feat: Add option to forward user info as headers to OpenAI API 2024-10-30 11:29:18 -04:00
Timothy Jaeryang Baek
adfce28732
Merge pull request #6543 from execgit/main
Some checks are pending
Deploy to HuggingFace Spaces / check-secret (push) Waiting to run
Deploy to HuggingFace Spaces / deploy (push) Blocked by required conditions
Create and publish Docker images with specific build args / build-main-image (linux/amd64) (push) Waiting to run
Create and publish Docker images with specific build args / build-main-image (linux/arm64) (push) Waiting to run
Create and publish Docker images with specific build args / build-cuda-image (linux/amd64) (push) Waiting to run
Create and publish Docker images with specific build args / build-cuda-image (linux/arm64) (push) Waiting to run
Create and publish Docker images with specific build args / build-ollama-image (linux/amd64) (push) Waiting to run
Create and publish Docker images with specific build args / build-ollama-image (linux/arm64) (push) Waiting to run
Create and publish Docker images with specific build args / merge-main-images (push) Blocked by required conditions
Create and publish Docker images with specific build args / merge-cuda-images (push) Blocked by required conditions
Create and publish Docker images with specific build args / merge-ollama-images (push) Blocked by required conditions
Python CI / Format Backend (3.11) (push) Waiting to run
Frontend Build / Format & Build Frontend (push) Waiting to run
Frontend Build / Frontend Unit Tests (push) Waiting to run
Integration Test / Run Cypress Integration Tests (push) Waiting to run
Integration Test / Run Migration Tests (push) Waiting to run
fix: omit document contents in logging document embedding
2024-10-29 19:17:53 -07:00
execgit
03e9add96d retrieval.utils: omit logging file contents at level INFO 2024-10-29 14:33:37 +02:00
execgit
bc7622c0fe Avoid logging file contents at level INFO
I had problems with document handling in rootless containers. Long documents caused the container to hang. Reducing the verbosity of logging from retrieval.main seemed to fix the issues I was experiencing.
2024-10-29 14:31:47 +02:00