49 Commits

Author	SHA1	Message	Date
Jerry	f07172bfe6	fix the checking logic in get_model_path ... fix the checking logic in function get_model_path()	2024-07-12 14:21:37 +08:00
Timothy J. Baek	c7a9b5ccfa	refac: chat completion middleware	2024-07-01 19:33:58 -07:00
Jun Siang Cheah	a48ac6a209	refac: lazily load sentence_transformers to reduce start up memory usage	2024-07-01 08:13:56 +08:00
Timothy J. Baek	20e4f6cc16	refac	2024-06-18 14:55:18 -07:00
Timothy J. Baek	bd5a8567ef	refac: tools & rag	2024-06-11 01:10:24 -07:00
Timothy J. Baek	f2b9a5f5bf	refac: rag	2024-06-09 03:01:25 -07:00
Jun Siang Cheah	0cb8163321	feat: add RAG_EMBEDDING_OPENAI_BATCH_SIZE to batch multiple embeddings	2024-06-02 15:34:31 +01:00
Timothy J. Baek	999d2bc21b	refac: web search	2024-06-01 19:52:12 -07:00
Timothy J. Baek	912a704fdc	refac: web search settings	2024-06-01 19:40:48 -07:00
Timothy J. Baek	74a8deb19f	refac	2024-05-27 14:25:36 -07:00
Timothy Jaeryang Baek	635951b55c	Merge branch 'dev' into feat/backend-web-search	2024-05-06 16:26:44 -07:00
Timothy J. Baek	64ed0d1089	refac: include source name to citation	2024-05-06 16:16:26 -07:00
Timothy J. Baek	4c490132ba	refac: styling	2024-05-06 16:16:26 -07:00
Jun Siang Cheah	0872bea790	feat: show RAG query results as citations	2024-05-06 16:14:10 -07:00
Jun Siang Cheah	99e4edd364	feat: add websearch endpoint to RAG API ... fix: google PSE endpoint uses GET fix: google PSE returns link, not url fix: serper wrong field	2024-05-06 17:09:04 +08:00
Jun Siang Cheah	501ff7a98b	feat: backend implementation of various search APIs	2024-05-06 12:28:41 +08:00
tabacoWang	fffd283b0c	fix: ... fix: Change the type from int to float	2024-05-02 13:45:19 +08:00
Yanyutin753	c0bb32d768	📌 fixed a bug where RAG would not reply after not reading the file correctly	2024-04-30 13:51:30 +08:00
Steven Kreitzer	5b8fd14470	fix: various api rag results	2024-04-29 12:17:36 -05:00
Timothy J. Baek	ce9a5d12e0	refac: rag pipeline	2024-04-27 15:38:50 -04:00
Timothy J. Baek	8f1563a7a5	fix: typo	2024-04-27 15:03:49 -04:00
Timothy J. Baek	9be56d68e0	refac: naming convention	2024-04-27 15:02:57 -04:00
Timothy J. Baek	cebf733b9d	refac: naming convention	2024-04-26 14:41:39 -04:00
Steven Kreitzer	69822e4c25	fix: sort ranking hybrid	2024-04-26 07:56:41 -05:00
Steven Kreitzer	9755cd5baa	feat: toggle hybrid search	2024-04-25 17:51:38 -05:00
Timothy J. Baek	984dbf13ab	revert: original rag pipeline	2024-04-25 17:03:00 -04:00
Steven Kreitzer	72090fab88	chore: update log line	2024-04-25 13:28:31 -05:00
Steven Kreitzer	c9c9660459	fix: address comment in pr #1687	2024-04-25 07:50:42 -05:00
Steven Kreitzer	c0259aad67	feat: hybrid search and reranking support	2024-04-24 07:55:10 -05:00
Steven Kreitzer	4e0b32b505	feat: hybrid search	2024-04-22 18:33:43 -05:00
Steven Kreitzer	f3e5700d49	feat: move to native sentence_transformer	2024-04-22 14:20:41 -05:00
Timothy J. Baek	710850e442	refac: audio	2024-04-20 15:15:59 -05:00
Timothy J. Baek	741ed5dc4c	fix	2024-04-14 19:56:33 -04:00
Timothy J. Baek	b1b72441bb	feat: openai embeddings integration	2024-04-14 19:48:15 -04:00
Timothy J. Baek	b48e73fa43	feat: openai embeddings support	2024-04-14 19:15:39 -04:00
Timothy J. Baek	36ce157907	fix: integration	2024-04-14 18:47:45 -04:00
Timothy J. Baek	2952e61167	feat: external embeddings support	2024-04-14 17:55:00 -04:00
Timothy J. Baek	f4b87ecb23	refac	2024-04-10 00:33:45 -07:00
Self Denial	075fbedb02	More format fixes	2024-04-04 12:07:42 -06:00
Self Denial	bcf79c8366	Format fixes	2024-04-04 12:02:48 -06:00
Self Denial	3b66aa55c0	Improve embedding model update & resolve network dependency ... * Add config variable RAG_EMBEDDING_MODEL_AUTO_UPDATE to control update behavior * Add RAG utils embedding_model_get_path() function to output the filesystem path in addition to update of the model using huggingface_hub * Update and utilize existing RAG functions in main: get_embedding_model() & update_embedding_model() * Add GUI setting to execute manual update process	2024-04-04 11:01:23 -06:00
Timothy J. Baek	a6c154d839	feat: rag context logging	2024-03-31 14:02:31 -07:00
Timothy Jaeryang Baek	371dfc1143	Merge branch 'dev' into debug_print	2024-03-24 18:04:03 -05:00
Timothy J. Baek	7e0ea8f77d	feat: RAG text ingestion(store) api	2024-03-24 00:40:27 -07:00
Self Denial	e6dd0bfbe0	Migrate to python logging module with env var control.	2024-03-20 17:11:36 -06:00
Timothy J. Baek	072b499a50	fix: backslash rag content issue	2024-03-15 13:34:52 -07:00
Timothy J. Baek	8df6b137cb	fix: rag	2024-03-10 18:40:50 -07:00
Timothy J. Baek	c49491e516	refac: rag to backend	2024-03-08 22:34:47 -08:00
Timothy J. Baek	7e5e2c42c9	refac: rag routes	2024-03-08 19:26:39 -08:00