11 Commits

Author	SHA1	Message	Date
Wei Xu	57794ff6f8	Clean up configs	2024-11-07 15:30:46 +11:00
Wei Xu	98ca4520e5	Change asyncboto3 to boto3	2024-11-07 13:17:31 +11:00
Wei Xu	c9a904f7af	Get file using async content stream	2024-11-07 12:26:55 +11:00
Wei Xu	15e4ef01a8	Use async method from aioboto3	2024-11-07 11:03:58 +11:00
Wei Xu	63e996fb9d	Split storage provider into multiple files	2024-11-07 10:13:32 +11:00
Wei Xu	b3b1caed9b	Save original file info in vector db metadata	2024-11-06 18:06:00 +11:00
Wei Xu	2867cfcd29	Clean up local file storeage when using S3 for upload	2024-11-06 17:30:33 +11:00
Timothy J. Baek	5d2714bc92	fix: s3 file upload	2024-10-25 21:50:31 -07:00
Timothy J. Baek	cd8271eb95	fix	2024-10-20 23:48:28 -07:00
Timothy J. Baek	7984980619	feat: s3 support	2024-10-20 23:38:26 -07:00
Timothy J. Baek	cb86e09005	feat: s3 support (cherry-picked from #6117) ... Co-Authored-By: ssnnow <ssnnow@gmail.com>	2024-10-20 22:53:45 -07:00