7 Commits

Author	SHA1	Message	Date
Timothy Jaeryang Baek	81fb53e757	Merge pull request #1780 from cheahjs/fix/harden-streaming ... fix: harden openai streaming parsing	2024-04-26 11:06:20 -07:00
Jun Siang Cheah	615e9e348f	fix: do not error out if OpenAI response has no delta	2024-04-26 18:42:43 +01:00
Jun Siang Cheah	510afab37c	fix: catch any errors parsing openai sse events	2024-04-26 18:38:25 +01:00
Arman Ordookhani	4ad7ef84a4	add else	2024-04-26 15:45:29 +02:00
Arman Ordookhani	7449634290	Fix OpenRouter hearbeats breaking streaming	2024-04-26 15:37:18 +02:00
Jun Siang Cheah	67df928c7a	feat: make chunk splitting a configurable option	2024-04-21 11:00:33 +01:00
Jun Siang Cheah	efa258c695	feat: split large openai responses into smaller chunkers	2024-04-20 20:34:23 +01:00