UniqAI
/
open-webui
mirror of https://github.com/open-webui/open-webui
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity

Merge pull request #1773 from Rmaan/fix-openrouter-streaming 

Fixed OpenRouter heart beats breaking streaming
This commit is contained in:
Timothy Jaeryang Baek 2024-04-26 11:05:52 -07:00 committed by GitHub
parent e9ba8d74d2 4ad7ef84a4
commit add5269b89
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 4 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

4
src/lib/apis/streaming/index.ts
View File

@ -31,6 +31,10 @@ async function* openAIStreamToIterator(
console.log(line);
if (line === 'data: [DONE]') {
yield { done: true, value: '' };
} else if (line.startsWith(':')) {
// Events starting with : are comments https://developer.mozilla.org/en-US/docs/Web/API/Server-sent_events/Using_server-sent_events#event_stream_format
// OpenRouter sends heartbeats like ": OPENROUTER PROCESSING"
continue
} else {
const data = JSON.parse(line.replace(/^data: /, ''));
console.log(data);