Merge pull request #209 from Helvio88/patch-1

Use new OpenAI Completions Endpoint
This commit is contained in:
Timothy Jaeryang Baek 2024-09-10 00:56:59 +01:00 committed by GitHub
commit 7ba65e33ec
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194

View File

@ -68,6 +68,7 @@ Make sure you pull the model into your ollama instance/s beforehand.
"title": "Granite Code", "title": "Granite Code",
"provider": "openai", "provider": "openai",
"model": "granite-code:latest", "model": "granite-code:latest",
"useLegacyCompletionsEndpoint": false,
"apiBase": "http://YOUROPENWEBUI/ollama/v1", "apiBase": "http://YOUROPENWEBUI/ollama/v1",
"apiKey": "sk-YOUR-API-KEY" "apiKey": "sk-YOUR-API-KEY"
} }
@ -83,6 +84,7 @@ Make sure you pull the model into your ollama instance/s beforehand.
"title": "Granite Code", "title": "Granite Code",
"provider": "openai", "provider": "openai",
"model": "granite-code:latest", "model": "granite-code:latest",
"useLegacyCompletionsEndpoint": false,
"apiBase": "http://localhost:3000/ollama/v1", "apiBase": "http://localhost:3000/ollama/v1",
"apiKey": "sk-YOUR-API-KEY" "apiKey": "sk-YOUR-API-KEY"
} }
@ -98,4 +100,4 @@ Select it and you should now be chatting via Open WebUI (and or any [pipelines](
You can do this for as many models you would like to use, altough any model should work, you should use a model that is designed for code. You can do this for as many models you would like to use, altough any model should work, you should use a model that is designed for code.
See the continue documentation for additional continue configuration, [Continue Documentation](https://docs.continue.dev/reference/Model%20Providers/openai) See the continue documentation for additional continue configuration, [Continue Documentation](https://docs.continue.dev/reference/Model%20Providers/openai)