OpenWebUI/docs
1
0
Fork 0
mirror of https://github.com/open-webui/docs synced 2025-05-19 10:52:14 +00:00
Code Issues Actions Packages Projects Releases Wiki Activity

Update starting-with-openai-compatible.mdx
Some checks are pending
Deploy site to Pages / build (push) Waiting to run
Details
Deploy site to Pages / deploy (push) Blocked by required conditions
Details

Browse Source
This commit is contained in:
Timothy Jaeryang Baek 2025-05-08 03:01:07 +04:00
parent 701524fbc4
commit d2c411a4f9
1 changed files with 2 additions and 3 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

5
docs/getting-started/quick-start/starting-with-openai-compatible.mdx
View File

@ -20,7 +20,7 @@ There are many servers and tools that expose an OpenAI-compatible API. Here are
- [Llama.cpp](https://github.com/ggml-org/llama.cpp): Extremely efficient, runs on CPU and GPU - [Llama.cpp](https://github.com/ggml-org/llama.cpp): Extremely efficient, runs on CPU and GPU
- [Ollama](https://ollama.com/): Super user-friendly and cross-platform - [Ollama](https://ollama.com/): Super user-friendly and cross-platform
- [LM Studio](https://lmstudio.ai/): Rich desktop app for Windows/Mac/Linux - [LM Studio](https://lmstudio.ai/): Rich desktop app for Windows/Mac/Linux
- [Lemonade (ONNX TurnkeyML)](https://github.com/onnx/turnkeyml): Fast ONNX-based backend, easily runs GGUF and other models locally - [Lemonade (ONNX TurnkeyML)](https://github.com/onnx/turnkeyml): Fast ONNX-based backend with NPU/iGPU acceleration
Pick whichever suits your workflow! Pick whichever suits your workflow!
@ -41,8 +41,7 @@ Lemonade is a plug-and-play ONNX-based OpenAI-compatible server. Here’s how to
![Lemonade Server](/images/getting-started/lemonade-server.png) ![Lemonade Server](/images/getting-started/lemonade-server.png)
See [their docs](https://github.com/onnx/turnkeyml) for details.
Lemonade works on Linux and Mac too—see [their docs](https://github.com/onnx/turnkeyml) for details.
--- ---