OpenWebUI/docs
1
0
Fork 0
mirror of https://github.com/open-webui/docs synced 2025-05-19 18:58:41 +00:00
Code Issues Actions 1 Packages Projects Releases Wiki Activity

Update deepseekr1-dynamic.md

Browse Source
This commit is contained in:
Timothy Jaeryang Baek 2025-01-31 01:48:12 -08:00
parent 78ad3398df
commit 1461c0990a
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
docs/tutorials/integrations/deepseekr1-dynamic.md
View File

@ -1,6 +1,6 @@
---
sidebar_position: 1
title: "🦥 Run DeepSeek R1 Dynamic 1.58-bit with Llama.cpp"
title: "🐋 Run DeepSeek R1 Dynamic 1.58-bit with Llama.cpp"
---
A huge shoutout to **UnslothAI** for their incredible efforts! Thanks to their hard work, we can now run the **full DeepSeek-R1** 671B parameter model in its dynamic 1.58-bit quantized form (compressed to just 131GB) on **Llama.cpp**! And the best part? You no longer have to despair about needing massive enterprise-class GPUs or servers — it’s possible to run this model on your personal machine (albeit slowly for most consumer hardware).