From e690191317de662a080fc38b4f69abe91c5bbba4 Mon Sep 17 00:00:00 2001 From: BingxuanWang <151806429+BingxuanWang@users.noreply.github.com> Date: Thu, 30 Nov 2023 09:59:55 +0800 Subject: [PATCH] Update README.md --- README.md | 5 ++++- 1 file changed, 4 insertions(+), 1 deletion(-) diff --git a/README.md b/README.md index f1138cd..e7c0278 100644 --- a/README.md +++ b/README.md @@ -352,7 +352,10 @@ python convert-hf-to-gguf.py --outfile --model-name dee ``` ##### GPTQ(exllamav2) -The [PR](https://github.com/turboderp/exllamav2/pull/189) to [exllamav2](https://github.com/turboderp/exllamav2) is also under reviewing. Please using the forked version before the PR getting merged. +`UPDATE:`[exllamav2](https://github.com/turboderp/exllamav2) has been able to support Huggingface Tokenizer. Please pull the latest version and try out. + +Remeber to set RoPE scaling to 4 for correct output, more discussion could be found in this [PR](https://github.com/turboderp/exllamav2/pull/189). + ### 8. Resources [awesome-deepseek-coder](https://github.com/deepseek-ai/awesome-deepseek-coder) is a curated list of open-source projects related to DeepSeek Coder.