DeepSeek/DeepSeek-LLM
1
0
Fork 0
mirror of https://github.com/deepseek-ai/DeepSeek-LLM synced 2025-02-01 23:34:03 +00:00
Code Issues Actions Packages Projects Releases Wiki Activity

Update README.md (#16)

Browse Source
This commit is contained in:
Fuli Luo 2023-12-04 19:45:45 +08:00 committed by GitHub
parent 9fa033d753
commit 8b216f7cef
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 2 additions and 6 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

8
README.md
View File

@ -212,11 +212,7 @@ On the basis of `Python >= 3.8` environment, install the necessary dependencies
pip install -r requirements.txt
```
### Inference
Here are some examples of utilizing our models.
#### Inference with Huggingface's Transformers
### Inference with Huggingface's Transformers
You can directly employ [Huggingface's Transformers](https://github.com/huggingface/transformers) for model inference.
@ -274,7 +270,7 @@ Assistant:
**Note:** By default (`add_special_tokens=True`), our tokenizer automatically adds a `bos_token` (`<｜begin▁of▁sentence｜>`) before the input text. Additionally, since the system prompt is not compatible with this version of our models, we DO NOT RECOMMEND including the system prompt in your input.
#### Inference with vLLM
### Inference with vLLM
You can also employ [vLLM](https://github.com/vllm-project/vllm) for high-throughput inference.