DeepSeek/DeepSeek-Coder-V2
1
0
Fork 0
mirror of https://github.com/deepseek-ai/DeepSeek-Coder-V2 synced 2024-11-22 03:17:37 +00:00
Code Issues Actions Packages Projects Releases Wiki Activity

Update README.md

Browse Source
This commit is contained in:
Daya Guo 2024-07-03 13:09:24 +08:00 committed by GitHub
parent b945d8135e
commit 09209c4aed
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
README.md
View File

@ -237,7 +237,7 @@ messages=[
{ 'role': 'user', 'content': "write a quick sort algorithm in python."} { 'role': 'user', 'content': "write a quick sort algorithm in python."}
] ]
inputs = tokenizer.apply_chat_template(messages, add_generation_prompt=True, return_tensors="pt").to(model.device) inputs = tokenizer.apply_chat_template(messages, add_generation_prompt=True, return_tensors="pt").to(model.device)
# tokenizer.eos_token_id is the id of <|EOT|> token # tokenizer.eos_token_id is the id of <｜end▁of▁sentence｜> token
outputs = model.generate(inputs, max_new_tokens=512, do_sample=False, top_k=50, top_p=0.95, num_return_sequences=1, eos_token_id=tokenizer.eos_token_id) outputs = model.generate(inputs, max_new_tokens=512, do_sample=False, top_k=50, top_p=0.95, num_return_sequences=1, eos_token_id=tokenizer.eos_token_id)
print(tokenizer.decode(outputs[0][len(inputs[0]):], skip_special_tokens=True)) print(tokenizer.decode(outputs[0][len(inputs[0]):], skip_special_tokens=True))
``` ```