DeepSeek/DeepSeek-MoE
1
0
Fork 0
mirror of https://github.com/deepseek-ai/DeepSeek-MoE synced 2025-06-26 18:27:03 +00:00
Code Issues Actions Packages Projects Releases Wiki Activity

initial commit

Browse Source
This commit is contained in:
zwd973-deepseek
2024-01-11 10:35:17 +08:00
commit 1c8e7915f5
14 changed files with 816 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

11
requirements.txt Normal file
View File

@@ -0,0 +1,11 @@
torch>=2.0.1
tokenizers>=0.14.0
transformers>=4.36.2
accelerate
attrdict
tqdm
deepspeed
datasets
tensorboardX
peft