DeepSeek/DeepSeek-V3
1
0
Fork 0
mirror of https://github.com/deepseek-ai/DeepSeek-V3 synced 2025-03-12 14:39:26 +00:00
Code Issues Actions 1 Packages Projects Releases Wiki Activity

Merge pull request #341 from enochkan/main

Browse Source 
docs: Add system requirements for DeepSeek-Infer demo
This commit is contained in:
Huang Panpan 2025-01-26 09:29:50 +08:00 committed by GitHub
commit b5d872ead0
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 13 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

14
README.md
View File

@ -253,6 +253,18 @@ python fp8_cast_bf16.py --input-fp8-hf-path /path/to/fp8_weights --output-bf16-h
### 6.1 Inference with DeepSeek-Infer Demo (example only) ### 6.1 Inference with DeepSeek-Infer Demo (example only)
#### System Requirements
> [!NOTE]
> Linux with Python 3.10 only. Mac and Windows are not supported.
Dependencies:
```
torch==2.4.1
triton==3.0.0
transformers==4.46.3
safetensors==0.4.5
```
#### Model Weights & Demo Code Preparation #### Model Weights & Demo Code Preparation
First, clone our DeepSeek-V3 GitHub repository: First, clone our DeepSeek-V3 GitHub repository:
@ -261,7 +273,7 @@ First, clone our DeepSeek-V3 GitHub repository:
git clone https://github.com/deepseek-ai/DeepSeek-V3.git git clone https://github.com/deepseek-ai/DeepSeek-V3.git
``` ```
Navigate to the `inference` folder and install dependencies listed in `requirements.txt`. Navigate to the `inference` folder and install dependencies listed in `requirements.txt`. Easiest way is to use a package manager like `conda` or `uv` to create a new virtual environment and install the dependencies.
```shell ```shell
cd DeepSeek-V3/inference cd DeepSeek-V3/inference