From 53b055bc1e6e9de307b7c72ff2afd0b6d18e865a Mon Sep 17 00:00:00 2001 From: enoch kan Date: Sat, 25 Jan 2025 22:21:51 +0000 Subject: [PATCH 1/3] docs: Add system requirements for DeepSeek-Infer demo --- README.md | 12 +++++++++++- 1 file changed, 11 insertions(+), 1 deletion(-) diff --git a/README.md b/README.md index c43e2b3..86e8492 100644 --- a/README.md +++ b/README.md @@ -253,6 +253,16 @@ python fp8_cast_bf16.py --input-fp8-hf-path /path/to/fp8_weights --output-bf16-h ### 6.1 Inference with DeepSeek-Infer Demo (example only) +#### System Requirements + +OS: Linux (Mac, Windows are currently not supported) + +- Python 3.10 +- PyTorch 2.4.1 +- Transformers 4.46.3 +- Safetensors 0.4.5 +- Triton 3.0.0 + #### Model Weights & Demo Code Preparation First, clone our DeepSeek-V3 GitHub repository: @@ -261,7 +271,7 @@ First, clone our DeepSeek-V3 GitHub repository: git clone https://github.com/deepseek-ai/DeepSeek-V3.git ``` -Navigate to the `inference` folder and install dependencies listed in `requirements.txt`. +Navigate to the `inference` folder and install dependencies listed in `requirements.txt`. Easiest way is to use a package manager like `conda` or `uv` to create a new virtual environment and install the dependencies. ```shell cd DeepSeek-V3/inference From 722e6885ef02adcbbc4e5cb55ecc848087d60b77 Mon Sep 17 00:00:00 2001 From: enoch kan Date: Sat, 25 Jan 2025 22:26:48 +0000 Subject: [PATCH 2/3] docs: Improve system requirements section formatting --- README.md | 15 ++++++++------- 1 file changed, 8 insertions(+), 7 deletions(-) diff --git a/README.md b/README.md index 86e8492..f2ca61b 100644 --- a/README.md +++ b/README.md @@ -255,14 +255,15 @@ python fp8_cast_bf16.py --input-fp8-hf-path /path/to/fp8_weights --output-bf16-h #### System Requirements -OS: Linux (Mac, Windows are currently not supported) - -- Python 3.10 -- PyTorch 2.4.1 -- Transformers 4.46.3 -- Safetensors 0.4.5 -- Triton 3.0.0 +:warning: **Mac, Windows are currently not supported**: OS: Linux + Python 3.10 +Dependencies: +``` +torch==2.4.1 +triton==3.0.0 +transformers==4.46.3 +safetensors==0.4.5 +``` #### Model Weights & Demo Code Preparation First, clone our DeepSeek-V3 GitHub repository: From 53d8dc9966be4fa2629f7191a782311eb6b7e50c Mon Sep 17 00:00:00 2001 From: enoch kan Date: Sat, 25 Jan 2025 22:29:54 +0000 Subject: [PATCH 3/3] docs: Update system requirements with GitHub Markdown callout --- README.md | 3 ++- 1 file changed, 2 insertions(+), 1 deletion(-) diff --git a/README.md b/README.md index f2ca61b..7ecf87e 100644 --- a/README.md +++ b/README.md @@ -255,7 +255,8 @@ python fp8_cast_bf16.py --input-fp8-hf-path /path/to/fp8_weights --output-bf16-h #### System Requirements -:warning: **Mac, Windows are currently not supported**: OS: Linux + Python 3.10 +> [!NOTE] +> Linux with Python 3.10 only. Mac and Windows are not supported. Dependencies: ```