DeepSeek/DeepEP
1
0
Fork 0
mirror of https://github.com/deepseek-ai/DeepEP synced 2025-05-02 11:11:17 +00:00
Code Issues Actions Packages Projects Releases Wiki Activity

Merge pull request #96 from songhexiang/adjust_kNumThreads_of_notify_dispatch

Browse Source 
Adjust kNumThreads of notify_dispatch
This commit is contained in:
Chenggang Zhao 2025-03-28 16:42:21 +08:00 committed by GitHub
commit dcf46f1c26
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
csrc/kernels/internode.cu
View File

@ -428,7 +428,7 @@ void notify_dispatch(const int* num_tokens_per_rank, int* moe_recv_counter_mappe
buffer_ptrs, task_fifo_ptrs, head, rank, \
cpu_rdma_team); } break
constexpr int kNumThreads = 256;
constexpr int kNumThreads = std::max(256, 32 * num_channels);
const auto num_rdma_ranks = num_ranks / NUM_MAX_NVL_PEERS;
// Get clean meta