mirror of
https://github.com/deepseek-ai/open-infra-index
synced 2025-04-10 15:55:41 +00:00
add day 4
This commit is contained in:
parent
92b859fe9f
commit
bf880385d0
@ -56,6 +56,15 @@ Introducing DeepGEMM - an FP8 GEMM library that supports both dense and MoE GEMM
|
||||
|
||||
🔗 GitHub: https://github.com/deepseek-ai/DeepGEMM
|
||||
|
||||
### Day 4 - Optimized Parallelism Strategies
|
||||
✅ DualPipe - a bidirectional pipeline parallelism algorithm for computation-communication overlap in V3/R1 training.
|
||||
🔗 https://github.com/deepseek-ai/DualPipe
|
||||
|
||||
✅ EPLB - an expert-parallel load balancer for V3/R1.
|
||||
🔗 https://github.com/deepseek-ai/eplb
|
||||
|
||||
📊 Analyze computation-communication overlap in V3/R1.
|
||||
🔗 https://github.com/deepseek-ai/profile-data
|
||||
|
||||
### Ongoing Releases...
|
||||
|
||||
|
Loading…
Reference in New Issue
Block a user