mirror of
https://github.com/deepseek-ai/open-infra-index
synced 2025-04-24 00:05:50 +00:00
add day 4
This commit is contained in:
parent
92b859fe9f
commit
bf880385d0
@ -56,6 +56,15 @@ Introducing DeepGEMM - an FP8 GEMM library that supports both dense and MoE GEMM
|
|||||||
|
|
||||||
🔗 GitHub: https://github.com/deepseek-ai/DeepGEMM
|
🔗 GitHub: https://github.com/deepseek-ai/DeepGEMM
|
||||||
|
|
||||||
|
### Day 4 - Optimized Parallelism Strategies
|
||||||
|
✅ DualPipe - a bidirectional pipeline parallelism algorithm for computation-communication overlap in V3/R1 training.
|
||||||
|
🔗 https://github.com/deepseek-ai/DualPipe
|
||||||
|
|
||||||
|
✅ EPLB - an expert-parallel load balancer for V3/R1.
|
||||||
|
🔗 https://github.com/deepseek-ai/eplb
|
||||||
|
|
||||||
|
📊 Analyze computation-communication overlap in V3/R1.
|
||||||
|
🔗 https://github.com/deepseek-ai/profile-data
|
||||||
|
|
||||||
### Ongoing Releases...
|
### Ongoing Releases...
|
||||||
|
|
||||||
|
Loading…
Reference in New Issue
Block a user