mirror of
https://github.com/deepseek-ai/DualPipe
synced 2025-04-06 05:24:58 +00:00
fix the front of readme
This commit is contained in:
parent
dbb267dd85
commit
51d7f92a69
@ -15,7 +15,7 @@ have mutually overlapped computation and communication
|
||||
|
||||
| Method | Bubble | Parameter | Activation |
|
||||
|-------------|---------------------------------|-----------|------------|
|
||||
| 1F1B | (PP-1)(𝐹+B) | 1× | PP |
|
||||
| 1F1B | (PP-1)(𝐹+𝐵) | 1× | PP |
|
||||
| ZB1P | (PP-1)(𝐹+𝐵-2𝑊) | 1× | PP |
|
||||
| DualPipe | (PP/2-1)(𝐹&𝐵+𝐵-3𝑊) | 2× | PP+1 |
|
||||
|
||||
|
Loading…
Reference in New Issue
Block a user