11 Commits

Author	SHA1	Message	Date
Shangyan Zhou	e255d57bef	Use put_nbi_warp.	2025-04-22 12:29:46 +08:00
Chenggang Zhao	edbb1bc3ff	Several code lints	2025-04-22 10:52:10 +08:00
Shangyan Zhou	20b2aaaf9e	Refactor some code.	2025-04-22 10:22:30 +08:00
Shangyan Zhou	e2c578485c	Revert ibgda_device.cuh and remove some comments.	2025-04-21 17:44:32 +08:00
moningchen	5ab80c28f3	In the Internode Normal Kernel, when using nvshmem ibrc for RDMA data transmission, a single QP is used for data transfer between two GPUs, which limits kernel performance in network card dual-port and RoCE network scenarios. ... In our optimized Internode Normal Kernel, we implemented multiple QPs for data transmission between two GPUs, setting a different QP for each channel. Additionally, we modified the transmission method from IBRC to IBGAD. Through these optimizations, the Internode Normal Kernel achieves optimal performance in both H800 and H20 environments, with RDMA transmission performance nearly reaching the physical network performance limit. Using the current default statistical method, in 4-node H800 and H20 environments, RDMA performance can reach 60GB/s+.	2025-04-21 15:50:39 +08:00
Chenggang Zhao	c4d12b4f8f	Fix compilation	2025-03-28 16:45:10 +08:00
songhexiang	4dd1e68ac8	For the SMs which calculate metadata in notify_dispatch, each warp in the SM is used to calculate the metadata of one channel. The default configuration is 8 warps for 10 channels, which needs two rounds of loop. Maybe the number of warps can be configured to the number of the channels so that one loop is enough.	2025-03-28 06:43:29 +00:00
Chenggang Zhao	1fc40d50f3	Improve AR performance	2025-03-06 21:41:19 +08:00
Chenggang Zhao	458cdcb22a	Fix AR bugs for normal kernels	2025-03-05 17:13:35 +08:00
Chenggang Zhao	680e424bdc	Bugs fixed	2025-03-05 14:27:45 +08:00
Chenggang Zhao	ebfe47e46f	Initial commit	2025-02-25 09:07:53 +08:00