Make the Parallel Truly Parallel: Interleaving Parallel ZeRO-DP for RLHF Training with ZeroFuse

Publication
IEEE Transactions on Computers ( Early Access )
Wenhao Huang
Wenhao Huang
Ph.D (2023)
Laiping Zhao
Laiping Zhao
Professor(英才教授、博士生导师)
Yiming Li
Yiming Li
Ph.D (2020)
Yichi Chen
Yichi Chen
Ph.D (2026)
Yanjie Wang
Yanjie Wang
Master (2024)
Fupeng Li
Fupeng Li
Master (2025)
Yihan Wang
Yihan Wang
Master (2026)