Rethinking Memory and Communication Costs for Efficient Data Parallel Training of Large Language Models - Zhang, Hanxiao; Ju, Lin; Wu, Chan; Huang, Jinjing; Xiao, Youshao; Zhou, Zhenglei; Fan, Zhiming; Huan, Zhaoxin; Li, Siyuan; Meng, Fanzhuang; Liang, Lei; Zhang, Xiaolu; et al. (Advances in Neural Information Processing Systems, 2024)