GMLake: Efficient and Transparent GPU Memory Defragmentation for Large-scale DNN Training with Virtual Memory Stitching
Published in ASPLOS '24, 2024
GMLake introduces virtual memory stitching for efficient and transparent GPU memory defragmentation in large-scale DNN training.
Recommended citation: Cong Guo, Rui Zhang, Jiale Xu, Jingwen Leng, Zihan Liu, Ziyu Huang, Minyi Guo, Hao Wu, Shouren Zhao, Junping Zhao, and Ke Zhang. (2024). "GMLake: Efficient and Transparent GPU Memory Defragmentation for Large-scale DNN Training with Virtual Memory Stitching." ASPLOS '24.
Download Paper