Xiaonan Nie

Heterogeneity-Aware Distributed Machine Learning Training via Partial Reduce

Xupeng Miao, Xiaonan Nie, Yingxia Shao et al. · 2021 · 59 citations

Cluster Computing, Engineering, Machine Learning +18

HET

Xupeng Miao, Hailin Zhang, Yining Shi et al. · Proceedings of the VLDB Endowment · 2021 · 52 citations · Full text

Natural Language Processing, Model Training, Llm Fine-tuning +10

Galvatron

Xupeng Miao, Y X Wang, Youhe Jiang et al. · Proceedings of the VLDB Endowment · 2022 · 46 citations · Full text

Transformer Models, Engineering, Machine Learning +14

FlexMoE: Scaling Large-scale Sparse Pre-trained Model Training via Dynamic Device Placement

Xiaonan Nie, Xupeng Miao, Zilong Wang et al. · Proceedings of the ACM on Management of Data · 2023 · 32 citations · Full text

Artificial Intelligence, Engineering, Machine Learning +19

TSPLIT: Fine-grained GPU Memory Management for Efficient DNN Training via Tensor Splitting

Xiaonan Nie, Xupeng Miao, Zhi Yang et al. · 2022 IEEE 38th International Conference on Data Engineering (ICDE) · 2022 · 23 citations

Engineering, Machine Learning, Computer Architecture +17