Simiao Zuo

Fine-Tuning Pre-trained Language Model with Weak Supervision: A Contrastive-Regularized Self-Training Approach

Yue Yu, Simiao Zuo, Haoming Jiang et al. · 2021 · 93 citations · Full text

Computing, Linguistics, Computational Linguistics +13

Super Tickets in Pre-Trained Language Models: From Model Compression to Improving Generalization

Liang Chen, Simiao Zuo, Minshuo Chen et al. · 2021 · 40 citations · Full text

Computing, Computer Science, Computational Linguistics +12

Taming Sparsely Activated Transformer with Stochastic Experts

Simiao Zuo, Xiaodong Liu, Jian Jiao et al. · arXiv (Cornell University) · 2021 · 27 citations · Full text

Computing, Computer Science, Artificial Intelligence +11

MoEBERT: from BERT to Mixture-of-Experts via Importance-Guided Adaptation

Simiao Zuo, Qingru Zhang, Liang Chen et al. · Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · 2022 · 27 citations · Full text

Computing, Computer Science, Computational Linguistics +6

Transformer Hawkes Process

Simiao Zuo, Haoming Jiang, Zichong Li et al. · arXiv (Cornell University) · 2020 · 22 citations · Full text

Computing, Computer Science, Data Science +17