Sheng Shen

Multitask Prompted Training Enables Zero-Shot Task Generalization

Victor Sanh, Albert Webson, Colin Raffel et al. · arXiv (Cornell University) · 2021 · 560 citations · Full text

Artificial Intelligence, Few-shot Learning, Llm Fine-tuning +20

Q-BERT: Hessian Based Ultra Low Precision Quantization of BERT

Sheng Shen, Zhen Dong, Jiayu Ye et al. · Proceedings of the AAAI Conference on Artificial Intelligence · 2020 · 408 citations · Full text

Natural Language Processing, Bert Downstream Tasks, Large Ai Model +12

Crosslingual Generalization through Multitask Finetuning

Niklas Muennighoff, Thomas J. Wang, Lintang Sutawika et al. · 2023 · 303 citations · Full text

Engineering, Cross-lingual Representation, Crosslingual Generalization +19

ADAHESSIAN: An Adaptive Second Order Optimizer for Machine Learning

Zhewei Yao, Amir Gholami, Sheng Shen et al. · Proceedings of the AAAI Conference on Artificial Intelligence · 2021 · 173 citations · Full text

Artificial Intelligence, Model Optimization, Approximate Curvature Information +13

Train Big, Then Compress: Rethinking Model Size for Efficient Training and Inference of Transformers

Zhuohan Li, Eric Wallace, Sheng Shen et al. · International Conference on Machine Learning · 2020 · 111 citations

Artificial Intelligence, Large Ai Model, Model Size +11