Concepedia

Sheng Shen

SS

Statistics

Publications

29

Citations

2.6K

H-Index

23

Active since

2018

Affiliations

University of California, Berkeley(Current)

University of Technology Sydney

Berkeley College

Booz Allen Hamilton (United States)

City University of Macau

Sheng Shen is an author at University of California, Berkeley specializing in computing, computer science, and natural language processing.

Publications per year

2018–2024

29

Publications

29

Multitask Prompted Training Enables Zero-Shot Task Generalization

Victor Sanh, Albert Webson, Colin Raffel et al. · arXiv (Cornell University) · 2021 · 561 citations · Full text

Computing, Computer Science, Computational Linguistics +14

Q-BERT: Hessian Based Ultra Low Precision Quantization of BERT

Sheng Shen, Zhen Dong, Jiayu Ye et al. · Proceedings of the AAAI Conference on Artificial Intelligence · 2020 · 422 citations · Full text

Computing, Computer Engineering, Computer Science +14

Crosslingual Generalization through Multitask Finetuning

Niklas Muennighoff, Thomas J. Wang, Lintang Sutawika et al. · 2023 · 338 citations · Full text

Computing, Computer Science, Computational Linguistics +16

ADAHESSIAN: An Adaptive Second Order Optimizer for Machine Learning

Zhewei Yao, Amir Gholami, Sheng Shen et al. · Proceedings of the AAAI Conference on Artificial Intelligence · 2021 · 183 citations · Full text

Computing, Computer Science, Artificial Intelligence +16

Train Big, Then Compress: Rethinking Model Size for Efficient Training and Inference of Transformers

Zhuohan Li, Eric Wallace, Sheng Shen et al. · International Conference on Machine Learning · 2020 · 111 citations

Computing, Computer Science, Electrical Engineering +11

1–5 of 29