Xiaodong Liu

Domain-Specific Language Model Pretraining for Biomedical Natural Language Processing

Robert Tinn, Hao Cheng, Michael Lucas et al. · ACM Transactions on Computing for Healthcare · 2021 · 2K citations · Full text

Computing, Computer Science, Biomedical Text Mining +12

Multi-Task Deep Neural Networks for Natural Language Understanding

Xiaodong Liu, Pengcheng He, Weizhu Chen et al. · 2019 · 1.1K citations · Full text

Computing, Computer Science, Computational Linguistics +15

DEBERTA: DECODING-ENHANCED BERT WITH DISENTANGLED ATTENTION

Pengcheng He, Xiaodong Liu, Jianfeng Gao et al. · International Conference on Learning Representations · 2021 · 922 citations

Computing, Computer Science, Artificial Intelligence +13

On the Variance of the Adaptive Learning Rate and Beyond

Liyuan Liu, Haoming Jiang, Pengcheng He et al. · arXiv (Cornell University) · 2019 · 608 citations · Full text

Computing, Computer Science, Algorithms +16

DeBERTa: Decoding-enhanced BERT with Disentangled Attention

Pengcheng He, Xiaodong Liu, Jianfeng Gao et al. · arXiv (Cornell University) · 2020 · 430 citations · Full text

Computing, Computer Science, Artificial Intelligence +13