Pengcheng He

Multi-Task Deep Neural Networks for Natural Language Understanding

Xiaodong Liu, Pengcheng He, Weizhu Chen et al. · 2019 · 1K citations · Full text

DEBERTA: DECODING-ENHANCED BERT WITH DISENTANGLED ATTENTION

Pengcheng He, Xiaodong Liu, Jianfeng Gao et al. · International Conference on Learning Representations · 2021 · 922 citations

Llm Fine-tuning, Engineering, Machine Learning +18

DeBERTa: Decoding-enhanced BERT with Disentangled Attention

Pengcheng He, Xiaodong Liu, Jianfeng Gao et al. · arXiv (Cornell University) · 2020 · 419 citations · Full text

Llm Fine-tuning, Engineering, Machine Learning +20

DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding Sharing

Pengcheng He, Jianfeng Gao, Weizhu Chen · arXiv (Cornell University) · 2021 · 394 citations · Full text

Artificial Intelligence, Llm Fine-tuning, Engineering +23

Multi-Task Deep Neural Networks for Natural Language Understanding

Xiaodong Liu, Pengcheng He, Weizhu Chen et al. · arXiv (Cornell University) · 2019 · 220 citations · Full text

Llm Fine-tuning, Engineering, Machine Learning +18