Fine-tune BERT with Sparse Self-Attention Mechanism

Abstract

Baiyun Cui, Yingming Li, Ming Chen, Zhongfei Zhang. Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP). 2019.