2019 · 11 citations · 13 references
ComputingComputer ScienceLinguisticsComputational LinguisticsNatural Language ProcessingSyntaxError CorrectionGrammarLanguage ModelingLanguage ModelsSyntactic AnalysisCorrection Of Linguistic ErrorsGrammatical Error AnalysisGrammatical Error CorrectionLanguage Model IntegrationLanguage Model PretrainingSentence CorrectionSentence Error Correction
This paper describes our contribution to the low-resource track of the BEA 2019 shared task on Grammatical Error Correction (GEC). Our approach to GEC builds on the theory of the noisy channel by combining a channel model and language model. We generate confusion sets from the Wikipedia edit history and use the frequencies of edits to estimate the channel model. Additionally, we use two pretrained language models: 1) Google's BERT model, which we fine-tune for specific error types and 2) OpenAI's GPT-2 model, utilizing that it can operate with previous sentences as context. Furthermore, we search for the optimal combinations of corrections using beam search.
13
DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · 2023 · 76.3K citations · Full text
George A. Miller · Communications of the ACM · 1995 · 14.1K citations · Full text
The CoNLL-2014 Shared Task on Grammatical Error Correction
Hwee Tou Ng, Siew Mei Wu, Ted Briscoe et al. · 2014 · 587 citations · Full text
The BEA-2019 Shared Task on Grammatical Error Correction
Christopher Bryant, Mariano Felice, Øistein E. Andersen et al. · 2019 · 293 citations · Full text