2017 · 15 citations · 20 references
ComputingComputer ScienceSecond Language StudiesComputational LinguisticsLanguage AcquisitionNatural Language ProcessingLanguage ModelingLanguage ModelsMultilingual Natural Language ProcessingSecond Language AcquisitionSequence LabelingWord EmbeddingsAccuracyLanguage Model PretrainingNeural Language ModelsRecurrent Neural Language ModelsRecurrent Neural Network Language Models
Selecting appropriate words to compose a sentence is one common problem faced by non-native Chinese learners. In this paper, we propose (bidirectional) LSTM sequence labeling models and explore various features to detect word usage errors in Chinese sentences. By combining CWIN-DOW word embedding features and POS information, the best bidirectional LSTM model achieves accuracy 0.5138 and MRR 0.6789 on the HSK dataset. For 80.79% of the test data, the model ranks the groundtruth within the top two at position level.
20
Sepp Hochreiter, Jürgen Schmidhuber · Neural Computation · 1997 · 98.1K citations
Adam: A Method for Stochastic Optimization
Diederik P. Kingma, Jimmy Ba · UvA-DARE (University of Amsterdam) · 2014 · 84.8K citations · Full text
Efficient Estimation of Word Representations in Vector Space
Tomáš Mikolov, Kai Chen, Greg S. Corrado et al. · arXiv (Cornell University) · 2013 · 11.7K citations · Full text