2017 · 11 citations · 19 references
ComputingComputer ScienceComputational LinguisticsNatural Language ProcessingReading ComprehensionLanguage ModelsNatural Language UnderstandingReadingSemantic NetworksSyntactic ProcessingText ComprehensionEmergent StructureHidden State InferenceHidden-state ModelsInferential ProcessingNeural Language ModelsPredication
A significant number of neural architectures for reading comprehension have recently been developed and evaluated on large cloze-style datasets. We present experiments supporting the emergence of "predication structure" in the hidden state vectors of these readers. More specifically, we provide evidence that the hidden state vectors represent atomic formulas [c] where is a semantic property (predicate) and c is a constant symbol entity identifier.
19
Adam: A Method for Stochastic Optimization
Diederik P. Kingma, Jimmy Ba · UvA-DARE (University of Amsterdam) · 2014 · 84.8K citations · Full text
SQuAD: 100,000+ Questions for Machine Comprehension of Text
Pranav Rajpurkar, Jian Zhang, Konstantin Lopyrev et al. · 2016 · 6.3K citations · Full text