2022 · 29 citations · 38 references
Language StudiesComputer SciencePsychologyComputational LinguisticsPsycholinguisticsReading ComprehensionCognitive LoadCognitive ModelingLanguage ModelingLanguage ModelsReadingSyntactic ComplexityBiasesCognitive Neuroscience ModelingContextInformation ComplexityLanguage Processing ModelsNeural Language ModelsReading Behavior AnalysisSyntactic Comprehension
Language models (LMs) have been used in cognitive modeling as well as engineering studies—they compute information-theoretic complexity metrics that simulate humans' cognitive load during reading.This study highlights a limitation of modern neural LMs as the model of choice for this purpose: there is a discrepancy between their context access capacities and that of humans.Our results showed that constraining the LMs' context access improved their simulation of human reading behavior.We also showed that LM-human gaps in context access were associated with specific syntactic constructions; incorporating syntactic biases into LMs' context access might enhance their cognitive plausibility.
38
Sepp Hochreiter, Jürgen Schmidhuber · Neural Computation · 1997 · 98.1K citations
Fitting Linear Mixed-Effects Models Using <b>lme4</b>
Douglas M. Bates, Martin Mächler, Benjamin M. Bolker et al. · Journal of Statistical Software · 2015 · 85.6K citations · Full text
DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · 2023 · 76.3K citations · Full text
Three Factors in Language Design
Noam Chomsky · Linguistic Inquiry · 2005 · 2.6K citations
fairseq: A Fast, Extensible Toolkit for Sequence Modeling
Myle Ott, Sergey Edunov, Alexei Baevski et al. · 2019 · 2.5K citations · Full text