Cognitive Science · 2002 · 318 citations · 53 references
Language StudiesComputer ScienceLinguisticsComputational LinguisticsNatural Language ProcessingPsycholinguisticsGrammarLanguage ModelingSentence ProcessingSentence ProductionSentence StructureSyntactic ProcessingGrammatical EncodingSentence ModelingSentence Production ModelsSyntactic Processing In ProductionSyntactic Structures
Abstract The ability to combine words into novel sentences has been used to argue that humans have symbolic language production abilities. Critiques of connectionist models of language often center on the inability of these models to generalize symbolically (Fodor & Pylyshyn, 1988; Marcus, 1998). To address these issues, a connectionist model of sentence production was developed. The model had variables (role‐concept bindings) that were inspired by spatial representations (Landau & Jackendoff, 1993). In order to take advantage of these variables, a novel dual‐pathway architecture with event semantics is proposed and shown to be better at symbolic generalization than several variants. This architecture has one pathway for mapping message content to words and a separate pathway that enforces sequencing constraints. Analysis of the model's hidden units demonstrated that the model learned different types of information in each pathway, and that the model's compositional behavior arose from the combination of these two pathways. The model's ability to balance symbolic and statistical behavior in syntax acquisition and to model aphasic double dissociations provided independent support for the dual‐pathway architecture.
53
Learning representations by back-propagating errors
David E. Rumelhart, Geoffrey E. Hinton, Ronald J. Williams · Nature · 1986 · 30.9K citations
Jeffrey L. Elman · Cognitive Science · 1990 · 10.8K citations
Introduction to the theory of neural computation
Neural Networks · 1994 · 6.5K citations
Foundations of Cognitive Grammar
Margaret E. Winters, Ronald W. Langacker · Modern Language Journal · 1988 · 5.7K citations
Connectionism and cognitive architecture: A critical analysis
Jerry A. Fodor, Zenon W. Pylyshyn · Cognition · 1988 · 4K citations