IFAC-PapersOnLine · 2020 · 180 citations · 17 references
ComputingComputer ScienceSystems EngineeringArtificial IntelligenceMachine LearningSystems ModelingDeep LearningNeural NetworksState EstimationState-space ModelingState-space ModelsSystem IdentificationIdentification Of Dynamical SystemsNarx Model IdentificationNonlinear State EstimationNonlinear State-space ModelsNonlinear State-space SystemsNonlinear System IdentificationState Space EstimationState-space Identification
Deep learning is a topic of considerable interest today. Since it deals with estimating - or learning - models, there are connections to the area of System Identification developed in the Automatic Control community. Such connections are explored and exploited in this contribution. It is stressed that common deep nets such as feedforward and cascadeforward nets are nonlinear ARX (NARX) models, and can thus be easily incorporated in System Identification code and practice. The case of LSTM nets is an example of NonLinear State-Space (NLSS) models.
17
Sepp Hochreiter, Jürgen Schmidhuber · Neural Computation · 1997 · 98.1K citations
Efficient Estimation of Word Representations in Vector Space
Tomáš Mikolov, Kai Chen, Greg S. Corrado et al. · arXiv (Cornell University) · 2013 · 11.7K citations · Full text
Neural Networks and the Bias/Variance Dilemma
Stuart Geman, Elie Bienenstock, René Doursat · Neural Computation · 1992 · 3.6K citations