2011 · 33 citations · 15 references
ComputingComputer ScienceComplex SystemsMachine LearningTime Series AnalysisDigital Signal ProcessingNeural NetworksPattern RecognitionEqualizationRecurrent Neural NetworksReservoir ComputingTraining
Echo state networks represent a promising alternative to the classical approaches involving recurrent neural networks, as they ally processing capability, due to the existence of feedback loops within the dynamical reservoir, with a simplified training process. However, the existing networks cannot fully explore the potential of the underlying structure, since the outputs are computed via linear combinations of the internal states. In this work, we propose a novel architecture for an echo state network that employs the Volterra filter structure in the output layer together with the Principal Component Analysis technique. This idea not only improves the processing capability of the network, but also preserves the simplicity of the training process. The proposed architecture has been analyzed in the context of the channel equalization problem, and the obtained results highlight the adequacy and the advantages of the novel network, which achieved a convincing performance, overcoming the other echo state networks, especially in the most challenging scenarios.
15
Steven C. Rogers · Control Engineering Practice · 1996 · 9.3K citations
Colin Goodall, Ian T. Jolliffe · Technometrics · 1988 · 8.7K citations
Backpropagation through time: what it does and how to do it
Paul J. Werbos · Proceedings of the IEEE · 1990 · 4.9K citations