Neural Computation · 2008 · 28 citations · 28 references
Life SciencesComputer ScienceNeuroscienceComputational NeuroscienceMachine LearningSystems NeuroscienceNeural Circuit ModelingNeural ModelingNeural NetworksNeural System ModelingNeuronal DynamicsSpiking Neural NetworksGradient DescentIntegrate-and-fire Neuron ModelsNeural Network ModelingNeuron DynamicsPostsynaptic CurrentsSpiking Neural Network ModelsSpiking Neuron ModelsSteepest Descent
The main contribution of this letter is the derivation of a steepest gradient descent learning rule for a multilayer network of theta neurons, a one-dimensional nonlinear neuron model. Central to our model is the assumption that the intrinsic neuron dynamics are sufficient to achieve consistent time coding, with no need to involve the precise shape of postsynaptic currents; this assumption departs from other related models such as SpikeProp and Tempotron learning. Our results clearly show that it is possible to perform complex computations by applying supervised learning techniques to the spike times and time response properties of nonlinear integrate and fire neurons. Networks trained with our multilayer training rule are shown to have similar generalization abilities for spike latency pattern classification as Tempotron learning. The rule is also able to train networks to perform complex regression tasks that neither SpikeProp or Tempotron learning appears to be capable of.
28
Advances in neural information processing systems 7
Krzysztof J. Cios, Mark E. Shields · Neurocomputing · 1997 · 22.3K citations
Speed of processing in the human visual system
Simon J. Thorpe, Denis Fize, Catherine Marlot · Nature · 1996 · 3.5K citations
Natural Gradient Works Efficiently in Learning
Neural Computation · 1998 · 2.7K citations