Proceedings of the National Academy of Sciences · 2023 · 21 citations · 75 references
Dendritic BranchesSocial SciencesRepresentation LearningSensory RepresentationsNeurodynamicsCognitive NeuroscienceNeurocomputersCognitive ScienceCortical RemodelingNeuroinformaticsSensory ProcessingDeep LearningPredictive CodingSynaptic PlasticityDendritic ProcessingModulatory InputsComputational NeuroscienceNeuronal NetworkNeuroscienceBrain-like ComputingMedicine
While sensory representations in the brain depend on context, it remains unclear how such modulations are implemented at the biophysical level, and how processing layers further in the hierarchy can extract useful features for each possible contextual state. Here, we demonstrate that dendritic N-Methyl-D-Aspartate spikes can, within physiological constraints, implement contextual modulation of feedforward processing. Such neuron-specific modulations exploit prior knowledge, encoded in stable feedforward weights, to achieve transfer learning across contexts. In a network of biophysically realistic neuron models with context-independent feedforward weights, we show that modulatory inputs to dendritic branches can solve linearly nonseparable learning problems with a Hebbian, error-modulated learning rule. We also demonstrate that local prediction of whether representations originate either from different inputs, or from different contextual modulations of the same input, results in representation learning of hierarchical feedforward weights across processing layers that accommodate a multitude of contexts.
75
Learning representations by back-propagating errors
David E. Rumelhart, Geoffrey E. Hinton, Ronald J. Williams · Nature · 1986 · 29.7K citations
PyTorch: An Imperative Style, High-Performance Deep Learning Library
Adam Paszke, Sam Gross, Francisco Massa et al. · arXiv (Cornell University) · 2019 · 16.2K citations · Full text
Speed of processing in the human visual system
Simon J. Thorpe, Denis Fize, Catherine Marlot · Nature · 1996 · 3.5K citations