Neural Information Processing Systems · 2004 · 27 citations · 11 references
Life SciencesNeuroscienceVision ScienceComputational NeuroscienceSensory NeuroscienceVisual NeuroscienceNeural CodingSensory CodingSensory System ModelingVisual NeurophysiologyVisual PhysiologyVisual SystemCoding RedundancyMulti-scale RepresentationRedundancy EncodingRedundancy ReductionRedundant ComputationRedundant EncodingSimple CellsSparse Coding
It has been suggested that the primary goal of the sensory system is to represent input in such a way as to reduce the high degree of redundancy. Given a noisy neural representation, however, solely reducing redundancy is not desirable, since redundancy is the only clue to reduce the effects of noise. Here we propose a model that best balances redundancy reduction and redundant representation. Like previous models, our model accounts for the localized and oriented structure of simple cells, but it also predicts a different organization for the population. With noisy, limited-capacity units, the optimal representation becomes an overcomplete, multi-scale representation, which, compared to previous models, is in closer agreement with physiological data. These results offer a new perspective on the expansion of the number of neurons from retina to V1 and provide a theoretical model of incorporating useful redundancy into efficient neural representations.
11
The “independent components” of natural scenes are edge filters
Anthony J. Bell, T. J. Sejnowski · Vision Research · 1997 · 2.3K citations
What Does the Retina Know about Natural Scenes?
Joseph J. Atick, Amanda Redlich · Neural Computation · 1992 · 748 citations