bioRxiv (Cold Spring Harbor Laboratory) · 2021 · 37 citations · 98 references
Life SciencesComputer ScienceNeuroscienceCognitive NeuroscienceComputational NeuroscienceComputer VisionBrain ImagingDeep LearningFunctional NeuroimagingNeural Data AnalysisNeural NetworksVisual SystemBrain Function MappingComputational Neuroscience ModelsLarge-scale Brain Network ModelsNeural Representation LearningVentral Visual StreamVisual Pathway Organization
Abstract Extensive sampling of neural activity during rich cognitive phenomena is critical for robust understanding of brain function. We present the Natural Scenes Dataset (NSD), in which high-resolution fMRI responses to tens of thousands of richly annotated natural scenes are measured while participants perform a continuous recognition task. To optimize data quality, we develop and apply novel estimation and denoising techniques. Simple visual inspections of the NSD data reveal clear representational transformations along the ventral visual pathway. Further exemplifying the inferential power of the dataset, we use NSD to build and train deep neural network models that predict brain activity more accurately than state-of-the-art models from computer vision. NSD also includes substantial resting-state and diffusion data, enabling network neuroscience perspectives to constrain and enhance models of perception and memory. Given its unprecedented scale, quality, and breadth, NSD opens new avenues of inquiry in cognitive and computational neuroscience.
98
Adam: A Method for Stochastic Optimization
Diederik P. Kingma, Jimmy Ba · UvA-DARE (University of Amsterdam) · 2014 · 84.8K citations · Full text
ImageNet: A large-scale hierarchical image database
Jia Deng, Wei Dong, Richard Socher et al. · 2009 IEEE Conference on Computer Vision and Pattern Recognition · 2009 · 61.8K citations
Laurens van der Maaten, Geoffrey E. Hinton · Journal of Machine Learning Research · 2008 · 35.7K citations
David H. Brainard · Spatial Vision · 1997 · 20.1K citations