Frontiers in Neuroscience · 2015 · 40 citations · 17 references
Life SciencesComputer ScienceNeuroscienceComputer VisionVisual NeuroscienceVisual PerceptionDeep LearningDigital Image ProcessingImage ProcessingSpiking Neural NetworksVisual SystemBenchmark DatasetsNeuromorphic DevicesNeuromorphic HardwareSpike-based Signal ProcessingVisual Signal Processing
Neuromorphic Vision sensors have improved greatly since the first silicon retina was presented almost three decades ago. They have recently matured to the point where they are commercially available and can be operated by laymen. However, despite improved availability of sensors, there remains a lack of good datasets, while algorithms for processing spike-based visual data are still in their infancy. On the other hand, frame-based computer vision algorithms are far more mature, thanks in part to widely accepted datasets which allow direct comparison between algorithms and encourage competition. We are presented with a unique opportunity to shape the development of Neuromorphic Vision benchmarks and challenges by leveraging what has been learnt from the use of datasets in frame-based computer vision. Taking advantage of this opportunity, in this paper we review the role that benchmarks and challenges have played in the advancement of frame-based computer vision, and suggest guidelines for the creation of Neuromorphic Vision benchmarks and challenges. We also discuss the unique challenges faced when benchmarking Neuromorphic Vision algorithms, particularly when attempting to provide direct comparison with frame-based computer vision.
17
ImageNet: A large-scale hierarchical image database
Jia Deng, Wei Dong, Richard Socher et al. · 2009 IEEE Conference on Computer Vision and Pattern Recognition · 2009 · 61.8K citations
George A. Miller · Communications of the ACM · 1995 · 14.1K citations · Full text
The Pascal Visual Object Classes Challenge: A Retrospective
Mark Everingham, S. M. Ali Eslami, Luc Van Gool et al. · International Journal of Computer Vision · 2014 · 7.3K citations · Full text
LabelMe: A Database and Web-Based Tool for Image Annotation
Bryan Russell, Antonio Torralba, Kevin Murphy et al. · International Journal of Computer Vision · 2007 · 4.2K citations · Full text