arXiv (Cornell University) · 2017 · 32 citations · 25 references
ComputingComputer ScienceComputer VisionMachine LearningMachine VisionDeep LearningFeature DetectionObject DetectionObject RecognitionRepresentation LearningBinary CodesCompact Binary SystemsDeep Image FeaturesHashingInstance GenerationInstance RetrievalRegion Proposal NetworksRegion-based Features
Instance Search (INS) is a fundamental problem for many applications, while it is more challenging comparing to traditional image search since the relevancy is defined at the instance level. Existing works have demonstrated the success of many complex ensemble systems that are typically conducted by firstly generating object proposals, and then extracting handcrafted and/or CNN features of each proposal for matching. However, object bounding box proposals and feature extraction are often conducted in two separated steps, thus the effectiveness of these methods collapses. Also, due to the large amount of generated proposals, matching speed becomes the bottleneck that limits its application to large-scale datasets. To tackle these issues, in this paper we propose an effective and efficient Deep Region Hashing (DRH) approach for large-scale INS using an image patch as the query. Specifically, DRH is an end-to-end deep neural network which consists of object proposal, feature extraction, and hash code generation. DRH shares full-image convolutional feature map with the region proposal network, thus enabling nearly cost-free region proposals. Also, each high-dimensional, real-valued region features are mapped onto a low-dimensional, compact binary codes for the efficient object region level matching on large-scale dataset. Experimental results on four datasets show that our DRH can achieve even better performance than the state-of-the-arts in terms of MAP, while the efficiency is improved by nearly 100 times.
25
Selective Search for Object Recognition
Jasper Uijlings, Koen E. A. van de Sande, Theo Gevers et al. · International Journal of Computer Vision · 2013 · 6.1K citations · Full text
Object retrieval with large vocabularies and fast spatial matching
James Philbin, Ondřej Chum, Michael Isard et al. · 2007 · 3K citations
Aggregating local descriptors into a compact image representation
Hervé Jeǵou, Matthijs Douze, Cordelia Schmid et al. · 2010 · 2.8K citations · Full text
Lost in quantization: Improving particular object retrieval in large scale image databases
James Philbin, Ondřej Chum, Michael Isard et al. · 2008 · 1.5K citations
Visual Tracking with Fully Convolutional Networks
Lijun Wang, Wanli Ouyang, Xiaogang Wang et al. · 2015 · 1K citations