2019 · 237 citations · 38 references
ComputingComputer ScienceComputer VisionMachine LearningVisual AttentionDeep LearningGenerative ModelingScene UnderstandingBenchmark DatasetsFew-shot LearningSaliency MappingSimilarity LearningSimilarity-based LearningVisual Saliency
Learning new concepts from a few of samples is a standard challenge in computer vision. The main directions to improve the learning ability of few-shot training models include (i) a robust similarity learning and (ii) generating or hallucinating additional data from the limited existing samples. In this paper, we follow the latter direction and present a novel data hallucination model. Currently, most datapoint generators contain a specialized network (i.e., GAN) tasked with hallucinating new datapoints, thus requiring large numbers of annotated data for their training in the first place. In this paper, we propose a novel less-costly hallucination method for few-shot learning which utilizes saliency maps. To this end, we employ a saliency network to obtain the foregrounds and backgrounds of available image samples and feed the resulting maps into a two-stream network to hallucinate datapoints directly in the feature space from viable foreground-background combinations. To the best of our knowledge, we are the first to leverage saliency maps for such a task and we demonstrate their usefulness in hallucinating additional datapoints for few-shot learning. Our proposed network achieves the state of the art on publicly available datasets.
38
ImageNet Large Scale Visual Recognition Challenge
Olga Russakovsky, Jia Deng, Hao Su et al. · International Journal of Computer Vision · 2015 · 40.2K citations
Prototypical Networks for Few-shot Learning
Jake Snell, Kevin Swersky, Richard S. Zemel · arXiv (Cornell University) · 2017 · 5.2K citations · Full text
mixup: Beyond Empirical Risk Minimization
Hongyi Zhang, Moustapha Cissé, Yann Dauphin et al. · arXiv (Cornell University) · 2017 · 4.8K citations · Full text
Siamese Neural Networks for One-shot Image Recognition
Gregory Koch, Richard S. Zemel, Ruslan Salakhutdinov · 2015 · 3.3K citations