2020 · 478 citations · 27 references
ComputingComputer ScienceComputer VisionMachine LearningVisual AttentionDeep LearningPattern RecognitionRepresentation LearningScene UnderstandingInpainting
Existing inpainting methods have achieved promising performance for recovering regular or small image defects. However, filling in large continuous holes remains difficult due to the lack of constraints for the hole center. In this paper, we devise a Recurrent Feature Reasoning (RFR) network which is mainly constructed by a plug-and-play Recurrent Feature Reasoning module and a Knowledge Consistent Attention (KCA) module. Analogous to how humans solve puzzles (i.e., first solve the easier parts and then use the results as additional information to solve difficult parts), the RFR module recurrently infers the hole boundaries of the convolutional feature maps and then uses them as clues for further inference. The module progressively strengthens the constraints for the hole center and the results become explicit. To capture information from distant places in the feature map for RFR, we further develop KCA and incorporate it in RFR. Empirically, we first compare the proposed RFR-Net with existing backbones, demonstrating that RFR-Net is more efficient (e.g., a 4% SSIM improvement for the same model size). We then place the network in the context of the current state-of-the-art, where it exhibits improved performance. The corresponding source code is available at: https://github.com/jingyuanli001/RFR-Inpainting.
27
Conditional Generative Adversarial Nets
Mehdi Mirza, Simon Osindero · arXiv (Cornell University) · 2014 · 8.9K citations · Full text
Deep Learning Face Attributes in the Wild
Ziwei Liu, Ping Luo, Xiaogang Wang et al. · 2015 · 7.7K citations