2011 · 102 citations · 26 references
ArtsVision ScienceComputer VisionReal-time RenderingVisual AttentionImage EnhancementImage FilteringConstraintsFilteringSaliency MappingVisual Saliency
Content-aware image retargeting has attracted a lot of interests recently. The key and most challenging issue for this task is how to balance the tradeoff between preserving the important contents and minimizing the visual distortions on the consistency of the image structure. In this paper we present a novel filtering-based technique to tackle this issue, called ”importance filtering”. Specifically, we first filter the image saliency guided by the image itself to achieve a structure-consistent importance map. We then use the pixel importance as the key constraint to compute the gradient map of pixel shifts from the original resolution to the target. Finally, we integrate the shift gradient across the image using a weighted filter to construct a smooth shift map and render the target image. The weight is again controlled by the pixel importance. The two filtering processes enforce to maintain the structural consistency and yet preserve the important contents in the target image. Furthermore, the simple nature of filter operations allows highly efficient implementation for real-time applications and easy extension to video retargeting, as the structural constraints from the original image naturally convey the temporal coherence between frames. The effectiveness and efficiency of our importance filtering algorithm are confirmed in extensive experiments.
26
Robust Real-Time Face Detection
Paul Viola, Michael Jones · International Journal of Computer Vision · 2004 · 14.2K citations
Seam carving for content-aware image resizing
Shai Avidan, Ariel Shamir · 2007 · 1.4K citations
Improved seam carving for video retargeting
Michael Rubinstein, Ariel Shamir, Shai Avidan · ACM Transactions on Graphics · 2008 · 745 citations
Optimized scale-and-stretch for image resizing
Yu-Shuen Wang, Chiew‐Lan Tai, Olga Sorkine et al. · ACM Transactions on Graphics · 2008 · 622 citations