Proceedings of the tenth ACM international conference on Multimedia - MULTIMEDIA '02 · 2002 · 41 citations · 0 references
ComputingComputer ScienceComputer VisionNatural Language ProcessingVisual AttentionData SummarizationLanguage ModelingText SummarizationVideo AnalysisAttentionAttention MechanismsComputational Models Of AttentionSummarizationVideo Content AnalysisVideo SummarizationVisual Summarization
Automatic video summarization is a key technique for video management and browsing. This paper proposes a generic video summarization framework that models viewer attention. The framework relies on computational audio‑visual attention models, avoiding full semantic analysis and complex heuristic rules. Experiments show that this attention‑based approach effectively substitutes semantic analysis for video summarization.
Automatic generation of video summarization is one of the key techniques in video management and browsing. In this paper, we present a generic framework of video summarization based on the modeling of viewer's attention. Without fully semantic understanding of video content, this framework takes advantage of understanding of video content, this framework takes advantage of computational attention models and eliminates the needs of complex heuristic rules in video summarization. A set of methods of audio-visual attention model features are proposed and presented. The experimental evaluations indicate that the computational attention based approach is an effective alternative to video semantic analysis for video summarization.