Semantic video content abstraction based on multiple cues

Abstract

This research addresses the problem of automatically extracting video’s semantic structure and summarizing it in a hierarchical manner. Multiple media cues are employed in this procedure including visual, audio and text information. The generated hierarchy can provide us a compact yet meaningful abstraction of the video data similar to the conventional table-of-contents, which will facilitate user’s access to multimedia contents including browsing and retrieval. Preliminary experiments of integrating different media for hierarchically representing video semantics have yielded encouraging results.