Event detection from continuous media

Abstract

It is difficult to extract semantical contents like events that occurred in the real world from continuous media consisting of visual, auditory, and linguistic information, because machines' ability of understanding media is still incomplete. To avoid this, we propose a strategy of collaborating multimodal information processing for continuous media, called intermodal collaboration and making full use of domain knowledge. The basic experimental results about event detection indicate that our strategy is effective.