IEEE Transactions on Big Data · 2017 · 22 citations · 57 references
ComputingComputer ScienceComputer VisionNatural Language ProcessingSocial Media AnalyticsEvent DetectionMultimodal CommunicationMultimodal InteractionVideo AnalysisMulti-modal ResponseMulti-sensor SurveillanceMultimodal Event DetectionMultimodal Information ExtractionSemantic InformationSpatial-temporal Data AnalysisSpatial-temporal ModelingVisual Feature Extraction
A public safety event is a danger and urgent event that need early detection, quick response, and accuracy recover. The efficient method for responding to a happening public safety event is to collect and describe the related data. Besides the surveillance cameras from the physical space, the social media data can also be used to collect and describe the related data of a public safety event. In this work, the proposed method focuses on the step for describing public safety events. Given a public safety event, videos from the surveillance cameras and social messages from social sensors are collected. The multi-modal information including texts, images, videos, and spatial-temporal data is mined to give a description precisely and concisely. First, the social sensors are associated to surveillance cameras by the spatial and temporal information. In the second stage, the social messages are associated to surveillance cameras by the semantic information. In the third stage, the social messages are associated to surveillance cameras by the visual feature. Besides the text, social sensors may upload images or videos. Finally, the multi-modal description step is given based on the three different associations. The experiments on the real data demonstrate the superiority of the proposed framework. Case studies on the real public safety event show the proposed model has good performance and high effectiveness.
57
ImageNet: A large-scale hierarchical image database
Jia Deng, Wei Dong, Richard Socher et al. · 2009 IEEE Conference on Computer Vision and Pattern Recognition · 2009 · 61.8K citations
Earthquake shakes Twitter users
Takeshi Sakaki, Makoto Okazaki, Yutaka Matsuo · 2010 · 3.7K citations
Natural Sciences, Data Science, Natural Language Processing +14
Microblogging during two natural hazards events
Sarah Vieweg, Amanda Hughes, Kate Starbird et al. · 2010 · 1.4K citations