2009 IEEE Conference on Computer Vision and Pattern Recognition · 2009 · 84 citations · 22 references
ComputingComputer ScienceCollective BehaviorComputer VisionSensor FusionCommunity DetectionCommunity StructureDigital SurveillanceFace RecognitionSocial Network AnalysisSocial Network MiningCamera SystemsCamera TrackingCommunity Pattern DiscoveryMulti-camera TrackingMulti-camera VisionNetwork Community DetectionRobust EstimationSocial Network Monitoring
This work addresses the important problem of the discovery and analysis of social networks from surveillance video. A computer vision approach to this problem is made possible by the proliferation of video data obtained from camera networks, particularly state-of-the-art Pan-Tilt-Zoom (PTZ) and tracking camera systems that have the capability to acquire high-resolution face images as well as tracks of people under challenging conditions. We perform “opportunistic” face recognition on captured images and compute motion similarities between tracks of people on the ground plane. To deal with the unknown correspondences between faces and tracks, we present a novel graph-cut based algorithm to solve this association problem. It enables the robust estimation of a social network that captures the interactions between individuals in spite of large amounts of noise in the datasets. We also introduce an algorithm that we call “modularity-cut”, which is an Eigen-analysis based approach for discovering community and leadership structure in the estimated social network. Our approach is illustrated with promising results from a fully integrated multi-camera system under challenging conditions over long period of time.
22
Finding and evaluating community structure in networks
Michelle G. Newman, Michelle Girvan · Physical Review E · 2004 · 14.1K citations · Full text
A tutorial on spectral clustering
Ulrike von Luxburg · Statistics and Computing · 2007 · 10.3K citations · Full text
On Spectral Clustering: Analysis and an algorithm
Andrew Y. Ng, Michael I. Jordan, Yair Weiss · 2001 · 7.8K citations