2021 · 11 citations · 25 references
ComputingComputer ScienceComputer VisionMachine LearningTime Series AnalysisAnomaly DetectionDeep LearningDigital SurveillanceOutlier DetectionTrajectory AnalysisVideo AnalysisAnomaly Detection In TrajectoriesAnomaly-based DetectionData EvaluationDeep Learning-based Anomaly DetectionSpatial Anomaly DetectionSpatiotemporal Outlier DetectionTemporal Late FusionVideo Anomaly Detection
State-of-the-Art (SoTA) deep learning-based approaches to detect anomalies in surveillance videos utilize limited temporal information, including basic information from motion, e.g., optical flow computed between consecutive frames. In this paper, we compliment the SoTA methods by including long-range dependencies from trajectories for anomaly detection. To achieve that, we first created trajectories by running a tracker on two SoTA datasets, namely Avenue and Shanghai-Tech. We propose a prediction-based anomaly detection method using trajectories based on Social GANs, also called in this paper as temporal-based anomaly detection. Then, we hypothesize that late fusion of the result of this temporal-based anomaly detection system with spatial-based anomaly detection systems produces SoTA results. We verify this hypothesis on two spatial-based anomaly detection systems. We show that both cases produce results better than baseline spatial-based systems, indicating the usefulness of the temporal information coming from the trajectories for anomaly detection. We observe that the proposed approach depicts the maximum improvement in micro-level Area-Under-the-Curve (AUC) by 4.1% on CUHK Avenue and 3.4% on Shanghai-Tech over one of the baseline method. We also show a high performance on cross-data evaluation, where we learn the weights to combine spatial and temporal information on Shanghai-Tech and perform evaluation on CUHK Avenue and vice-versa.
25
An introduction to ROC analysis
Tom Fawcett · Pattern Recognition Letters · 2005 · 21.3K citations
Social LSTM: Human Trajectory Prediction in Crowded Spaces
Alexandre Alahi, Kratarth Goel, Vignesh Ramanathan et al. · 2016 · 3.5K citations · Full text
Future Frame Prediction for Anomaly Detection - A New Baseline
Wen Liu, Weixin Luo, Dongze Lian et al. · 2018 · 1.4K citations
Abnormal Event Detection at 150 FPS in MATLAB
Cewu Lu, Jianping Shi, Jiaya Jia · 2013 · 1.4K citations