IA-SSLM: Irregularity-Aware Semi-Supervised Deep Learning Model for Analyzing Unusual Events in Crowds

Abstract

Analyzing unusual events is significantly important for video surveillance to ensure people safety. These events are characterized by irregular patterns that do not conform to the expected behavior in the surveillance scenes. We present a novel irregularity-aware semi-supervised deep learning model (IA-SSLM) for detection of unusual events. While most existing works depend on the availability of large amount of labeled data for training, our proposed method utilizes a semi-supervised deep model to automatically learn feature representations from limited number of labeled data samples. Our method extracts meaningful information from both labeled and unlabeled data during the training stage to improve the performance. For this purpose, we explore the concept of consistency regularization and entropy minimization to output confident predictions on unlabeled data. For experimental analysis, we consider various standard and diverse datasets. The results show that our IA-SSLM method outperforms several reference methods using different performance metrics.