Expert Systems with Applications · 2023 · 71 citations · 69 references
ComputingComputer ScienceComputer VisionEdge ComputingMachine LearningAction RecognitionDeep LearningEdge ArchitectureEdge Artificial IntelligenceEdge Computing InfrastructureObject DetectionAction DetectionActivity RecognitionEdge Machine LearningLong Short-term Memory NetworksReal-time SurveillanceReal-world ApplicationSegmentationSurveillance Systems
Nowadays, video surveillance systems are commonly found in most public and private spaces. These systems typically consist of a network of cameras that feed into a central node. However, the processing aspect is evolving toward distributed approaches, leveraging edge-computing. These distributed systems are capable of effectively addressing the detection of people or events at each individual node. Most of these systems, rely on the use of deep-learning and segmentation algorithms which enable them to achieve high performance, but usually with a significant computational cost, hindering real-time execution. This paper presents an approach for people detection and action recognition in the wild, optimized for running on the edge, and that is able to work in real-time, in an embedded platform. Human Action Recognition (HAR) is performed by using a Recurrent Neural Network (RNN), specifically a Long Short-Term Memory (LSTM). The input to the LSTM is an ad-hoc, lightweight feature vector obtained from the bounding box of each detected person in the video surveillance image. The resulting system is highly portable and easily scalable, providing a powerful tool for real-world video surveillance applications (in the wild and real-time action recognition). The proposal has been exhaustively evaluated and compared against other state-of-the-art (SOTA) proposals in five datasets, including four widely used (KTH, WEIZMAN, WVU, IXMAX) and a novel one (GBA) recorded in the wild, that includes several people performing different actions simultaneously. The obtained results validate the proposal, since it achieves SOTA accuracy within a much more complicated video surveillance real scenario, and using a lightweight embedded hardware.
69
The Kinetics Human Action Video Dataset
Will Kay, João Carreira, Karen Simonyan et al. · arXiv (Cornell University) · 2017 · 2.9K citations · Full text