IEEE Transactions on Consumer Electronics · 2022 · 73 citations · 34 references
ComputingComputer ScienceArtificial IntelligenceComputer VisionMachine LearningDeep LearningNeural NetworksObject DetectionPattern RecognitionScene UnderstandingConvolutional Neural Network DetectionConvolutional Neural NetworksCrowd CountingCrowd Scene Analysis
Crowd counting has important applications in the environments of smart cities, such as intelligent surveillance. In this paper, we propose a novel convolutional neural network (CNN) framework for crowd counting with mixed ground-truth, called top- <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <tex-math notation="LaTeX">$k$ </tex-math></inline-formula> relation-based network (TKRNet). Specifically, the estimated density maps generated in a coarse-to-fine manner are treated as coarse locations for crowds so as to assist our TKRNet to regress the scattered point-annotated ground truth. Moreover, an adaptive top- <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <tex-math notation="LaTeX">$k$ </tex-math></inline-formula> relation module (ATRM) is proposed to enhance feature representations by leveraging the top- <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <tex-math notation="LaTeX">$k$ </tex-math></inline-formula> dependencies between the pixels with an adaptive filtering mechanism. Specifically, we first compute the similarity between two pixels so as to select the top- <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <tex-math notation="LaTeX">$k$ </tex-math></inline-formula> relations for each position. Then, a weight normalization operation with an adaptive filtering mechanism is proposed to make the ATRM adaptively eliminate the influence from the low correlation positions in the top- <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <tex-math notation="LaTeX">$k$ </tex-math></inline-formula> relations. Finally, a weight attention mechanism is introduced to make the ATRM pay more attention to the positions with high weights in the top- <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <tex-math notation="LaTeX">$k$ </tex-math></inline-formula> relations. Extensive experimental results demonstrate the effectiveness of our proposed TKRNet on several public datasets in comparison to state-of-the-art methods.
34
Single-Image Crowd Counting via Multi-Column Convolutional Neural Network
Yingying Zhang, Desen Zhou, Siqin Chen et al. · 2016 · 2.3K citations
Cross-scene crowd counting via deep convolutional neural networks
Cong Zhang, Hongsheng Li, Xiaogang Wang et al. · 2015 · 1.2K citations
Weizhe Liu, Mathieu Salzmann, Pascal Fua · 2019 · 745 citations · Full text