2018 · 355 citations · 44 references
ComputingComputer ScienceComputer VisionFeature EngineeringVisual AttentionAttention NetworksDeep LearningRepresentation LearningSpatial AttentionTemporal AttentionVideo AnalysisBody Part RepresentationMetricsPerson Re-identificationRegularizationSpatial Attention NetworksSpatiotemporal Feature ExtractionSpatiotemporal Feature LearningVideo Representation Learning
Video-based person re-identification matches video clips of people across non-overlapping cameras. Most existing methods tackle this problem by encoding each video frame in its entirety and computing an aggregate representation across all frames. In practice, people are often partially occluded, which can corrupt the extracted features. Instead, we propose a new spatiotemporal attention model that automatically discovers a diverse set of distinctive body parts. This allows useful information to be extracted from all frames without succumbing to occlusions and misalignments. The network learns multiple spatial attention models and employs a diversity regularization term to ensure multiple models do not discover the same body part. Features extracted from local image regions are organized by spatial attention model and are combined using temporal attention. As a result, the network learns latent representations of the face, torso and other body parts using the best available image patches from the entire video sequence. Extensive evaluations on three datasets show that our framework outperforms the state-of-the-art approaches by large margins on multiple metrics.
44
Deep Residual Learning for Image Recognition
Kaiming He, Xiangyu Zhang, Shaoqing Ren et al. · 2016 · 222.1K citations · Full text
Show, Attend and Tell: Neural Image Caption Generation with Visual Attention
Kelvin Xu, Jimmy Ba, Ryan Kiros et al. · arXiv (Cornell University) · 2015 · 7.5K citations · Full text
DeepReID: Deep Filter Pairing Neural Network for Person Re-identification
Person re-identification by Local Maximal Occurrence representation and metric learning
Shengcai Liao, Yang Hu, Xiangyu Zhu et al. · 2015 · 2.2K citations