2021 IEEE/CVF International Conference on Computer Vision (ICCV) · 2021 · 116 citations · 36 references
ComputingComputer ScienceComputer VisionSensor FusionVisual AttentionFeature-based AttentionFeature-level FusionImage FusionScene UnderstandingVisual TrackingAttention-based FusionDynamic RangePrecisionSingle-object TrackingVisual Motion CuesVisual Object Tracking
Inspired by the complementarity between conventional frame-based and bio-inspired event-based cameras, we propose a multi-modal based approach to fuse visual cues from the frame- and event-domain to enhance the single object tracking performance, especially in degraded conditions (e.g., scenes with high dynamic range, low light, and fast-motion objects). The proposed approach can effectively and adaptively combine meaningful information from both domains. Our approach’s effectiveness is enforced by a novel designed cross-domain attention schemes, which can effectively enhance features based on self- and cross-domain attention schemes; The adaptiveness is guarded by a specially designed weighting scheme, which can adaptively balance the contribution of the two domains. To exploit event-based visual cues in single-object tracking, we construct a large-scale frame-event-based dataset, which we subsequently employ to train a novel frame-event fusion based model. Extensive experiments show that the proposed approach outperforms state-of-the-art frame-based tracking methods by at least 10.4% and 11.9% in terms of representative success rate and precision rate, respectively. Besides, the effectiveness of each key component of our approach is evidenced by our thorough ablation study.
36
Deep Residual Learning for Image Recognition
Kaiming He, Xiangyu Zhang, Shaoqing Ren et al. · 2016 · 222.1K citations · Full text
High Performance Visual Tracking with Siamese Region Proposal Network
Bo Li, Junjie Yan, Wei Wu et al. · 2018 · 3K citations
Learning Multi-domain Convolutional Neural Networks for Visual Tracking
Hyeonseob Nam, Bohyung Han · 2016 · 2.8K citations
ECO: Efficient Convolution Operators for Tracking
Martin Danelljan, Goutam Bhat, Fahad Shahbaz Khan et al. · 2017 · 2.8K citations · Full text
Deeper and Wider Siamese Networks for Real-Time Visual Tracking
Zhipeng Zhang, Houwen Peng · 2019 · 1.1K citations