2018 · 300 citations · 40 references
ComputingComputer ScienceComputer VisionMachine VisionRobot VisionImage SegmentationObject RecognitionVideo AnalysisVisual TrackingBenchmark Dataset EvaluationObject Mask GenerationObject Part SegmentationObject SegmentationSegmentationSimilarity ScoringSimilarity Scoring FunctionsVideo Segmentation
Online video object segmentation requires real‑time, accurate processing, yet most CNN approaches rely on time‑consuming fine‑tuning of the first‑frame mask. This work introduces a fast, accurate algorithm that begins segmenting immediately upon receiving video frames. The method tracks object parts to handle deformation, occlusion, and clutter, feeds the tracked boxes into a region‑of‑interest segmentation network to produce part masks, and refines them with a similarity‑based scoring function against the first‑frame visual cues. On the DAVIS benchmark, the approach outperforms state‑of‑the‑art methods while achieving substantially faster runtimes.
Online video object segmentation is a challenging task as it entails to process the image sequence timely and accurately. To segment a target object through the video, numerous CNN-based methods have been developed by heavily finetuning on the object mask in the first frame, which is time-consuming for online applications. In this paper, we propose a fast and accurate video object segmentation algorithm that can immediately start the segmentation process once receiving the images. We first utilize a part-based tracking method to deal with challenging factors such as large deformation, occlusion, and cluttered background. Based on the tracked bounding boxes of parts, we construct a region-of-interest segmentation network to generate part masks. Finally, a similarity-based scoring function is adopted to refine these object parts by comparing them to the visual information in the first frame. Our method performs favorably against state-of-the-art algorithms in accuracy on the DAVIS benchmark dataset, while achieving much faster runtime performance.
40
Deep Residual Learning for Image Recognition
Kaiming He, Xiangyu Zhang, Shaoqing Ren et al. · 2016 · 222.1K citations · Full text
Fully convolutional networks for semantic segmentation
Jonathan Long, Evan Shelhamer, Trevor Darrell · 2015 · 36.9K citations
Kaiming He, Georgia Gkioxari, Piotr Dollár et al. · 2017 · 28.8K citations
Visual object tracking using adaptive correlation filters
D.S. Bolme, J. Ross Beveridge, Bruce A. Draper et al. · 2010 · 3.3K citations