2017 · 28.8K citations · 30 references
ComputingComputer ScienceComputer VisionMachine LearningMachine VisionDeep LearningInstance SegmentationObject DetectionObject RecognitionKeypoint DetectionMask PredictionObject Mask GenerationObject Segmentation
The paper proposes a simple, flexible, general framework for object instance segmentation. Mask R‑CNN extends Faster R‑CNN by adding a parallel mask‑prediction branch, enabling efficient simultaneous detection and high‑quality instance segmentation with minimal overhead and easy adaptation to tasks such as pose estimation. Mask R‑CNN achieves state‑of‑the‑art results on COCO instance segmentation, object detection, and keypoint detection, outperforming all single‑model baselines, and its code is publicly released.
We present a conceptually simple, flexible, and general framework for object instance segmentation. Our approach efficiently detects objects in an image while simultaneously generating a high-quality segmentation mask for each instance. The method, called Mask R-CNN, extends Faster R-CNN by adding a branch for predicting an object mask in parallel with the existing branch for bounding box recognition. Mask R-CNN is simple to train and adds only a small overhead to Faster R-CNN, running at 5 fps. Moreover, Mask R-CNN is easy to generalize to other tasks, e.g., allowing us to estimate human poses in the same framework. We show top results in all three tracks of the COCO suite of challenges, including instance segmentation, bounding-box object detection, and person keypoint detection. Without bells and whistles, Mask R-CNN outperforms all existing, single-model entries on every task, including the COCO 2016 challenge winners. We hope our simple and effective approach will serve as a solid baseline and help ease future research in instance-level recognition. Code has been made available at: https://github.com/facebookresearch/Detectron.
30
Deep Residual Learning for Image Recognition
Kaiming He, Xiangyu Zhang, Shaoqing Ren et al. · 2016 · 222.1K citations · Full text
Fully convolutional networks for semantic segmentation
Jonathan Long, Evan Shelhamer, Trevor Darrell · 2015 · 36.9K citations
Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation
Ross Girshick, Jeff Donahue, Trevor Darrell et al. · 2014 · 31.8K citations