arXiv (Cornell University) · 2016 · 15 citations · 20 references
ComputingComputer ScienceComputer VisionMachine LearningMachine VisionDeep LearningInstance SegmentationObject DetectionObject RecognitionScene UnderstandingSemantic SegmentationAffordance DetectionAffordance LearningConvolutional Neural NetworksExpectation-maximizationExpectation-maximization AlgorithmKeypoint DetectionVisual Scene UnderstandingWeakly Supervised Segmentation
Localizing functional regions of objects or affordances is an important aspect of scene understanding. In this work, we cast the problem of affordance segmentation as that of semantic image segmentation. In order to explore various levels of supervision, we introduce a pixel-annotated affordance dataset of 3090 images containing 9916 object instances with rich contextual information in terms of human-object interactions. We use a deep convolutional neural network within an expectation maximization framework to take advantage of weakly labeled data like image level annotations or keypoint annotations. We show that a further reduction in supervision is possible with a minimal loss in performance when human pose is used as context.
20
Describing objects by their attributes
Ali Farhadi, Ian Endres, Derek Hoiem et al. · 2009 IEEE Conference on Computer Vision and Pattern Recognition · 2009 · 1.9K citations