2009 · 28 citations · 6 references
ComputingComputer ScienceComputer VisionNatural Language ProcessingVisual AttentionAction RecognitionAffective ComputingAffective State DetectionEmotion RecognitionObject DetectionVisual LocalizationAffectAutomatic Emotion DetectionFacial Expression RecognitionGaze Behavior AnalysisGaze Estimation
We propose a novel framework to localize and label affective objects and actions in images through a combination of text, visual and gaze-based analysis. Human gaze provides useful cues to infer locations and interactions of affective objects. While concepts (labels) associated with an image can be determined from its caption, we demonstrate localization of these concepts upon learning from a statistical affect model for world concepts. The affect model is derived from non-invasively acquired fixation patterns on labeled images, and guides localization of affective objects (faces, reptiles) and actions (look, read) from fixations in unlabeled images. Experimental results obtained on a database of 500 images confirm the effectiveness and promise of the proposed approach.
6
LabelMe: A Database and Web-Based Tool for Image Annotation
Bryan Russell, Antonio Torralba, Kevin Murphy et al. · International Journal of Computer Vision · 2007 · 4.2K citations · Full text
Components of bottom-up gaze allocation in natural images
Robert J. Peters, Asha Iyer, Laurent Itti et al. · Vision Research · 2005 · 736 citations
Objects predict fixations better than early saliency
Wolfgang Einhäuser, M Spain, Pietro Perona · Journal of Vision · 2008 · 459 citations · Full text
Medicine, Psychology, Vision Science +15
Yining Deng, B.S. Manjunath, Hyejin Shin · 2003 · 430 citations