2010 · 26 citations · 6 references
ComputingComputer ScienceComputer VisionEye MovementsInformation RetrievalEvaluation Of Retrieval SystemsEye Movement AnalysisImage RetrievalRelevance FeedbackRetrieval ModelsVisual SearchContent-based Image RetrievalImage Retrieval EvaluationImage Retrieval SystemsPrecisionRanking ModelsRelevance Feedback EvaluationRetrieval Evaluation
Relevance feedback (RF) mechanisms are widely adopted in Content-Based Image Retrieval (CBIR) systems to improve image retrieval performance. However, there exist some intrinsic problems: (1) the semantic gap between high-level concepts and low-level features and (2) the subjectivity of human perception of visual contents. The primary focus of this paper is to evaluate the possibility of inferring the relevance of images based on eye movement data. In total, 882 images from 101 categories are viewed by 10 subjects to test the usefulness of implicit RF, where the relevance of each image is known beforehand. A set of measures based on fixations are thoroughly evaluated which include fixation duration, fixation count, and the number of revisits. Finally, the paper proposes a decision tree to predict the user's input during the image searching tasks. The prediction precision of the decision tree is over 87%, which spreads light on a promising integration of natural eye movement into CBIR systems in the future.
6
Eye tracking in web search tasks
Joseph H. Goldberg, Mark Stimson, Marion Lewenstein et al. · 2002 · 380 citations
Can relevance of images be inferred from eye movements?
Arto Klami, Craig Saunders, Teófilo de Campos et al. · 2008 · 50 citations · Full text
Scale-Invariant Visual Language Modeling for Object Categorization
Lei Wu, Yang Hu, Mingjing Li et al. · IEEE Transactions on Multimedia · 2009 · 47 citations
Exploring Human Eye Behaviour Using a Model of Visual Attention
2004 · 26 citations