2012 · 23 citations · 18 references
ComputingComputer SciencePsychologyHuman-computer InteractionInformation RetrievalPerformance AssessmentEvaluation Of Retrieval SystemsInformation SearchSearch SystemsUsability TestingWeb SearchCognitive Load In SearchInformation Search EffortSearch Engine User BehaviorSearch Performance MetricsSearch Task EvaluationTask ComplexityUser Performance MeasurementUser Performance Metrics
Search engines are the preferred tools for finding information on the Web. They are advancing to be the common helpers to answer any of our search needs. We use them to carry out simple look-up tasks and also to work on rather time consuming and more complex search tasks. Yet, we do not know very much about the user performance while carrying out those tasks -- especially not for ordinary users. The aim of this study was to get more insight into whether Web users manage to assess difficulty, time effort, query effort, and task outcome of search tasks, and if their judging performance relates to task complexity. Our study was conducted with a systematically selected sample of 56 people with a wide demographic background. They carried out a set of 12 search tasks with commercial Web search engines in a laboratory environment. The results confirm that it is hard for normal Web users to judge the difficulty and effort to carry out complex search tasks. The judgments are more reliable for simple tasks than for complex ones. Task complexity is an indicator for judging performance.
18
Gary Marchionini · Communications of the ACM · 2006 · 1.5K citations
Task‐based information searching
Pertti Vakkari · Annual Review of Information Science and Technology · 2003 · 365 citations · Full text