The economics in interactive information retrieval

TLDR

Searching is an inherently interactive process that requires many iterations of querying and assessment to locate relevant information, conceptualized as inputs producing relevance output. The paper adapts microeconomic theory to analyze Interactive Information Retrieval by modeling the search process as an economics problem and simulating TREC test collections. The authors employ a Cobb‑Douglas production function, simulate TREC collections, and use cognitive‑load–based cost models to identify strategies that minimize interaction cost for a given output. The study shows cumulative gain is mathematically linked to querying and assessing, identifies cost‑minimizing strategies, demonstrates that economics can formally model the search process, and lays theoretical foundations for future empirical research.

Abstract

Searching is inherently an interactive process usually requiring numerous iterations of querying and assessing in order to find the desired amount of relevant information. Essentially, the search process can be viewed as a combination of inputs (queries and assessments) which are used to "produce" output (relevance). Under this view, it is possible to adapt microeconomic theory to analyze and understand the dynamics of Interactive Information Retrieval. In this paper, we approach the search process as an economics problem and conduct extensive simulations on TREC test collections analyzing various combinations of inputs in the "production" of relevance. The analysis reveals that the total Cumulative Gain (output) obtained during the course of a search session is functionally related to querying and assessing (inputs), and this can be characterized mathematically by the Cobbs-Douglas production function. Further analysis using cost models, that are grounded using cognitive load as the cost, reveals which search strategies minimize the cost of interaction for a given level of output. This paper demonstrates how economics can be applied to formally model the search process. This development establishes the theoretical foundations of Interactive Information Retrieval, providing numerous directions for empirical experimentation that are motivated directly from theory.