2002 · 94 citations · 16 references
ComputingComputer ScienceComputational LinguisticsInformation RetrievalNatural Language ProcessingDocument RepresentationLanguage ModelingLanguage ModelsProbabilistic RetrievalRetrieval ModelsVector Space RetrievalConditional Probability ModelsLanguage Model SmoothingLanguage Modeling Approach To RetrievalLanguage Modeling For Information RetrievalLanguage Modeling For RetrievalProbabilistic Retrieval ModelsStatistical Machine TranslationVector Space Models
In this paper, we propose a new language model, namely, a title language model, for information retrieval. Different from the traditional language model used for retrieval, we define the conditional probability P(QID) as the probability of using query Q as the title for document D. We adopted the statistical translation model learned from the title and document pairs in the collection to compute the probability P(QID). To avoid the sparse data problem, we propose two new smoothing methods. In the experiments with four different TREC document collections, the title language model for information retrieval with the new smoothing method outperforms both the traditional language model and the vector space model for IR significantly.
16
A Language Modeling Approach to Information Retrieval
Jay Ponte, W. Bruce Croft · ACM SIGIR Forum · 2017 · 2.5K citations · Full text
Stephen Robertson, Steve Walker, Susan Jones et al. · Text REtrieval Conference · 1994 · 2.2K citations
A language modeling approach to information retrieval
Jay Ponte, W. Bruce Croft · 1998 · 1.7K citations