arXiv (Cornell University) · 2019 · 210 citations · 19 references
ComputingComputer ScienceInformation RetrievalMachine LearningNatural Language ProcessingDocument RepresentationLanguage ModelingQuery ExpansionQuestion AnsweringRetrieval ModelsWeb SearchExpansionLearning To Expand QueriesNeural Query ExpansionNeural Ranking ModelsQuestion-answer RetrievalRe-rankingRetrievalSequence-to-sequence Generation
One technique to improve the retrieval effectiveness of a search engine is to expand documents with terms that are related or representative of the documents' content.From the perspective of a question answering system, this might comprise questions the document can potentially answer. Following this observation, we propose a simple method that predicts which queries will be issued for a given document and then expands it with those predictions with a vanilla sequence-to-sequence model, trained using datasets consisting of pairs of query and relevant documents. By combining our method with a highly-effective re-ranking component, we achieve the state of the art in two retrieval tasks. In a latency-critical regime, retrieval results alone (without re-ranking) approach the effectiveness of more computationally expensive neural re-rankers but are much faster.
19
Indexing by latent semantic analysis
Scott Deerwester, Susan Dumais, George W. Furnas et al. · Journal of the American Society for Information Science · 1990 · 12.8K citations
Relevance feedback in information retrieval
J. J. Rocchio · Medical Entomology and Zoology · 1971 · 2.6K citations
Stephen Robertson, Steve Walker, Susan Jones et al. · Text REtrieval Conference · 1994 · 2.2K citations
Hierarchical Neural Story Generation
Angela Fan, Mike Lewis, Yann Dauphin · 2018 · 1.1K citations · Full text