Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval · 2022 · 52 citations · 28 references
ComputingComputer ScienceInformation RetrievalMachine LearningNatural Language ProcessingDeep LearningDocument RepresentationEvaluation Of Retrieval SystemsInformation Retrieval ArchitectureRetrieval ModelsDense RetrievalInverted Index StructuresNeural Information RetrievalNeural Ranking ModelsRetrievalSparse ModelsSparse Retrieval
Neural information retrieval architectures based on transformers such as BERT are able to significantly improve system effectiveness over traditional sparse models such as BM25. Though highly effective, these neural approaches are very expensive to run, making them difficult to deploy under strict latency constraints. To address this limitation, recent studies have proposed new families of learned sparse models that try to match the effectiveness of learned dense models, while leveraging the traditional inverted index data structure for efficiency.
28
In-Datacenter Performance Analysis of a Tensor Processing Unit
Norman P. Jouppi, Cliff Young, Nishant Patil et al. · 2017 · 4.4K citations