Bibliometric‐enhanced legal information retrieval: Combining usage and citations as flavors of impact relevance

Gineke Wiggers, Suzan Verberne, Wouter van Loon, Gerrit‐Jan Zwenne

Journal of the Association for Information Science and Technology · 2023 · 22 citations · 33 references

DOIFull text

Open access

Concepts

TL;DR

Bibliometric‑enhanced information retrieval uses citations and other bibliometrics to improve ranking algorithms. The study develops and evaluates a bibliometric‑enhanced ranking algorithm for legal information retrieval. The authors analyze usage‑citation correlations from a commercial legal search engine, design a boost function that combines usage and citation counts into an impact variable, and evaluate the resulting ranking by comparing search sessions before and after deployment. The bibliometric‑enhanced ranking reduced legal professionals’ search time by 2–3 % on average, implying higher efficiency for users with long sessions.

Abstract

Abstract Bibliometric‐enhanced information retrieval uses bibliometrics (e.g., citations) to improve ranking algorithms. Using a data‐driven approach, this article describes the development of a bibliometric‐enhanced ranking algorithm for legal information retrieval, and the evaluation thereof. We statistically analyze the correlation between usage of documents and citations over time, using data from a commercial legal search engine. We then propose a bibliometric boost function that combines usage of documents with citation counts. The core of this function is an impact variable based on usage and citations that increases in influence as citations and usage counts become more reliable over time. We evaluate our ranking function by comparing search sessions before and after the introduction of the new ranking in the search engine. Using a cost model applied to 129,571 sessions before and 143,864 sessions after the intervention, we show that our bibliometric‐enhanced ranking algorithm reduces the time of a search session of legal professionals by 2 to 3% on average for use cases other than known‐item retrieval or updating behavior. Given the high hourly tariff of legal professionals and the limited time they can spend on research, this is expected to lead to increased efficiency, especially for users with extremely long search sessions.

References

33