2024 · 16 citations · 17 references
ComputingComputer ScienceInformation RetrievalNatural Language ProcessingText AnalyticsLanguage ModelingLiterature MiningLiterature Review MethodsNatural Language GenerationSystematic ReviewSystematic Review MethodsAutomated Query GenerationBoolean Query LanguagesBoolean Query ProcessingBoolean Search QueriesGeneralizability Study DesignLanguage Modeling For RetrievalLarge Language ModelsSystematic Literature Review
Systematic literature reviews (SLRs) are a cornerstone of academic research, yet they are often labour-intensive and time-consuming due to the detailed literature curation process. The advent of generative AI and large language models (LLMs) promises to revolutionize this process by assisting researchers in several tedious tasks, one of them being the generation of effective Boolean queries that will select the publications to consider including in a review. This paper presents an extensive study of Boolean query generation using LLMs for systematic reviews, reproducing and extending the work of Wang et al. and Alaniz et al. Our study investigates the replicability and reliability of results achieved using ChatGPT and compares its performance with open-source alternatives like Mistral and Zephyr to provide a more comprehensive analysis of LLMs for query generation.
17
Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks
Nils Reimers, Iryna Gurevych · 2019 · 10.9K citations · Full text
Can ChatGPT Write a Good Boolean Query for Systematic Review Literature Search?
Shuai Wang, Harrisen Scells, Bevan Koopman et al. · 2023 · 202 citations