Journal of the Medical Library Association JMLA · 2016 · 1.9K citations · 5 references
ComputingComputer ScienceDatabasesInformation RetrievalDuplicate DetectionLiterature Review MethodsLiterature SearchingSystematic ReviewSystematic Review MethodologySystematic Review MethodsContent De-duplicationDuplicate RemovalDuplicate Study DetectionHand SearchingSearchesStudy RetrievalSystematic Literature ReviewSystematic Review Retrieval
When conducting exhaustive searches for systematic reviews, information professionals search multiple databases with overlapping content [1][2][3][4].They typically remove duplicate records to reduce the reviewers' workload associated with screening titles and abstracts; sometimes the reviewers remove the duplicates.Several articles have been published recently on de-duplication methods.In the authors' opinion, these methods are either very time consuming [5] or impractical, as they require uploading large files to an online platform [6,7].A recent overview article compared existing software programs but found that none was truly satisfactory [8].Unique identifiers for journal articles are digital object identifiers (DOIs) and PubMed IDs (PMIDs).However, these identifiers are not present in every database.When they are present, they often cannot be exported easily.Thus, they cannot be relied upon to identify duplicates.An alternative involves using pagination, because the often large page numbers in scientific journals, in combination with other fields, can serve as a type of unique identifier.However, this is complicated by variations in the way page numbers are stored.Most biomedical databases use a long format (e.g.,
5
Find Duplicates among the PubMed, EMBASE, and Cochrane Library Databases in Systematic Review
Xingshun Qi, Man Yang, Weirong Ren et al. · PLoS ONE · 2013 · 108 citations · Full text
Rule-based deduplication of article records from bibliographic databases
Yu Jiang, Can Lin, Weiyi Meng et al. · Database · 2014 · 40 citations · Full text