2012 · 13 citations · 12 references
ComputingComputer ScienceData ScienceData MiningInformation RetrievalRecommender SystemsArchivingDuplicate DetectionInformation ExtractionKnowledge RepositoriesLiterature MiningLiterature SearchingBibliographic MetadataCurated Data SetsDocument DeduplicationDuplicate Content DetectionDuplicate RemovalGround Truth ConstructionSearch AutomationSource Retrieval
Mendeley's crowd-sourced catalogue of research papers forms the basis of features such as the ability to search for papers, finding papers related to one currently being viewed and personalised recommendations. In order to generate this catalogue it is necessary to deduplicate the records uploaded from users' libraries and imported from external sources such as PubMed and arXiv. This task has been achieved at Mendeley via an automated system.
12
Similarity estimation techniques from rounding algorithms
Moses Charikar · 2002 · 2.2K citations
Interactive deduplication using active learning
Sunita Sarawagi, Anuradha Bhamidipaty · 2002 · 693 citations
Digital libraries and autonomous citation indexing
Sandra Lawrence, C. Lee Giles, Kurt Bollacker · Computer · 1999 · 614 citations
Detecting near-duplicates for web crawling
Gurmeet Singh Manku, Arvind Kumar Jain, Anish Das Sarma · 2007 · 610 citations