Algorithms · 2009 · 122 citations · 19 references
ComputingComputer ScienceData StructuresInformation RetrievalStorage SystemsData CompressionGraph AlgorithmsGraph MiningGraph TheoryLossless Data CompressionLossy Data CompressionCompressed Data StructuresCompressionCompression AlgorithmsCompression TechniquesData Compression In StorageGraph CompressionMemory CompressionRetrieval
The Web Graph is a large-scale graph that does not fit in main memory, so that lossless compression methods have been proposed for it. This paper introduces a compression scheme that combines efficient storage with fast retrieval for the information in a node. The scheme exploits the properties of the Web Graph without assuming an ordering of the URLs, so that it may be applied to more general graphs. Tests on some datasets of use achieve space savings of about 10% over existing methods.
19
The PageRank Citation Ranking : Bringing Order to the Web
Lawrence M. Page, Sergey Brin, Rajeev Motwani et al. · 1999 · 12.7K citations
Paolo Boldi, Sebastiano Vigna · 2004 · 1.2K citations
UbiCrawler: a scalable fully distributed Web crawler
Paolo Boldi, Bruno Codenotti, Massimo Santini et al. · Software Practice and Experience · 2004 · 564 citations