ComputingComputer ScienceData ScienceData ManagementDatabasesInformation RetrievalArchival ResearchArchivingData ArchivingDigital ArchivingQuery ProcessingWeb ArchivingAccessArchival MetadataData ProcessingDistributed Web ArchivingElectronic Data ArchivingMetadataResearch Corpus ConstructionResearch Data Repositories
Web archives are a valuable resource for researchers of various disciplines. However, to use them as a scholarly source, researchers require a tool that provides efficient access to Web archive data for extraction and derivation of smaller datasets. Besides efficient access we identify five other objectives based on practical researcher needs such as ease of use, extensibility and reusability.
10
Spark: cluster computing with working sets
Matei Zaharia, Mosharaf Chowdhury, Michael J. Franklin et al. · 2010 · 4.2K citations
Fay W. Chang, Sanjay Ghemawat, Wilson C. Hsieh et al. · ACM Transactions on Computer Systems · 2008 · 3.4K citations
Avinash Lakshman, Prashant Malik · ACM SIGOPS Operating Systems Review · 2010 · 2.6K citations
Bigtable: a distributed storage system for structured data
Fay W. Chang, Jay B. Dean, Sanjay Ghemawat et al. · 2006 · 2K citations
Sanjay Ghemawat · Communications of the ACM · 2009 · 1.2K citations