2008 · 41 citations · 42 references
ComputingComputer ScienceComputer SystemsData ManagementGrid ComputingScientific ComputingData LocalityData Locality OptimizationData Storage SystemsFile SystemsAbstractionData AvailabilityData-intensive ComputingGridsLocality ConstraintsTemporal LocalityWorkloadWorkload Modeling
The analysis of data usage in a large set of real traces from a high-energy physics collaboration revealed the existence of an emergent grouping of files that we coined filecules. This paper presents the benefits of using this file grouping for prestaging data and compares it with previously proposed file grouping techniques along a range of performance metrics. Our experiments with real workloads demonstrate that filecule grouping is a reliable and useful abstraction for data management in science Grids; that preserving time locality for data prestaging is highly recommended; that job reordering with respect to data availability has significant impact on throughput; and finally, that a relatively short history of traces is a good predictor for filecule grouping.Our experimental results provide lessons for workload modeling and suggest design guidelines for data management in data-intensive resource-sharing environments.
42
Sanjay Ghemawat, Howard Gobioff, Shun-Tak A. Leung · 2003 · 1.4K citations
A workload characterization study of the 1998 World Cup Web site
Martin Arlitt, Tai Jin · IEEE Network · 2000 · 765 citations
Characteristics of WWW Client-based Traces
Carlos R. Cunha, Azer Bestavros, Mark Crovella · 1995 · 532 citations
Characterizing reference locality in the WWW
Virgı́lio Almeida, Azer Bestavros, Mark Crovella et al. · 2002 · 466 citations