2002 · 145 citations · 23 references
ComputingComputer ScienceComputer SystemsData ManagementDistributed SystemsGrid ComputingData ReplicationDistributed ComputingData Grid ArchitectureGridsObject-oriented ArchitectureReplica Management
Data replication in high‑energy‑physics data grids is critical, occurring at file or object levels, and requires performance‑tuned wide‑area file transfers to support distributed analysis. The study introduces an enhanced GDMP architecture and prototype that leverages Globus tools to enable efficient file replication and to address object‑level replication in object‑oriented databases. The prototype employs Globus data‑grid middleware to orchestrate file replication and incorporates mechanisms to support object replication within object‑oriented database systems. The GDMP prototype is already deployed in a physics experiment, and performance tests with GridFTP demonstrate that tuning parameters can significantly improve data transfer rates.
Data replication is a key issue in a data grid and can be managed in different ways and at different levels of granularity: for example, at the file level or the object level. In the high-energy physics community, data grids are being developed to support the distributed analysis of experimental data. We have produced a prototype data replication tool, the Grid Data Management Pilot (GDMP) that is in production use in one physics experiment, with middleware provided by the Globus toolkit used for authentication, data movement and other purposes. We present a new, enhanced GDMP architecture and prototype implementation that uses Globus data-grid tools for efficient file replication. We also explain how this architecture can address object replication issues in an object-oriented database management system. File transfer over wide-area networks requires specific performance tuning in order to gain optimal data transfer rates. We present performance results obtained with GridFTP, an enhanced version of FTP, and discuss tuning parameters.
23
Web caching and Zipf-like distributions: evidence and implications
Lee Breslau, Pei Cao, Fan Li et al. · 1999 · 3.5K citations
A security architecture for computational grids
Ian Foster, Carl Kesselman, Gene Tsudik et al. · 1998 · 1.3K citations · Full text
The SDSC storage resource broker
Chaitanya Baru, Reagan Moore, Arcot Rajasekar et al. · 2010 · 557 citations