ACM SIGMOD Record · 2002 · 14 citations · 10 references
ComputingComputer SciencePhysicsData ManagementInformation RetrievalParticle PhysicsData PartitioningData Storage SystemsQuery ProcessingScalable Data StorageStorage EnginesStorage ManagementAttributesClustering For Large-scale DataHigh-dimensional Data ClusteringIndex StructuresIndexingRetrievalScalable IndexingStorage Clustering
In high-energy physics experiments, large particle accelerators produce enormous quantities of data, measured in hundreds of terabytes or petabytes per year, which are deposited onto tertiary storage. The experiments are designed to study the collisions of fundamental particles, called "events", each of which is represented as a point in a multi-dimensional universe. In these environments, the best retrieval performance can be achieved only if the data is clustered on the tertiary storage by all searchable attributes of the events. Since the number of these attributes is high, the underlying data-management facility must be able to cope with extremely large volumes and very high dimensionalities of data at the same time. The proposed indexing technique is designed to facilitate both clustering and efficient retrieval of high-dimensional data on tertiary storage. The structure uses an original space-partitioning scheme, which has numerous advantages over other space-partitioning techniques. While the main objective of the design is to support high-energy physics experiments, the proposed solution is appropriate for many other scientific applications.
10
John T. Robinson · 1981 · 888 citations · Full text
The X Tree: An Index Structure for High Dimensional Data
KOPS (University of Konstanz) · 1996 · 414 citations · Full text
Stefan Berchtold, Christian Böhm, Hans-Peter Kriegal · 1998 · 402 citations · Full text