2010 · 29 citations · 8 references
Cluster ComputingEngineeringCloud DatabaseBig Data IndexingProperty ParcelsMap-reduceUnited StatesGeodatabasesData ScienceDatabase SupportManagementData IntegrationCloud Data ManagementParallel ComputingData ManagementComputer ScienceInformation ManagementBig Data SearchDistributed Query ProcessingCloud ComputingParallel ProgrammingMassive Data ProcessingBig Data
The study leverages cloud computing to scale geographic database management, focusing on parallel data indexing. The authors partition and index spatial data in a Hadoop MapReduce cluster, comparing Z‑order and X‑means clustering strategies, and evaluate query performance on a 110‑million‑object U.S. property parcel dataset.
In this work, we leverage Cloud computing technologies in scaling out data management in geographical databases. In particular, we tackle the issue of data indexing in parallel. First, spatial data is partitioned and indexed in a Hadoop MapReduce cluster. Two main partitioning strategies are evaluated: a) A linear-complexity method based on Zorder values, and b) An iterative algorithm based on X-means clustering. The advantages and drawbacks of each method are weighted in with relation to query performance. Second, interactive queries are processed from a local site using the index data structures built in the Cloud. We perform an experimental study on a real dataset of 110 million spatial objects representing property parcels in the United States. Our results support Cloud computing as an effective technology to cope up with huge datasets and, in particular, MapReduce parallel programming model in easing parallel processing implementations.
8
Sanjay Ghemawat · Communications of the ACM · 2008 · 18.4K citations · Full text
Antonin Guttman · 1984 · 6.6K citations
Sanjay Ghemawat, Howard Gobioff, Shun-Tak A. Leung · ACM SIGOPS Operating Systems Review · 2003 · 5K citations
X-means: Extending K-means with Efficient Estimation of the Number of Clusters
Dan Pelleg, Andrew Moore · 2000 · 2.2K citations