A case study in building layered DHT applications

Yatin Chawathe, Sriram Ramabhadran, Sylvia Ratnasamy, Anthony LaMarca, Scott Shenker, Joseph M. Hellerstein

ACM SIGCOMM Computer Communication Review · 2005 · 33 citations · 23 references

Concepts

TL;DR

Distributed Hash Tables enable scalable, robust, and efficient applications, yet the simplicity of their implementation and deployment remains largely unaddressed. This study investigates whether a DHT can serve as an application‑independent building block for Place Lab’s mapping infrastructure, prioritizing ease of deployment over raw performance. Place Lab, an end‑user positioning system, employs Prefix Hash Trees built entirely atop a standard DHT to support geographic range queries, and the authors analyze its suitability and performance impact in a layered deployment. Layering Place Lab’s data structures on a generic DHT decouples its deployment and management from the underlying DHT, demonstrating a viable, deployment‑friendly architecture.

Abstract

Recent research has shown that one can use Distributed Hash Tables (DHTs) to build scalable, robust and efficient applications. One question that is often left unanswered is that of simplicity of implementation and deployment. In this paper, we explore a case study of building an application for which ease of deployment dominated the need for high performance. The application we focus on is Place Lab, an end-user positioning system. We evaluate whether it is feasible to use DHTs as an application-independent building block to implement a key component of Place Lab: its "mapping infrastructure." We present Prefix Hash Trees, a data structure used by Place Lab for geographic range queries that is built entire on top of a standard DHT. By strictly layering Place Lab's data structures on top of a generic DHT service, we were able to decouple the deployment and management of Place Lab from that of the underlying DHT. We identify the characteristics of Place Lab that made it amenable for deploying in this layered manner, and comment on its effect on performance.

References

23