2010 · 16 citations · 22 references
ComputingComputer ScienceComputer SystemsCloud MonitoringComputer NetworksDistributed SystemsContent Delivery NetworksPeer-to-peer NetworkingPeer-to-peer NetworksPeer-to-peer SystemsFile Sharing NetworksFile Sharing SystemsPeer-to-peer ArchitecturesPeer-to-peer Network ArchitectureTorrent Swarms
Today, the BitTorrent Peer-to-Peer file-sharing network is one of the largest Internet applications---it generates massive traffic volumes, it is deployed in thousands of independent communities, and it serves millions of unique users worldwide. Despite a large number of empirical and theoretical studies, observing the state of the global BitTorrent network remains a grand challenge for the BitTorrent community. To address this challenge, in this work we introduce BT-World, an architecture for observing the global BitTorrent network without help from the ISPs. We design BTWorld around three main features specific to BitTorrent measurements. First, our architecture is able to find public trackers, that is, the BitTorrent components that offer unrestricted service to peers around the world. Second, by observing the state of these trackers, BTWorld obtains information about the performance, scalability, and reliability of BitTorrent. Third, BTWorld is designed to pre-process the large volumes of recorded data for later analysis. We demonstrate the viability of our architecture by deploying it in practice, to observe and analyze one week of operation of a large part of the global BitTorrent network--over 10 million swarms and tens of millions of concurrent users. We also show that BT-World can shed light on BitTorrent phenomena, such as the presence of spam trackers and giant swarms.
22
A comparison of approaches to large-scale data analysis
Andrew Pavlo, Erik K. Paulson, Alexander Rasin et al. · 2009 · 1.1K citations
R. Matei, Adriana Iamnitchi, Philip P. Foster · IEEE Internet Computing · 2002 · 769 citations
Transport layer identification of P2P traffic
Thomas Karagiannis, Andre Broido, Michalis Faloutsos et al. · 2004 · 713 citations
Computing, Information Technology, Digital Communication +16
Zoltán Gyöngyi, Héctor García-Molina · Adversarial Information Retrieval on the Web · 2005 · 488 citations