TY - JOUR
T1 - Chirp
T2 - A practical global filesystem for cluster and grid computing
AU - Thain, Douglas
AU - Moretti, Christopher
AU - Hemmes, Jeffrey
N1 - Funding Information:
We thank the many users and testers of Chirp, particularly Justin Wozniak, Paul Brenner, Aaron Striegel, Jesus Izaguirre, Tim Faltemier, Patrick Flynn, Chris D’Andrea, John Poirier, Christophe Blanchet, Remi Mollon, Gilbert Deleage, Mark Calleja, and Sander Klous. This work was supported in part by National Science Foundation grants CCF-06-21434 and CNS-06-43229.
PY - 2009
Y1 - 2009
N2 - Traditional distributed filesystem technologies designed for local and campus area networks do not adapt well to wide area Grid computing environments. To address this problem, we have designed the Chirp distributed filesystem, which is designed from the ground up to meet the needs of Grid computing. Chirp is easily deployed without special privileges, provides strong and flexible security mechanisms, tunable consistency semantics, and clustering to increase capacity and throughput. We demonstrate that many of these features also provide order-of-magnitude performance increases over wide area networks. We describe three applications in bioinformatics, biometrics, and gamma ray physics that each employ Chirp to attack large scale data intensive problems.
AB - Traditional distributed filesystem technologies designed for local and campus area networks do not adapt well to wide area Grid computing environments. To address this problem, we have designed the Chirp distributed filesystem, which is designed from the ground up to meet the needs of Grid computing. Chirp is easily deployed without special privileges, provides strong and flexible security mechanisms, tunable consistency semantics, and clustering to increase capacity and throughput. We demonstrate that many of these features also provide order-of-magnitude performance increases over wide area networks. We describe three applications in bioinformatics, biometrics, and gamma ray physics that each employ Chirp to attack large scale data intensive problems.
KW - Cluster computing
KW - Filesystem
KW - Grid computing
UR - http://www.scopus.com/inward/record.url?scp=60349117117&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=60349117117&partnerID=8YFLogxK
U2 - 10.1007/s10723-008-9100-5
DO - 10.1007/s10723-008-9100-5
M3 - Article
AN - SCOPUS:60349117117
SN - 1570-7873
VL - 7
SP - 51
EP - 72
JO - Journal of Grid Computing
JF - Journal of Grid Computing
IS - 1
ER -