Archipelago: An island-based file system for highly available and scalable internet services

Minwen Ji, Edward W. Felten, Randolph Wang, Jaswinder Pal Singh

Research output: Contribution to conferencePaperpeer-review

Abstract

Maintaining availability in the face of failures is a critical requirement for Internet services. Existing approaches in cluster-based data storage rely on redundancy to survive a small number of failures, but the system becomes entirely unavailable if more failures occur. We describe an approach that allows a cluster file server to isolate failures so that the system can continue to serve most clients. Our approach is complementary to existing redundancy-based methods: redundancy can mask the first few failures, and failure isolation can take over and maintain availability for the majority of clients if more failures occur. The building blocks of our design are self-contained and load-balanced file servers called islands. The main idea underlying island-based design is the one-island principle: as many operations as possible should involve exactly one island. The one-island principle provides failure isolation because each island can function independently of other islands' failures. It also helps the file system scale with the system and workload sizes because communication and synchronization across islands are reduced. We implemented a prototype island-based file system called Archipelago on a cluster of PCs running Windows NT 4.0 connected by Ethernet. The measurement of micro benchmark shows that Archipelago adds little overhead to NTFS and Win32 RPC performance; while the measurement of operation mixes based on NTFS traces shows a speedup of 15.7 on 16 islands.

Original languageEnglish (US)
StatePublished - 2020
Event4th USENIX Windows Systems Symposium - Seattle, United States
Duration: Aug 3 2000Aug 4 2000

Conference

Conference4th USENIX Windows Systems Symposium
CountryUnited States
CitySeattle
Period8/3/008/4/00

All Science Journal Classification (ASJC) codes

  • Management of Technology and Innovation
  • Information Systems and Management

Fingerprint Dive into the research topics of 'Archipelago: An island-based file system for highly available and scalable internet services'. Together they form a unique fingerprint.

Cite this