Performance isolation and fairness for multi-tenant cloud storage

David Shue, Michael J. Freedman, Anees Shaikh

Research output: Chapter in Book/Report/Conference proceedingConference contribution

164 Scopus citations

Abstract

Shared storage services enjoy wide adoption in commercial clouds. But most systems today provide weak performance isolation and fairness between tenants, if at all. Misbehaving or high-demand tenants can overload the shared service and disrupt other well-behaved tenants, leading to unpredictable performance and violating SLAs. This paper presents Pisces, a system for achieving datacenter-wide per-tenant performance isolation and fairness in shared key-value storage. Today's approaches for multi-tenant resource allocation are based either on per-VM allocations or hard rate limits that assume uniform workloads to achieve high utilization. Pisces achieves per-tenant weighted fair shares (or minimal rates) of the aggregate resources of the shared service, even when different tenants' partitions are co-located and when demand for different partitions is skewed, time-varying, or bottlenecked by different server resources. Pisces does so by decomposing the fair sharing problem into a combination of four complementary mechanisms-partition placement, weight allocation, replica selection, and weighted fair queuing-that operate on different time-scales and combine to provide system-wide max-min fairness. An evaluation of our Pisces storage prototype achieves nearly ideal (0.99 Min-Max Ratio) weighted fair sharing, strong performance isolation, and robustness to skew and shifts in tenant demand. These properties are achieved with minimal overhead (<3%), even when running at high utilization (more than 400,000 requests/second/server for 10B requests).

Original languageEnglish (US)
Title of host publicationProceedings of the 10th USENIX Symposium on Operating Systems Design and Implementation, OSDI 2012
PublisherUSENIX Association
Pages349-362
Number of pages14
ISBN (Electronic)9781931971966
StatePublished - Jan 1 2012
Event10th USENIX Symposium on Operating Systems Design and Implementation, OSDI 2012 - Hollywood, United States
Duration: Oct 8 2012Oct 10 2012

Publication series

NameProceedings of the 10th USENIX Symposium on Operating Systems Design and Implementation, OSDI 2012

Conference

Conference10th USENIX Symposium on Operating Systems Design and Implementation, OSDI 2012
CountryUnited States
CityHollywood
Period10/8/1210/10/12

All Science Journal Classification (ASJC) codes

  • Information Systems
  • Computer Networks and Communications
  • Hardware and Architecture

Fingerprint Dive into the research topics of 'Performance isolation and fairness for multi-tenant cloud storage'. Together they form a unique fingerprint.

  • Cite this

    Shue, D., Freedman, M. J., & Shaikh, A. (2012). Performance isolation and fairness for multi-tenant cloud storage. In Proceedings of the 10th USENIX Symposium on Operating Systems Design and Implementation, OSDI 2012 (pp. 349-362). (Proceedings of the 10th USENIX Symposium on Operating Systems Design and Implementation, OSDI 2012). USENIX Association.