Be fast, cheap and in control with SwitchKV

Xiaozhou Li, Raghav Sethi, Michael Kaminsky, David G. Andersen, Michael J. Freedman

Research output: Chapter in Book/Report/Conference proceedingConference contribution

32 Scopus citations

Abstract

SwitchKV is a new key-value store system design that combines high-performance cache nodes with resource-constrained backend nodes to provide load balancing in the face of unpredictable workload skew. The cache nodes absorb the hottest queries so that no individual backend node is over-burdened. Compared with previous designs, SwitchKV exploits SDN techniques and deeply optimized switch hardware to enable efficient content-based routing. Programmable network switches keep track of cached keys and route requests to the appropriate nodes at line speed, based on keys encoded in packet headers. A new hybrid caching strategy keeps cache and switch forwarding rules updated with low overhead and ensures that system load is always well-balanced under rapidly changing workloads. Our evaluation results demonstrate that SwitchKV can achieve up to 5× throughput and 3× latency improvements over traditional system designs.

Original languageEnglish (US)
Title of host publicationProceedings of the 13th USENIX Symposium on Networked Systems Design and Implementation, NSDI 2016
PublisherUSENIX Association
Pages31-44
Number of pages14
ISBN (Electronic)9781931971294
StatePublished - Jan 1 2016
Event13th USENIX Symposium on Networked Systems Design and Implementation, NSDI 2016 - Santa Clara, United States
Duration: Mar 16 2016Mar 18 2016

Publication series

NameProceedings of the 13th USENIX Symposium on Networked Systems Design and Implementation, NSDI 2016

Conference

Conference13th USENIX Symposium on Networked Systems Design and Implementation, NSDI 2016
CountryUnited States
CitySanta Clara
Period3/16/163/18/16

All Science Journal Classification (ASJC) codes

  • Computer Networks and Communications
  • Control and Systems Engineering

Fingerprint Dive into the research topics of 'Be fast, cheap and in control with SwitchKV'. Together they form a unique fingerprint.

  • Cite this

    Li, X., Sethi, R., Kaminsky, M., Andersen, D. G., & Freedman, M. J. (2016). Be fast, cheap and in control with SwitchKV. In Proceedings of the 13th USENIX Symposium on Networked Systems Design and Implementation, NSDI 2016 (pp. 31-44). (Proceedings of the 13th USENIX Symposium on Networked Systems Design and Implementation, NSDI 2016). USENIX Association.