Portkey: Adaptive key-value placement over dynamic edge networks

Joseph Noor, Mani Srivastava, Ravi Netravali

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Owing to a need for low latency data accesses, emerging IoT and mobile applications commonly require distributed data stores (e.g., key-value or KV stores) to operate entirely at the network's edge. Unfortunately, existing KV stores employ randomized data placement policies (e.g., consistent hashing) that ignore the client mobility and resulting variance in client-server latencies that are inherent to edge applications - -the effect is largely suboptimal and inefficient data placement. We present Portkey, a distributed KV store that dynamically adapts data placement according to time-varying client mobility and data access patterns. The key insight with Portkey is to lean into the inherent mobility and prioritize rapid but approximate placement decisions over delayed optimal ones. Doing so enables the efficient tracking of client-server latencies despite edge resource constraints, and the use of greedy placement heuristics that are self-correcting over short timescales. Results with a realistic autonomous vehicle dataset and two small-scale deployments reveal that Portkey reduces average and tail request latency by 21-82% and 26-77% compared to existing placement strategies.

Original languageEnglish (US)
Title of host publicationSoCC 2021 - Proceedings of the 2021 ACM Symposium on Cloud Computing
PublisherAssociation for Computing Machinery, Inc
Pages197-213
Number of pages17
ISBN (Electronic)9781450386388
DOIs
StatePublished - Nov 1 2021
Event12th Annual ACM Symposium on Cloud Computing, SoCC 2021 - Virtual, Online, United States
Duration: Nov 1 2021Nov 4 2021

Publication series

NameSoCC 2021 - Proceedings of the 2021 ACM Symposium on Cloud Computing

Conference

Conference12th Annual ACM Symposium on Cloud Computing, SoCC 2021
Country/TerritoryUnited States
CityVirtual, Online
Period11/1/2111/4/21

All Science Journal Classification (ASJC) codes

  • Computational Theory and Mathematics
  • Computer Science Applications

Keywords

  • Data Locality
  • Data Migration
  • Distributed Data
  • Edge Computing
  • Mobility
  • Replica Assignment

Fingerprint

Dive into the research topics of 'Portkey: Adaptive key-value placement over dynamic edge networks'. Together they form a unique fingerprint.

Cite this