ReLAQS: Reducing Latency for Multi-Tenant Approximate Queries via Scheduling

Logan Stafman, Andrew Or, Michael J. Freedman

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Scopus citations

Abstract

Approximate Query Processing has become increasingly popular as larger data sizes have increased query latency in distributed query processing systems. To provide such approximate results, systems return intermediate results and iteratively update these approximations as they process more data. In shared clusters, however, these systems waste resources by directing resources to queries that are no longer improving the results given to users. We describe ReLAQS, a cluster scheduling system for online aggregation queries that aims to reduce latency by assigning resources to queries with the most potential for improvement. ReLAQS utilizes the approximate results each query returns to periodically estimate how much progress each concurrent query is currently making. It then uses this information to predict how much progress each query is expected to make in the near future and redistributes resources in real-time to maximize the overall quality of the answers returned across the cluster. Experiments show that ReLAQS achieves a reduction in latency of up to 47% compared to traditional fair schedulers.

Original languageEnglish (US)
Title of host publicationMiddleware 2019 - Proceedings of the 2019 20th International Middleware Conference
PublisherAssociation for Computing Machinery
Pages280-292
Number of pages13
ISBN (Electronic)9781450370097
DOIs
StatePublished - Dec 9 2019
Event20th ACM/IFIP/USENIX Middleware Conference, Middleware 2019 - Davis, United States
Duration: Dec 9 2019Dec 13 2019

Publication series

NameMiddleware 2019 - Proceedings of the 2019 20th International Middleware Conference
Volume2019-January

Conference

Conference20th ACM/IFIP/USENIX Middleware Conference, Middleware 2019
Country/TerritoryUnited States
CityDavis
Period12/9/1912/13/19

All Science Journal Classification (ASJC) codes

  • Software

Keywords

  • approximate computing
  • scheduling
  • utility-aware scheduling

Fingerprint

Dive into the research topics of 'ReLAQS: Reducing Latency for Multi-Tenant Approximate Queries via Scheduling'. Together they form a unique fingerprint.

Cite this