TY - GEN
T1 - ReLAQS
T2 - 20th ACM/IFIP/USENIX Middleware Conference, Middleware 2019
AU - Stafman, Logan
AU - Or, Andrew
AU - Freedman, Michael J.
N1 - Publisher Copyright:
© 2019 Copyright held by the owner/author(s).
PY - 2019/12/9
Y1 - 2019/12/9
N2 - Approximate Query Processing has become increasingly popular as larger data sizes have increased query latency in distributed query processing systems. To provide such approximate results, systems return intermediate results and iteratively update these approximations as they process more data. In shared clusters, however, these systems waste resources by directing resources to queries that are no longer improving the results given to users. We describe ReLAQS, a cluster scheduling system for online aggregation queries that aims to reduce latency by assigning resources to queries with the most potential for improvement. ReLAQS utilizes the approximate results each query returns to periodically estimate how much progress each concurrent query is currently making. It then uses this information to predict how much progress each query is expected to make in the near future and redistributes resources in real-time to maximize the overall quality of the answers returned across the cluster. Experiments show that ReLAQS achieves a reduction in latency of up to 47% compared to traditional fair schedulers.
AB - Approximate Query Processing has become increasingly popular as larger data sizes have increased query latency in distributed query processing systems. To provide such approximate results, systems return intermediate results and iteratively update these approximations as they process more data. In shared clusters, however, these systems waste resources by directing resources to queries that are no longer improving the results given to users. We describe ReLAQS, a cluster scheduling system for online aggregation queries that aims to reduce latency by assigning resources to queries with the most potential for improvement. ReLAQS utilizes the approximate results each query returns to periodically estimate how much progress each concurrent query is currently making. It then uses this information to predict how much progress each query is expected to make in the near future and redistributes resources in real-time to maximize the overall quality of the answers returned across the cluster. Experiments show that ReLAQS achieves a reduction in latency of up to 47% compared to traditional fair schedulers.
KW - approximate computing
KW - scheduling
KW - utility-aware scheduling
UR - http://www.scopus.com/inward/record.url?scp=85132017461&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85132017461&partnerID=8YFLogxK
U2 - 10.1145/3361525.3361553
DO - 10.1145/3361525.3361553
M3 - Conference contribution
AN - SCOPUS:85132017461
T3 - Middleware 2019 - Proceedings of the 2019 20th International Middleware Conference
SP - 280
EP - 292
BT - Middleware 2019 - Proceedings of the 2019 20th International Middleware Conference
PB - Association for Computing Machinery
Y2 - 9 December 2019 through 13 December 2019
ER -