TY - GEN
T1 - Crossing the logarithmic barrier for dynamic boolean data structure lower bounds
AU - Green Larsen, Kasper
AU - Weinstein, Omri
AU - Yu, Huacheng
N1 - Funding Information:
∗Department of Computer Science, Aarhus University. Supported by MADALGO, grant DNRF84, a Villum Young Investigator Grant and an AUFF Starting Grant. †Department of Computer Science, Columbia University. ‡Department of Computer Science, Stanford University. Supported by NSF CCF-1212372.
Publisher Copyright:
© 2018 IEEE.
PY - 2018/10/23
Y1 - 2018/10/23
N2 - This paper proves the first super-logarithmic lower bounds on the cell probe complexity of dynamic boolean (a.k.a. decision) data structure problems, a long-standing milestone in data structure lower bounds. We introduce a new method for proving dynamic cell probe lower bounds and use it to prove a Ω(lg1.5n) lower bound on the operational time of a wide range of boolean data structure problems, most notably, on the query time of dynamic range counting over F2 ([Pat07]). Proving an ω(lg n) lower bound for this problem was explicitly posed as one of five important open problems in the late Mihai Pǎtraşcu's obituary [Tho13]. This result also implies the first ω(lg n) lower bound for the classical 2D range counting problem, one of the most fundamental data structure problems in computational geometry and spatial databases. We derive similar lower bounds for boolean versions of dynamic polynomial evaluation and 2D rectangle stabbing, and for the (non-boolean) problems of range selection and range median. Our technical centerpiece is a new way of 'weakly' simulating dynamic data structures using efficient one-way communication protocols with small advantage over random guessing. This simulation involves a surprising excursion to low-degree (Chebychev) polynomials which may be of independent interest, and offers an entirely new algorithmic angle on the 'cell sampling' method of Panigrahy et al. [PTW10].
AB - This paper proves the first super-logarithmic lower bounds on the cell probe complexity of dynamic boolean (a.k.a. decision) data structure problems, a long-standing milestone in data structure lower bounds. We introduce a new method for proving dynamic cell probe lower bounds and use it to prove a Ω(lg1.5n) lower bound on the operational time of a wide range of boolean data structure problems, most notably, on the query time of dynamic range counting over F2 ([Pat07]). Proving an ω(lg n) lower bound for this problem was explicitly posed as one of five important open problems in the late Mihai Pǎtraşcu's obituary [Tho13]. This result also implies the first ω(lg n) lower bound for the classical 2D range counting problem, one of the most fundamental data structure problems in computational geometry and spatial databases. We derive similar lower bounds for boolean versions of dynamic polynomial evaluation and 2D rectangle stabbing, and for the (non-boolean) problems of range selection and range median. Our technical centerpiece is a new way of 'weakly' simulating dynamic data structures using efficient one-way communication protocols with small advantage over random guessing. This simulation involves a surprising excursion to low-degree (Chebychev) polynomials which may be of independent interest, and offers an entirely new algorithmic angle on the 'cell sampling' method of Panigrahy et al. [PTW10].
UR - http://www.scopus.com/inward/record.url?scp=85057241994&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85057241994&partnerID=8YFLogxK
U2 - 10.1109/ITA.2018.8503262
DO - 10.1109/ITA.2018.8503262
M3 - Conference contribution
AN - SCOPUS:85057241994
T3 - 2018 Information Theory and Applications Workshop, ITA 2018
BT - 2018 Information Theory and Applications Workshop, ITA 2018
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 2018 Information Theory and Applications Workshop, ITA 2018
Y2 - 11 February 2018 through 16 February 2018
ER -