TY - JOUR
T1 - The optimal noise-adding mechanism in differential privacy
AU - Geng, Quan
AU - Viswanath, Pramod
N1 - Funding Information:
This work was supported in part by the National Science Foundation under Grant CCF-1422278 and in part by the University of Illinois at Urbana-Champaign. This paper was presented at the 2014 IEEE International Symposium on Information Theory. The authors thank Sachin Kadloor (UIUC) for helpful discussions, and thank Prof. Adam D. Smith (PSU) and Prof. Kamalika Chaudhuri (UCSD) for helpful comments on this work. They thank Chao Li (UMass) and Bing-Rong Lin (PSU) for pointing out the slides [55] by Soria-Comas and Domingo-Ferrer to us, where the same class of staircase mechanisms was presented under a different optimization framework. The related journal paper was published in [56]. They would like to thank the associate editor Dr. Adam Smith and the anonymous reviewers for their insightful comments and suggestions, which help us improve the presentation of this work.
Publisher Copyright:
© 2015 IEEE.
PY - 2016/2/1
Y1 - 2016/2/1
N2 - Differential privacy is a framework to quantify to what extent individual privacy in a statistical database is preserved while releasing useful aggregate information about the database. In this paper, within the classes of mechanisms oblivious of the database and the queries beyond the global sensitivity, we characterize the fundamental tradeoff between privacy and utility in differential privacy, and derive the optimal ∈-differentially private mechanism for a single realvalued query function under a very general utility-maximization (or cost-minimization) framework. The class of noise probability distributions in the optimal mechanism has staircase-shaped probability density functions which are symmetric (around the origin), monotonically decreasing and geometrically decaying. The staircase mechanism can be viewed as a geometric mixture of uniform probability distributions, providing a simple algorithmic description for the mechanism. Furthermore, the staircase mechanism naturally generalizes to discrete query output settings as well as more abstract settings. We explicitly derive the parameter of the optimal staircase mechanism for ℓ1 and ℓ2 cost functions. Comparing the optimal performances with those of the usual Laplacian mechanism, we show that in the high privacy regime (∈ is small), the Laplacian mechanism is asymptotically optimal as ∈ → 0; in the low privacy regime (∈ is large), the minimum magnitude and second moment of noise are Θ(Δe(-∈/2)) and Θ(Δ2e(-2∈/3)) as ∈ → +∞, respectively, while the corresponding figures when using the Laplacian mechanism are Δ/∈ and 2Δ2/∈2, where Δ is the sensitivity of the query function. We conclude that the gains of the staircase mechanism are more pronounced in the moderate-low privacy regime.
AB - Differential privacy is a framework to quantify to what extent individual privacy in a statistical database is preserved while releasing useful aggregate information about the database. In this paper, within the classes of mechanisms oblivious of the database and the queries beyond the global sensitivity, we characterize the fundamental tradeoff between privacy and utility in differential privacy, and derive the optimal ∈-differentially private mechanism for a single realvalued query function under a very general utility-maximization (or cost-minimization) framework. The class of noise probability distributions in the optimal mechanism has staircase-shaped probability density functions which are symmetric (around the origin), monotonically decreasing and geometrically decaying. The staircase mechanism can be viewed as a geometric mixture of uniform probability distributions, providing a simple algorithmic description for the mechanism. Furthermore, the staircase mechanism naturally generalizes to discrete query output settings as well as more abstract settings. We explicitly derive the parameter of the optimal staircase mechanism for ℓ1 and ℓ2 cost functions. Comparing the optimal performances with those of the usual Laplacian mechanism, we show that in the high privacy regime (∈ is small), the Laplacian mechanism is asymptotically optimal as ∈ → 0; in the low privacy regime (∈ is large), the minimum magnitude and second moment of noise are Θ(Δe(-∈/2)) and Θ(Δ2e(-2∈/3)) as ∈ → +∞, respectively, while the corresponding figures when using the Laplacian mechanism are Δ/∈ and 2Δ2/∈2, where Δ is the sensitivity of the query function. We conclude that the gains of the staircase mechanism are more pronounced in the moderate-low privacy regime.
KW - Data privacy
KW - Randomized algorithm
UR - http://www.scopus.com/inward/record.url?scp=84959378185&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=84959378185&partnerID=8YFLogxK
U2 - 10.1109/TIT.2015.2504967
DO - 10.1109/TIT.2015.2504967
M3 - Article
AN - SCOPUS:84959378185
SN - 0018-9448
VL - 62
SP - 925
EP - 951
JO - IRE Professional Group on Information Theory
JF - IRE Professional Group on Information Theory
IS - 2
M1 - 2504967
ER -