TY - GEN
T1 - Rapid mixing of Gibbs sampling on graphs that are sparse on average
AU - Mossel, Elchanan
AU - Sly, Allan
PY - 2008
Y1 - 2008
N2 - Gibbs sampling also known as Glauber dynamics is a popular technique for sampling high dimensional distributions defined on graphs. Of special interest is the behavior of Gibbs sampling on the Erdos-Renyi random graph G(n,d/n), where each edge is chosen independently with probability d/n and d is fixed. While the average degree in G(n,d/n) is d(1-0(1)), it contains many nodes of degree of order log n/log log n. The existence of nodes of almost logarithmic degrees implies that for many natural distributions defined on G(n,p) such as uniform coloring (with a constant number of colors) or the lsing model at any fixed inverse temperature β, the mixing time of Gibbs sampling is at least n 1+Ω(1/log log n) Recall that the lsing model with inverse temperature β defined on a graph G = (V, E) is the distribution over {±} v given by P(σ) = 1/z exp(β Σ (v,v)∈Eσ(v)σ(v)). High degree nodes pose a technical challenge in proving polynomial time mixing of the dynamics for many models including the Ising model and coloring. Almost all known sufficient conditions in terms of β or number of colors needed for rapid mixing of Gibbs samplers are stated in terms of the maximum degree of the underlying graph. In this work we show that for every d < ∞ and the Ising model defined on G(n, d/n), there exists a β d> 0, such that for all β < β d with probability going to 1 as n → ∞, the mixing time of the dynamics on G(n,d/n) is polynomial in n. Our results are the first polynomial time mixing results proven for a natural model on G(n, d/n) for d 7gt; 1 where the parameters of the model do not depend on n. They also provide a rare example where one can prove a polynomial time mixing of Gibbs sampler in a situation where the actual mixing time is slower than npolylog(n). Our proof exploits in novel ways the local treelike structure of Erdös-Rényi random graphs, comparison and block dynamics arguments and a recent result of Weitz. Our results extend to much more general families of graphs which are sparse in some average sense and to much more general interactions. In particular, they apply to any graph for which every vertex v of the graph has a neighborhood N(v) of radius O(log n) in which the induced sub-graph is a tree union at most O(log n) edges and where for each simple path in N(v) the sum of the vertex degrees along the path is O(logn). Moreover, our result apply also in the case of arbitrary external fields and provide the first FPRAS for sampling the lsing distribution in this case. We finally present a non Markov Chain algorithm for sampling the distribution which is effective for a wider range of parameters. In particular, for G(n,d/n) it applies for all external fields and β < β d, where d tanh (β d) = 1 is the critical point for decay of correlation for the Ising model on G(n, d/n).
AB - Gibbs sampling also known as Glauber dynamics is a popular technique for sampling high dimensional distributions defined on graphs. Of special interest is the behavior of Gibbs sampling on the Erdos-Renyi random graph G(n,d/n), where each edge is chosen independently with probability d/n and d is fixed. While the average degree in G(n,d/n) is d(1-0(1)), it contains many nodes of degree of order log n/log log n. The existence of nodes of almost logarithmic degrees implies that for many natural distributions defined on G(n,p) such as uniform coloring (with a constant number of colors) or the lsing model at any fixed inverse temperature β, the mixing time of Gibbs sampling is at least n 1+Ω(1/log log n) Recall that the lsing model with inverse temperature β defined on a graph G = (V, E) is the distribution over {±} v given by P(σ) = 1/z exp(β Σ (v,v)∈Eσ(v)σ(v)). High degree nodes pose a technical challenge in proving polynomial time mixing of the dynamics for many models including the Ising model and coloring. Almost all known sufficient conditions in terms of β or number of colors needed for rapid mixing of Gibbs samplers are stated in terms of the maximum degree of the underlying graph. In this work we show that for every d < ∞ and the Ising model defined on G(n, d/n), there exists a β d> 0, such that for all β < β d with probability going to 1 as n → ∞, the mixing time of the dynamics on G(n,d/n) is polynomial in n. Our results are the first polynomial time mixing results proven for a natural model on G(n, d/n) for d 7gt; 1 where the parameters of the model do not depend on n. They also provide a rare example where one can prove a polynomial time mixing of Gibbs sampler in a situation where the actual mixing time is slower than npolylog(n). Our proof exploits in novel ways the local treelike structure of Erdös-Rényi random graphs, comparison and block dynamics arguments and a recent result of Weitz. Our results extend to much more general families of graphs which are sparse in some average sense and to much more general interactions. In particular, they apply to any graph for which every vertex v of the graph has a neighborhood N(v) of radius O(log n) in which the induced sub-graph is a tree union at most O(log n) edges and where for each simple path in N(v) the sum of the vertex degrees along the path is O(logn). Moreover, our result apply also in the case of arbitrary external fields and provide the first FPRAS for sampling the lsing distribution in this case. We finally present a non Markov Chain algorithm for sampling the distribution which is effective for a wider range of parameters. In particular, for G(n,d/n) it applies for all external fields and β < β d, where d tanh (β d) = 1 is the critical point for decay of correlation for the Ising model on G(n, d/n).
KW - Erdös-Rényi random graphs
KW - Gibbs samplers
KW - Glauber dynamics
KW - Ising model
KW - mixing time
UR - http://www.scopus.com/inward/record.url?scp=58449101641&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=58449101641&partnerID=8YFLogxK
M3 - Conference contribution
AN - SCOPUS:58449101641
SN - 9780898716474
T3 - Proceedings of the Annual ACM-SIAM Symposium on Discrete Algorithms
SP - 238
EP - 247
BT - Proceedings of the 19th Annual ACM-SIAM Symposium on Discrete Algorithms
T2 - 19th Annual ACM-SIAM Symposium on Discrete Algorithms
Y2 - 20 January 2008 through 22 January 2008
ER -