TY - JOUR
T1 - DiffSG
T2 - A Generative Solver for Network Optimization with Diffusion Model
AU - Liang, Ruihuai
AU - Yang, Bo
AU - Yu, Zhiwen
AU - Guo, Bin
AU - Cao, Xuelin
AU - Debbah, Merouane
AU - Poor, H. Vincent
AU - Yuen, Chau
N1 - Publisher Copyright:
© 1979-2012 IEEE.
PY - 2025
Y1 - 2025
N2 - Generative diffusion models, famous for their performance in image generation, are useful in various cross-domain applications. However, their use in the communication community has been mostly limited to auxiliary tasks like data modeling and feature extraction. These models hold greater promise for fundamental problems in network optimization compared to traditional machine learning methods. Discriminative deep learning often falls short due to its single-step input-output mapping and lack of global awareness of the solution space, especially given the complexity of network optimization's objective functions. In contrast, generative diffusion models can consider a broader range of solutions and exhibit stronger generalization by learning parameters that describe the distribution of the underlying solution space, with higher probabilities assigned to better solutions. We propose a new framework, diffusion model-based solution generation (DiffSG), which leverages the intrinsic distribution learning capabilities of generative diffusion models to learn high-quality solution distributions based on given inputs. The optimal solution within this distribution is highly probable, allowing it to be effectively reached through repeated sampling. We validate the performance of DiffSG on several typical network optimization problems, including mixed-integer non-linear programming, convex optimization, and hierarchical non-convex optimization. Our results demonstrate that DiffSG outperforms existing baseline methods not only on in-domain inputs but also on out-of-domain inputs. In summary, we demonstrate the potential of generative diffusion models in tackling complex network optimization problems and outline a promising path for their broader application in the communication community.
AB - Generative diffusion models, famous for their performance in image generation, are useful in various cross-domain applications. However, their use in the communication community has been mostly limited to auxiliary tasks like data modeling and feature extraction. These models hold greater promise for fundamental problems in network optimization compared to traditional machine learning methods. Discriminative deep learning often falls short due to its single-step input-output mapping and lack of global awareness of the solution space, especially given the complexity of network optimization's objective functions. In contrast, generative diffusion models can consider a broader range of solutions and exhibit stronger generalization by learning parameters that describe the distribution of the underlying solution space, with higher probabilities assigned to better solutions. We propose a new framework, diffusion model-based solution generation (DiffSG), which leverages the intrinsic distribution learning capabilities of generative diffusion models to learn high-quality solution distributions based on given inputs. The optimal solution within this distribution is highly probable, allowing it to be effectively reached through repeated sampling. We validate the performance of DiffSG on several typical network optimization problems, including mixed-integer non-linear programming, convex optimization, and hierarchical non-convex optimization. Our results demonstrate that DiffSG outperforms existing baseline methods not only on in-domain inputs but also on out-of-domain inputs. In summary, we demonstrate the potential of generative diffusion models in tackling complex network optimization problems and outline a promising path for their broader application in the communication community.
UR - http://www.scopus.com/inward/record.url?scp=105007290254&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=105007290254&partnerID=8YFLogxK
U2 - 10.1109/MCOM.001.2400428
DO - 10.1109/MCOM.001.2400428
M3 - Article
AN - SCOPUS:105007290254
SN - 0163-6804
VL - 63
SP - 16
EP - 24
JO - IEEE Communications Magazine
JF - IEEE Communications Magazine
IS - 6
ER -