TY - JOUR
T1 - Guest Editorial Communication-Efficient Distributed Learning Over Networks
AU - Cao, Xuanyu
AU - Basar, Tamer
AU - Diggavi, Suhas
AU - Eldar, Yonina C.
AU - Letaief, Khaled B.
AU - Poor, H. Vincent
AU - Zhang, Junshan
N1 - Publisher Copyright:
© 1983-2012 IEEE.
PY - 2023/4/1
Y1 - 2023/4/1
N2 - Distributed machine learning is envisioned as the bedrock of future intelligent networks, where agents exchange information with each other to train models collaboratively without uploading data to a central processor. Despite its broad applicability, a downside of distributed learning is the need for iterative information exchange between agents, which may lead to high communication overhead unaffordable in many practical systems with limited communication resources. To resolve this communication bottleneck, we need to devise communication-efficient distributed learning algorithms and protocols that can reduce the communication cost and simultaneously achieve satisfactory learning/optimization performance. Accomplishing this goal necessitates synergistic techniques from a diverse set of fields, including optimization, machine learning, wireless communications, game theory, and network/graph theory. This Special Issue is dedicated to communication-efficient distributed learning from multiple perspectives, including fundamental theories, algorithm design and analysis, and practical considerations.
AB - Distributed machine learning is envisioned as the bedrock of future intelligent networks, where agents exchange information with each other to train models collaboratively without uploading data to a central processor. Despite its broad applicability, a downside of distributed learning is the need for iterative information exchange between agents, which may lead to high communication overhead unaffordable in many practical systems with limited communication resources. To resolve this communication bottleneck, we need to devise communication-efficient distributed learning algorithms and protocols that can reduce the communication cost and simultaneously achieve satisfactory learning/optimization performance. Accomplishing this goal necessitates synergistic techniques from a diverse set of fields, including optimization, machine learning, wireless communications, game theory, and network/graph theory. This Special Issue is dedicated to communication-efficient distributed learning from multiple perspectives, including fundamental theories, algorithm design and analysis, and practical considerations.
UR - http://www.scopus.com/inward/record.url?scp=85151141628&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85151141628&partnerID=8YFLogxK
U2 - 10.1109/JSAC.2023.3241848
DO - 10.1109/JSAC.2023.3241848
M3 - Review article
AN - SCOPUS:85151141628
SN - 0733-8716
VL - 41
SP - 845
EP - 850
JO - IEEE Journal on Selected Areas in Communications
JF - IEEE Journal on Selected Areas in Communications
IS - 4
ER -