TY - JOUR
T1 - Blind Federated Edge Learning
AU - Amiri, Mohammad Mohammadi
AU - Duman, Tolga M.
AU - Gunduz, Deniz
AU - Kulkarni, Sanjeev R.
AU - Poor, H. Vincent Poor
N1 - Funding Information:
Manuscript received October 19, 2020; revised December 30, 2020; accepted March 5, 2021. Date of publication March 19, 2021; date of current version August 12, 2021. This work was supported in part by the U.S. National Science Foundation under Grant CCF-0939370 and Grant CCF-1908308, in part by the European Research Council (ERC) Starting Grant BEACON under Grant 677854, and in part by CHIST-ERA-18-SDCDN-001 through U.K. EPSRC under Grant EP/T023600/1. This article was presented in part at the 2019 IEEE Global Conference on Signal and Information Processing (GlobalSIP), Ottawa, ON, Canada, November 2019. The associate editor coordinating the review of this article and approving it for publication was X. Cheng. (Corresponding author: Mohammad Mohammadi Amiri.) Mohammad Mohammadi Amiri, Sanjeev R. Kulkarni, and H. Vincent Poor are with the Department of Electrical Engineering, Princeton University, Princeton, NJ 08544 USA (e-mail: mamiri@princeton.edu; kulkarni@princeton.edu; poor@princeton.edu).
Publisher Copyright:
© 2002-2012 IEEE.
PY - 2021/8
Y1 - 2021/8
N2 - We study federated edge learning (FEEL), where wireless edge devices, each with its own dataset, learn a global model collaboratively with the help of a wireless access point acting as the parameter server (PS). At each iteration, wireless devices perform local updates using their local data and the most recent global model received from the PS, and send their local updates to the PS over a wireless fading multiple access channel (MAC). The PS then updates the global model according to the signal received over the wireless MAC, and shares it with the devices. Motivated by the additive nature of the wireless MAC, we propose an analog 'over-the-air' aggregation scheme, in which the devices transmit their local updates in an uncoded fashion. However, unlike recent literature on over-the-air FEEL, here we assume that the devices do not have channel state information (CSI), while the PS has imperfect CSI. On the other hand, the PS is equipped with multiple antennas to alleviate the destructive effect of the channel, exacerbated due to the lack of perfect CSI. We design a receive beamforming scheme at the PS, and show that it can compensate for the lack of perfect CSI when the PS has a sufficient number of antennas. We also derive the convergence rate of the proposed algorithm highlighting the impact of the lack of perfect CSI, as well as the number of PS antennas. Both the experimental results and the convergence analysis illustrate the performance improvement of the proposed algorithm with the number of PS antennas, where the wireless fading MAC becomes deterministic despite the lack of perfect CSI when the PS has a sufficiently large number of antennas.
AB - We study federated edge learning (FEEL), where wireless edge devices, each with its own dataset, learn a global model collaboratively with the help of a wireless access point acting as the parameter server (PS). At each iteration, wireless devices perform local updates using their local data and the most recent global model received from the PS, and send their local updates to the PS over a wireless fading multiple access channel (MAC). The PS then updates the global model according to the signal received over the wireless MAC, and shares it with the devices. Motivated by the additive nature of the wireless MAC, we propose an analog 'over-the-air' aggregation scheme, in which the devices transmit their local updates in an uncoded fashion. However, unlike recent literature on over-the-air FEEL, here we assume that the devices do not have channel state information (CSI), while the PS has imperfect CSI. On the other hand, the PS is equipped with multiple antennas to alleviate the destructive effect of the channel, exacerbated due to the lack of perfect CSI. We design a receive beamforming scheme at the PS, and show that it can compensate for the lack of perfect CSI when the PS has a sufficient number of antennas. We also derive the convergence rate of the proposed algorithm highlighting the impact of the lack of perfect CSI, as well as the number of PS antennas. Both the experimental results and the convergence analysis illustrate the performance improvement of the proposed algorithm with the number of PS antennas, where the wireless fading MAC becomes deterministic despite the lack of perfect CSI when the PS has a sufficiently large number of antennas.
KW - Federated edge learning
KW - blind transmitters
KW - fading multiple access channel
KW - multi-antenna parameter server
UR - http://www.scopus.com/inward/record.url?scp=85103295261&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85103295261&partnerID=8YFLogxK
U2 - 10.1109/TWC.2021.3065920
DO - 10.1109/TWC.2021.3065920
M3 - Article
AN - SCOPUS:85103295261
SN - 1536-1276
VL - 20
SP - 5129
EP - 5143
JO - IEEE Transactions on Wireless Communications
JF - IEEE Transactions on Wireless Communications
IS - 8
M1 - 9382114
ER -