TY - JOUR
T1 - Toward Ambient Intelligence
T2 - Federated Edge Learning With Task-Oriented Sensing, Computation, and Communication Integration
AU - Liu, Peixi
AU - Zhu, Guangxu
AU - Wang, Shuai
AU - Jiang, Wei
AU - Luo, Wu
AU - Poor, H. Vincent
AU - Cui, Shuguang
N1 - Funding Information:
The work was supported in part by the National Key R&D Program of China under Grant 2018YFB1800800, in part by the Basic Research Project under Grant HZQB-KCZYZ-2021067, in part by the Hetao Shenzhen- HK S&T Cooperation Zone, in part by the National Natural Science Foundation of China under Grants 62001310 and 62001203, in part by the Guangdong Provincial Key Laboratory of Future Networks of Intelligence under Grant 2022B1212010001, in part by theGuangdong Basic and Applied BasicResearch Foundation under Grants 2022A1515010109 and 2021B1515120067, in part by the ShenzhenKey Laboratory of BigData andArtificial Intelligence underGrant ZDSYS201707251409055, and in part by the U.S. National Science Foundation under Grant CNS-2128448.
Publisher Copyright:
© 2007-2012 IEEE.
PY - 2023/1/1
Y1 - 2023/1/1
N2 - With the breakthroughs in deep learning and contactless sensors, the recent years have witnessed a rise of ambient intelligence applications and services, spanning from healthcare delivery to intelligent home. Federated edge learning (FEEL), as a privacy-enhancing paradigm of collaborative learning at the network edge, is expected to be the core engine to achieve ambient intelligence. Sensing, computation, and communication (SC2) are highly coupled processes in FEEL and need to be jointly designed in a task-oriented manner to achieve the best FEEL performance under stringent resource constraints at edge devices. However, this remains an open problem as there is a lack of theoretical understanding on how the SC2 resources jointly affect the FEEL performance. In this paper, we address the problem of joint SC2 resource allocation for FEEL via a concrete case study of human motion recognition based on wireless sensing in ambient intelligence. First, by analyzing the wireless sensing process in human motion recognition, we find that there exists a thresholding value for the sensing transmit power, exceeding which yields sensing data samples with approximately the same satisfactory quality. Then, the joint SC2 resource allocation problem is cast to maximize the convergence speed of FEEL, under the constraints on training time, energy supply, and sensing quality of each edge device. Solving this problem entails solving two subproblems in order: the first one reduces to determine the joint sensing and communication resource allocation that maximizes the total number of samples that can be sensed during the entire training process; the second one concerns the partition of the attained total number of sensed samples over all the communication rounds to determine the batch size at each round for convergence speed maximization. The first subproblem on joint sensing and communication resource allocation is converted to a single-variable optimization problem by exploiting the derived relation between different control variables (resources), which thus allows an efficient solution via one-dimensional grid search. For the second subproblem, it is found that the number of samples to be sensed (or batch size) at each round is a decreasing function of the loss function value attained at the round. Based on this relationship, the approximate optimal batch size at each communication round is derived in closed-form as a function of the round index. Finally, extensive simulation results are provided to validate the superiority of the proposed joint SC2 resource allocation scheme over baseline schemes in terms of FEEL performance.
AB - With the breakthroughs in deep learning and contactless sensors, the recent years have witnessed a rise of ambient intelligence applications and services, spanning from healthcare delivery to intelligent home. Federated edge learning (FEEL), as a privacy-enhancing paradigm of collaborative learning at the network edge, is expected to be the core engine to achieve ambient intelligence. Sensing, computation, and communication (SC2) are highly coupled processes in FEEL and need to be jointly designed in a task-oriented manner to achieve the best FEEL performance under stringent resource constraints at edge devices. However, this remains an open problem as there is a lack of theoretical understanding on how the SC2 resources jointly affect the FEEL performance. In this paper, we address the problem of joint SC2 resource allocation for FEEL via a concrete case study of human motion recognition based on wireless sensing in ambient intelligence. First, by analyzing the wireless sensing process in human motion recognition, we find that there exists a thresholding value for the sensing transmit power, exceeding which yields sensing data samples with approximately the same satisfactory quality. Then, the joint SC2 resource allocation problem is cast to maximize the convergence speed of FEEL, under the constraints on training time, energy supply, and sensing quality of each edge device. Solving this problem entails solving two subproblems in order: the first one reduces to determine the joint sensing and communication resource allocation that maximizes the total number of samples that can be sensed during the entire training process; the second one concerns the partition of the attained total number of sensed samples over all the communication rounds to determine the batch size at each round for convergence speed maximization. The first subproblem on joint sensing and communication resource allocation is converted to a single-variable optimization problem by exploiting the derived relation between different control variables (resources), which thus allows an efficient solution via one-dimensional grid search. For the second subproblem, it is found that the number of samples to be sensed (or batch size) at each round is a decreasing function of the loss function value attained at the round. Based on this relationship, the approximate optimal batch size at each communication round is derived in closed-form as a function of the round index. Finally, extensive simulation results are provided to validate the superiority of the proposed joint SC2 resource allocation scheme over baseline schemes in terms of FEEL performance.
KW - Ambient intelligence
KW - federated edge learning
KW - integrated sensing and communication
KW - sensing-computation-communication resource allocation
UR - http://www.scopus.com/inward/record.url?scp=85144761587&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85144761587&partnerID=8YFLogxK
U2 - 10.1109/JSTSP.2022.3226836
DO - 10.1109/JSTSP.2022.3226836
M3 - Article
AN - SCOPUS:85144761587
SN - 1932-4553
VL - 17
SP - 158
EP - 172
JO - IEEE Journal on Selected Topics in Signal Processing
JF - IEEE Journal on Selected Topics in Signal Processing
IS - 1
ER -