Energy-Efficient Connectivity-Aware Learning Over Time-Varying D2D Networks

Rohit Parasnis, Seyyedali Hosseinalipour, Yun Wei Chu, Mung Chiang, Christopher G. Brinton

Research output: Contribution to journalArticlepeer-review

Abstract

Semi-decentralized federated learning blends the conventional device-to-server (D2S) interaction structure of federated model training with localized device-to-device (D2D) communications. We study this architecture over edge networks with multiple D2D clusters modeled as time-varying and directed communication graphs. Our investigation results in two algorithms: (a) a <italic>connectivity-aware</italic> learning algorithm that controls the fundamental trade-off between the convergence rate of the model training process and the number of energy-intensive D2S transmissions required for global aggregation, and (b) a <italic>motion-planning</italic> algorithm to enhance the densities and regularity levels of cluster digraphs so as to further reduce the number of D2S transmissions in connectivity-aware learning. Specifically, in our semi-decentralized methodology, weighted-averaging-based D2D updates are injected into the federated averaging framework based on column-stochastic weight matrices that encapsulate the connectivity within the clusters. To develop our algorithm, we show how the current expected optimality gap (i.e., the distance between the most recent global model computed by the server and the target/desired optimal model) depends on the greatest two singular values of the weighted adjacency matrices (and hence on the densities and degrees of digraph regularity) of the D2D clusters. We then derive tight bounds on these singular values in terms of the node degrees of the D2D clusters, and we use the resulting expressions to design our connectivity-aware learning algorithm. Simulations performed using real-world datasets and Random Direction Mobility Model (RDMM)-based time-varying D2D topologies reveal that our connectivity-aware algorithm significantly reduces the total communication energy required to reach a target accuracy level compared with baselines while achieving the accuracy level in nearly the same number of iterations as these baselines.

Original languageEnglish (US)
Pages (from-to)1-16
Number of pages16
JournalIEEE Journal on Selected Topics in Signal Processing
DOIs
StateAccepted/In press - 2024
Externally publishedYes

All Science Journal Classification (ASJC) codes

  • Signal Processing
  • Electrical and Electronic Engineering

Keywords

  • Clustering algorithms
  • Connectivity
  • Device-to-device communication
  • Energy efficiency
  • Servers
  • Signal processing algorithms
  • Topology
  • Training
  • energy efficiency
  • federated learning
  • semi-decentralized

Fingerprint

Dive into the research topics of 'Energy-Efficient Connectivity-Aware Learning Over Time-Varying D2D Networks'. Together they form a unique fingerprint.

Cite this