Random Orthogonalization for Private Wireless Federated Learning

Sadaf Ul Zuhra, Mohamed Seif, Karim Banawan, H. Vincent Poor

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

We consider the problem of private wireless feder-ated learning through a massive MIMO multiple-access channel (MAC). In this problem, a parameter server (PS) having M antennas needs to train a global machine learning model with the aid of K single-antenna users. Each user trains a local model to update the PS's global model without leaking information about the user's local model. By harnessing the additive nature of the MAC, the PS aggregates the local updates and updates the global model. We show that by adopting the random orthogonalization technique and careful noise injection by the users, maintaining the privacy of local models is possible under local differential privacy metrics without sacrificing the accuracy/convergence rate of the global machine learning model. We derive the exact achievable privacy level. Our results show that the privacy level is a function of the channel gains. We substantiate our findings by carrying out a standard classification task, which achieves an accuracy of 89% in less than 15 communication rounds while maintaining an acceptable privacy level of the users' local models. Moreover, numerical results show that the privacy leakage is decreasing in the number of users K, while it is increasing in the number of antennas at the PS M.

Original languageEnglish (US)
Title of host publicationConference Record of the 57th Asilomar Conference on Signals, Systems and Computers, ACSSC 2023
EditorsMichael B. Matthews
PublisherIEEE Computer Society
Pages233-236
Number of pages4
ISBN (Electronic)9798350325744
DOIs
StatePublished - 2023
Externally publishedYes
Event57th Asilomar Conference on Signals, Systems and Computers, ACSSC 2023 - Pacific Grove, United States
Duration: Oct 29 2023Nov 1 2023

Publication series

NameConference Record - Asilomar Conference on Signals, Systems and Computers
ISSN (Print)1058-6393

Conference

Conference57th Asilomar Conference on Signals, Systems and Computers, ACSSC 2023
Country/TerritoryUnited States
CityPacific Grove
Period10/29/2311/1/23

All Science Journal Classification (ASJC) codes

  • Signal Processing
  • Computer Networks and Communications

Fingerprint

Dive into the research topics of 'Random Orthogonalization for Private Wireless Federated Learning'. Together they form a unique fingerprint.

Cite this