Network-Aware Optimization of Distributed Learning for Fog Computing

Yuwei Tu, Yichen Ruan, Satyavrat Wagle, Christopher G. Brinton, Carlee Joe-Wong

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Fog computing promises to enable machine learning tasks to scale to large amounts of data by distributing processing across connected devices. Two key challenges to achieving this are (i) heterogeneity in devices' compute resources and (ii) topology constraints on which devices can communicate. We are the first to address these challenges by developing a network-aware distributed learning optimization methodology where devices process data for a task locally and send their learnt parameters to a server for aggregation at certain time intervals. Unlike traditional federated learning frameworks, our method enables devices to offload their data processing tasks, with these decisions determined through a convex data transfer optimization problem that trades off costs associated with devices processing, offloading, and discarding data points. We analytically characterize the optimal data transfer solution for different fog network topologies, showing for example that the value of a device offloading is approximately linear in the range of computing costs in the network. Our subsequent experiments on both synthetic and real-world datasets we collect confirm that our algorithms are able to improve network resource utilization substantially without sacrificing the accuracy of the learned model.

Original languageEnglish (US)
Title of host publicationINFOCOM 2020 - IEEE Conference on Computer Communications
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages2509-2518
Number of pages10
ISBN (Electronic)9781728164120
DOIs
StatePublished - Jul 2020
Event38th IEEE Conference on Computer Communications, INFOCOM 2020 - Toronto, Canada
Duration: Jul 6 2020Jul 9 2020

Publication series

NameProceedings - IEEE INFOCOM
Volume2020-July
ISSN (Print)0743-166X

Conference

Conference38th IEEE Conference on Computer Communications, INFOCOM 2020
CountryCanada
CityToronto
Period7/6/207/9/20

All Science Journal Classification (ASJC) codes

  • Computer Science(all)
  • Electrical and Electronic Engineering

Keywords

  • federated learning
  • fog computing
  • offloading

Fingerprint Dive into the research topics of 'Network-Aware Optimization of Distributed Learning for Fog Computing'. Together they form a unique fingerprint.

  • Cite this

    Tu, Y., Ruan, Y., Wagle, S., Brinton, C. G., & Joe-Wong, C. (2020). Network-Aware Optimization of Distributed Learning for Fog Computing. In INFOCOM 2020 - IEEE Conference on Computer Communications (pp. 2509-2518). [9155372] (Proceedings - IEEE INFOCOM; Vol. 2020-July). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/INFOCOM41043.2020.9155372