AoI Minimization for UAV-to-Device Underlay Communication by Multi-agent Deep Reinforcement Learning

Fanyi Wu, Hongliang Zhang, Jianjun Wu, Lingyang Song, Zhu Han, H. Vincent Poor

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

In this paper, we consider a cellular Internet of UAVs, where the sensory data can be transmitted either to the base station via cellular links, or to the mobile devices by underlay UAV-to-Device communications. To evaluate the freshness of the sensory data, the age of information (AoI) is adopted, in which a lower AoI implies fresher data. Since UAVs' AoIs are determined by their trajectories during sensing and transmission, we aim to minimize the AoIs of UAVs by designing their trajectories. This problem is a Markov decision problem with an infinite state-action space, and thus, we propose a multi-UAV trajectory design algorithm by leveraging multi-agent deep reinforcement learning to solve it. Simulation results show that our proposed algorithm outperforms both a greedy algorithm and a policy gradient algorithm.

Original languageEnglish (US)
Title of host publication2020 IEEE Global Communications Conference, GLOBECOM 2020 - Proceedings
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781728182988
DOIs
StatePublished - Dec 2020
Event2020 IEEE Global Communications Conference, GLOBECOM 2020 - Virtual, Taipei, Taiwan, Province of China
Duration: Dec 7 2020Dec 11 2020

Publication series

Name2020 IEEE Global Communications Conference, GLOBECOM 2020 - Proceedings

Conference

Conference2020 IEEE Global Communications Conference, GLOBECOM 2020
CountryTaiwan, Province of China
CityVirtual, Taipei
Period12/7/2012/11/20

All Science Journal Classification (ASJC) codes

  • Media Technology
  • Modeling and Simulation
  • Instrumentation
  • Artificial Intelligence
  • Computer Networks and Communications
  • Hardware and Architecture
  • Software
  • Safety, Risk, Reliability and Quality

Keywords

  • UAV-to-Device communication
  • cellular Internet of UAVs
  • multi-agent deep reinforcement learning

Fingerprint Dive into the research topics of 'AoI Minimization for UAV-to-Device Underlay Communication by Multi-agent Deep Reinforcement Learning'. Together they form a unique fingerprint.

Cite this