RIS-Assisted UAV Communications for IoT With Wireless Power Transfer Using Deep Reinforcement Learning

Khoi Khac Nguyen, Antonino Masaracchia, Vishal Sharma, H. Vincent Poor, Trung Q. Duong

Research output: Contribution to journalArticlepeer-review

48 Scopus citations

Abstract

Many of the devices used in Internet-of-Things (IoT) applications are energy-limited, and thus supplying energy while maintaining seamless connectivity for IoT devices is of considerable importance. In this context, we propose a simultaneous wireless power transfer and information transmission scheme for IoT devices with support from the reconfigurable intelligent surface (RIS)-aided unmanned aerial vehicle (UAV) communications. In particular, in the first phase, IoT devices harvest energy from the UAV through wireless power transfer; and then in the second phase, the UAV collects data from the IoT devices through information transmission. To characterise the agility of the UAV, we consider two scenarios: a hovering UAV and a mobile UAV. Aiming at maximising the total network sum-rate, we jointly optimise the trajectory and the power allocation of the UAV, the energy harvesting scheduling of IoT devices, and the phase-shift matrix of the RIS. We formulate a Markov decision process and propose two deep reinforcement learning algorithms to solve the optimisation problem of maximising the total network sum-rate. Numerical results illustrate the effectiveness of the UAV's flying path optimisation and the network's throughput of our proposed techniques compared with other benchmark schemes. Given the strict requirements of the RIS and UAV, the significant improvement in processing time and throughput performance demonstrates that our proposed scheme is well applicable for practical IoT applications.

Original languageEnglish (US)
Pages (from-to)1086-1096
Number of pages11
JournalIEEE Journal on Selected Topics in Signal Processing
Volume16
Issue number5
DOIs
StatePublished - Aug 1 2022

All Science Journal Classification (ASJC) codes

  • Signal Processing
  • Electrical and Electronic Engineering

Keywords

  • Internet-of-Things (IoT)
  • RIS
  • UAV
  • deep reinforcement learning
  • wireless power transfer

Fingerprint

Dive into the research topics of 'RIS-Assisted UAV Communications for IoT With Wireless Power Transfer Using Deep Reinforcement Learning'. Together they form a unique fingerprint.

Cite this