Intelligent User Association for Symbiotic Radio Networks Using Deep Reinforcement Learning

Qianqian Zhang, Ying Chang Liang, H. Vincent Poor

Research output: Contribution to journalArticle

Abstract

In this paper, we are interested in symbiotic radio networks (SRNs), in which an Internet-of-Things (IoT) network parasitizes in a primary cellular network to achieve spectrum-, energy-, and infrastructure-efficient communications. Each IoT device transmits its own information by backscattering the signals from the primary network without using active radio-frequency (RF) transmitter chain. We consider the symbiosis between the cellular network and the IoT network and focus on the user association problem in SRN. Specifically, the base station (BS) in the primary network serves multiple cellular users using time division multiple access (TDMA) and each IoT device is associated with one cellular user for information transmission. The objective of user association is to link each IoT device to an appropriate cellular user by maximizing the sum rate of all IoT devices. However, the difficulty in obtaining the full real-time channel information makes it difficult to design an optimal policy for this problem. To overcome this issue, we propose two deep reinforcement learning (DRL) algorithms, both use historical information to infer the current information in order to make appropriate decisions. One algorithm, referred to as centralized DRL, makes decisions for all IoT devices at one time with globally available information. The other algorithm, referred to as distributed DRL, makes a decision only for one IoT device at one time using locally available information. Finally, simulation results show that the two proposed DRL algorithms achieve performance comparable to the optimal user association policy which requires perfect real-time information, and the distributed DRL algorithm has the advantage of scalability.

Original languageEnglish (US)
Article number9058982
Pages (from-to)4535-4548
Number of pages14
JournalIEEE Transactions on Wireless Communications
Volume19
Issue number7
DOIs
StatePublished - Jul 2020

All Science Journal Classification (ASJC) codes

  • Computer Science Applications
  • Electrical and Electronic Engineering
  • Applied Mathematics

Keywords

  • Symbiotic radio network (SRN)
  • ambient backscatter communication (AmBC)
  • deep rein-forcement learning
  • user association

Fingerprint Dive into the research topics of 'Intelligent User Association for Symbiotic Radio Networks Using Deep Reinforcement Learning'. Together they form a unique fingerprint.

  • Cite this