A Machine Learning Approach for Task and Resource Allocation in Mobile-Edge Computing-Based Networks

Sihua Wang, Mingzhe Chen, Xuanlin Liu, Changchuan Yin, Shuguang Cui, H. Vincent Poor

Research output: Contribution to journalArticlepeer-review

8 Scopus citations

Abstract

In this article, a joint task, spectrum, and transmit power allocation problem is investigated for a wireless network in which the base stations (BSs) are equipped with mobile-edge computing (MEC) servers to jointly provide computational and communication services to users. Each user can request one computational task from three types of computational tasks. Since the data size of each computational task is different, as the requested computational task varies, the BSs must adjust their resource (subcarrier and transmit power) and task allocation schemes to effectively serve the users. This problem is formulated as an optimization problem whose goal is to minimize the maximal computational and transmission delay among all users. A multistack reinforcement learning (RL) algorithm is developed to solve this problem. Using the proposed algorithm, each BS can record the historical resource allocation schemes and users' information in its multiple stacks to avoid learning the same resource allocation scheme and users' states, thus improving the convergence speed and learning efficiency. The simulation results illustrate that the proposed algorithm can reduce the number of iterations needed for convergence and the maximal delay among all users by up to 18% and 11.1% compared to the standard Q -learning algorithm.

Original languageEnglish (US)
Article number9146372
Pages (from-to)1358-1372
Number of pages15
JournalIEEE Internet of Things Journal
Volume8
Issue number3
DOIs
StatePublished - Feb 1 2021

All Science Journal Classification (ASJC) codes

  • Signal Processing
  • Information Systems
  • Hardware and Architecture
  • Computer Science Applications
  • Computer Networks and Communications

Keywords

  • Mobile-edge computing (MEC)
  • multistack reinforcementlearning (RL)
  • resource management

Fingerprint

Dive into the research topics of 'A Machine Learning Approach for Task and Resource Allocation in Mobile-Edge Computing-Based Networks'. Together they form a unique fingerprint.

Cite this