TY - GEN
T1 - Reinforcement learning based QoS-provisioning over energy-harvesting 5G wireless Ad-Hoc networks
AU - Zhang, Xi
AU - Wang, Jingqing
AU - Poor, H. Vincent
PY - 2019/12
Y1 - 2019/12
N2 - To support the delay-bounded multimedia services for 5G mobile wireless networks, the statistical quality-of-service (QoS) technique has been developed to jointly guarantee statistically delay-bounded video transmissions over different timevarying wireless channels, simultaneously. On the other hand, as one of the 5G promising candidate techniques, energy harvesting (EH) is designed to solve the energy supply problem while bringing new challenges due to the stochastic nature of the harvested energy in supporting the heterogeneous statistical delay-bounded QoS provisionings. However, due to the unknown dynamics of the distributions for energy and data arrival processes, it is challenging to design the optimal EH and resource allocation policies under the heterogeneous statistical delay-bounded QoS constraints. Towards this end, the reinforcement learning algorithms have been designed to find the optimal EH and resource allocation policies by allowing the mobile users to learn from the different network states and historical behaviors until the optimal response set is reached. To overcome the aforementioned problems, in this paper we propose the learning based algorithm for designing the optimal EH and resource allocation policies while satisfying the heterogeneous statistical delay-bounded QoS constraints over EH based 5G mobile wireless networks. In particular, we establish the EH based system model. Under the heterogeneous statistical delay-bounded QoS requirements, we formulate the effective-capacity optimization problem over EH based 5G mobile wireless networks. Then, we apply the learning based EH algorithm for deriving the optimal resource allocation policy. Also conducted is a set of simulations which validate and evaluate the system performances and show that our proposed learning based EH scheme outperforms the other existing schemes under the heterogeneous statistical delay-bounded QoS constraints over 5G mobile wireless networks.
AB - To support the delay-bounded multimedia services for 5G mobile wireless networks, the statistical quality-of-service (QoS) technique has been developed to jointly guarantee statistically delay-bounded video transmissions over different timevarying wireless channels, simultaneously. On the other hand, as one of the 5G promising candidate techniques, energy harvesting (EH) is designed to solve the energy supply problem while bringing new challenges due to the stochastic nature of the harvested energy in supporting the heterogeneous statistical delay-bounded QoS provisionings. However, due to the unknown dynamics of the distributions for energy and data arrival processes, it is challenging to design the optimal EH and resource allocation policies under the heterogeneous statistical delay-bounded QoS constraints. Towards this end, the reinforcement learning algorithms have been designed to find the optimal EH and resource allocation policies by allowing the mobile users to learn from the different network states and historical behaviors until the optimal response set is reached. To overcome the aforementioned problems, in this paper we propose the learning based algorithm for designing the optimal EH and resource allocation policies while satisfying the heterogeneous statistical delay-bounded QoS constraints over EH based 5G mobile wireless networks. In particular, we establish the EH based system model. Under the heterogeneous statistical delay-bounded QoS requirements, we formulate the effective-capacity optimization problem over EH based 5G mobile wireless networks. Then, we apply the learning based EH algorithm for deriving the optimal resource allocation policy. Also conducted is a set of simulations which validate and evaluate the system performances and show that our proposed learning based EH scheme outperforms the other existing schemes under the heterogeneous statistical delay-bounded QoS constraints over 5G mobile wireless networks.
KW - 5G wireless ad-hoc networks
KW - Effective capacity
KW - Energy harvesting (EH)
KW - QoS
KW - Reinforcement Learning
UR - http://www.scopus.com/inward/record.url?scp=85081957218&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85081957218&partnerID=8YFLogxK
U2 - 10.1109/GLOBECOM38437.2019.9014116
DO - 10.1109/GLOBECOM38437.2019.9014116
M3 - Conference contribution
T3 - 2019 IEEE Global Communications Conference, GLOBECOM 2019 - Proceedings
BT - 2019 IEEE Global Communications Conference, GLOBECOM 2019 - Proceedings
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 2019 IEEE Global Communications Conference, GLOBECOM 2019
Y2 - 9 December 2019 through 13 December 2019
ER -