Semi-Data-Aided Channel Estimation for MIMO Systems via Reinforcement Learning

Tae Kyoung Kim, Yo Seb Jeon, Jun Li, Nima Tavangaran, H. Vincent Poor

Research output: Contribution to journalArticlepeer-review

6 Scopus citations

Abstract

Data-aided channel estimation is a promising solution to improve channel estimation accuracy by exploiting data symbols as pilot signals for updating an initial channel estimate. In this paper, we propose a semi-data-aided channel estimator for multiple-input multiple-output communication systems. Our strategy is to leverage reinforcement learning (RL) for selecting reliable detected symbols, then update the channel estimate by utilizing only the selected symbols as additional pilot signals. Towards this end, we first define a Markov decision process (MDP) which sequentially decides whether to use each detected symbol as an additional pilot signal. We then develop an RL algorithm to find an effective policy of the MDP based on a Monte Carlo tree search approach. In this algorithm, we exploit the a-posteriori probability for approximating both the optimal future actions and the corresponding state transitions of the MDP and derive a closed-form expression for the optimal policy under the approximations. A key advantage of the proposed channel estimator is that it requires less computational complexity than conventional iterative data-aided channel estimators. Simulation results demonstrate that the proposed channel estimator effectively mitigates both channel estimation error and detection performance loss caused by insufficient pilot signals.

Original languageEnglish (US)
Pages (from-to)4565-4579
Number of pages15
JournalIEEE Transactions on Wireless Communications
Volume22
Issue number7
DOIs
StatePublished - Jul 1 2023
Externally publishedYes

All Science Journal Classification (ASJC) codes

  • Computer Science Applications
  • Electrical and Electronic Engineering
  • Applied Mathematics

Keywords

  • Monte Carlo tree search
  • Multiple-input multiple-output (MIMO)
  • channel estimation
  • data-aided channel estimation
  • reinforcement learning

Fingerprint

Dive into the research topics of 'Semi-Data-Aided Channel Estimation for MIMO Systems via Reinforcement Learning'. Together they form a unique fingerprint.

Cite this