Channel Estimation via Successive Denoising in MIMO OFDM Systems: A Reinforcement Learning Approach

Myeung Suk Oh, Seyyedali Hosseinalipour, Taejoon Kim, Christopher G. Brinton, David J. Love

Research output: Chapter in Book/Report/Conference proceedingConference contribution

11 Scopus citations


In general, reliable communication via multiple-input multiple-output (MIMO) orthogonal frequency division multiplexing (OFDM) requires accurate channel estimation at the receiver. The existing literature largely focuses on denoising methods for channel estimation that depend on either (i) channel analysis in the time-domain with prior channel knowledge or (ii) supervised learning techniques which require large prelabeled datasets for training. To address these limitations, we present a frequency-domain denoising method based on a reinforcement learning framework that does not need a priori channel knowledge and pre-labeled data. Our methodology includes a new successive channel denoising process based on channel curvature computation, for which we obtain a channel curvature magnitude threshold to identify unreliable channel estimates. Based on this process, we formulate the denoising mechanism as a Markov decision process, where we define the actions through a geometry-based channel estimation update, and the reward function based on a policy that reduces mean squared error (MSE). We then resort to Q-learning to update the channel estimates. Numerical results verify that our denoising algorithm can successfully mitigate noise in channel estimates. In particular, our algorithm provides a significant improvement over the practical least squares (LS) estimation method and provides performance that approaches that of the ideal linear minimum mean square error (LMMSE) estimation with perfect knowledge of channel statistics.

Original languageEnglish (US)
Title of host publicationICC 2021 - IEEE International Conference on Communications, Proceedings
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781728171227
StatePublished - Jun 2021
Externally publishedYes
Event2021 IEEE International Conference on Communications, ICC 2021 - Virtual, Online, Canada
Duration: Jun 14 2021Jun 23 2021

Publication series

NameIEEE International Conference on Communications
ISSN (Print)1550-3607


Conference2021 IEEE International Conference on Communications, ICC 2021
CityVirtual, Online

All Science Journal Classification (ASJC) codes

  • Computer Networks and Communications
  • Electrical and Electronic Engineering


  • Channel estimation
  • MIMO
  • OFDM
  • channel denoising
  • reinforcement learning


Dive into the research topics of 'Channel Estimation via Successive Denoising in MIMO OFDM Systems: A Reinforcement Learning Approach'. Together they form a unique fingerprint.

Cite this