Zhang, Huaqian, Li, Xiao, Gao, Ning, Yi, Xinping 
ORCID: 0000-0001-5163-2364 and Jin, Shi
(2023)
A Deep Reinforcement Learning Approach to Two-Timescale Transmission for RIS-aided Multiuser MISO systems.
IEEE Wireless Communications Letters, 12 (8).
p. 1.
|
PDF
Li_WCL2023-0791.pdf - Author Accepted Manuscript Download (2MB) | Preview |
Abstract
Reconfigurable intelligent surface (RIS) has drawn great attention recently as a promising technology for future wireless networks. In this letter, considering the two-timescale transmission protocol, we investigate the joint design of the transmit beamforming at the base station (BS) with instantaneous channel state information (CSI) and the RIS phase shifts with statistical CSI. Due to the large number of RIS elements, this design issue usually suffers from high computational complexity. To resolve the non-convexity issue with low complexity, we propose a novel deep reinforcement learning (DRL) framework, which contains two agents applying proximal policy optimization (PPO) based algorithm. Experiment results demonstrate that the proposed algorithm has comparable spectral efficiency performance to the state-of-the-art methods with substantially reduced computational delay.
| Item Type: | Article |
|---|---|
| Uncontrolled Keywords: | Index Terms-Deep reinforcement learning, reconfigurable intelligent surface, two-timescale optimization, beamforming |
| Divisions: | Faculty of Science and Engineering > School of Electrical Engineering, Electronics and Computer Science |
| Depositing User: | Symplectic Admin |
| Date Deposited: | 20 Jun 2023 07:42 |
| Last Modified: | 17 Mar 2024 16:57 |
| DOI: | 10.1109/lwc.2023.3278171 |
| Related URLs: | |
| URI: | https://livrepository.liverpool.ac.uk/id/eprint/3171089 |
Dimensions
Dimensions
