Joint Trajectory and Passive Beamforming Design for Intelligent Reflecting Surface-Aided UAV Communications: A Deep Reinforcement Learning Approach

Wang, Liang, Wang, Kezhi, Pan, Cunhua and Aslam, Nauman (2022) Joint Trajectory and Passive Beamforming Design for Intelligent Reflecting Surface-Aided UAV Communications: A Deep Reinforcement Learning Approach. IEEE Transactions on Mobile Computing. ISSN 1536-1233 (In Press)

[img]
Preview
Text
TMC_accepted.pdf - Accepted Version

Download (1MB) | Preview

Abstract

In this paper, the intelligent reflecting surface (IRS)-aided unmanned aerial vehicle (UAV) communication system is studied, where the UAV is deployed to serve the user equipment (UE) with the assistance of multiple IRSs mounted on several buildings to enhance the communication quality between UAV and UE. We aim to maximize the energy efficiency of the system, including the data rate of UE and the energy consumption of UAV via jointly optimizing the UAV's trajectory and the phase shifts of reflecting elements of IRS, when the UE moves and the selection of IRSs is considered for the energy saving purpose. Since the system is complex and the environment is dynamic, it is challenging to derive low-complexity algorithms by using conventional optimization methods. To address this issue, we first propose a deep Q-network (DQN)-based algorithm by discretizing the trajectory, which has the advantage of training time. Furthermore, we propose a deep deterministic policy gradient (DDPG)-based algorithm to tackle the case with continuous trajectory for achieving better performance. The experimental results show that the proposed algorithms achieve considerable performance compared to other traditional solutions.

Item Type: Article
Uncontrolled Keywords: Deep Reinforcement Learning,, Intelligent Reflecting Surface, UAV communications
Subjects: G400 Computer Science
Department: Faculties > Engineering and Environment > Computer and Information Sciences
Related URLs:
Depositing User: Rachel Branson
Date Deposited: 31 Aug 2022 14:25
Last Modified: 31 Aug 2022 14:30
URI: https://nrl.northumbria.ac.uk/id/eprint/49990

Actions (login required)

View Item View Item

Downloads

Downloads per month over past year

View more statistics